JUnit version 4.13.2
.14:04:23.726 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779113063718
14:04:23.771 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:04:23.827 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:04:23.839 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskFE7Z_S/test-tmp
14:04:23.844 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:04:23.847 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskFE7Z_S/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:04:24.048 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:04:24.249 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:04:24.251 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:04:24.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.254868 14570 mini_oidc.cc:150] Starting JWKS server
14:04:24.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.258395 14570 webserver.cc:533] Webserver started at http://127.0.0.1:34005/ using document root <none> and password file <none>
14:04:24.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.258982 14570 mini_oidc.cc:186] Starting OIDC Discovery server
14:04:24.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.261114 14570 webserver.cc:533] Webserver started at http://127.0.0.1:39089/ using document root <none> and password file <none>
14:04:24.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:04:24Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:04:24.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:04:24Z Disabled control of system clock
14:04:24.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.324254 14570 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:24.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:24.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal
14:04:24.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data
14:04:24.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:04:24.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:04:24.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:04:24.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:24.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:24.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:24.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/logs
14:04:24.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data/info.pb
14:04:24.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:24.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:04:24.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:04:24.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:04:24.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:04:24.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:24.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.190:44863
14:04:24.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.190
14:04:24.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:24.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:24.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:24.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:24.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:24.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:04:24.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:24.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:04:24.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34005/jwks.json with env {}
14:04:24.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.634631 14582 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:04:24.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.635177 14582 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:04:24.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.635603 14582 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:04:24.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.670665 14582 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:04:24.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.670964 14582 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:04:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.671154 14582 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:04:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.671479 14582 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:04:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.671818 14582 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:04:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.672067 14582 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34005/jwks.json
14:04:24.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.713088 14582 master_runner.cc:387] Master server non-default flags:
14:04:24.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:24.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:24.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:24.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:24.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data
14:04:24.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal
14:04:24.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:04:24.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:24.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.190:44863
14:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:04:24.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34005/jwks.json
14:04:24.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:24.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:24.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data/info.pb
14:04:24.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.190
14:04:24.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:24.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:04:24.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:24.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:04:24.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:04:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/logs
14:04:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:04:24.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:04:24.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:04:24.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:04:24.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:04:24.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:04:24.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:22 UTC on e7f111948823
14:04:24.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11959
14:04:24.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:04:24.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.714617 14582 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:04:24.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:24.716971 14582 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:04:24.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.730036 14588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:25.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.736055 14591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:25.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:24.731778 14589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:25.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:25.976199 14590 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1240 milliseconds
14:04:25.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.976343 14582 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:04:25.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.977914 14582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:04:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.980995 14582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:04:25.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.982388 14582 hybrid_clock.cc:648] HybridClock initialized: now 1779113065982344 us; error 71 us; skew 500 ppm
14:04:25.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.983250 14582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:04:25.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.989502 14582 webserver.cc:533] Webserver started at http://127.14.58.190:34861/ using document root <none> and password file <none>
14:04:25.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.990476 14582 fs_manager.cc:362] Metadata directory not provided
14:04:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.990731 14582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:04:25.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.991109 14582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:04:25.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.995697 14582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data/instance:
14:04:25.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b904a3029014da58aaa503679da4cb4"
14:04:25.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:25 on dist-test-slave-dvk1"
14:04:25.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:25.996768 14582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal/instance:
14:04:25.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b904a3029014da58aaa503679da4cb4"
14:04:25.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:25 on dist-test-slave-dvk1"
14:04:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.004194 14582 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
14:04:26.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.010154 14598 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:04:26.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.012161 14582 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
14:04:26.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.012814 14582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data,/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal
14:04:26.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b904a3029014da58aaa503679da4cb4"
14:04:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:25 on dist-test-slave-dvk1"
14:04:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.013283 14582 fs_report.cc:389] FS layout report
14:04:26.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:04:26.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal
14:04:26.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal
14:04:26.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data/data
14:04:26.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:04:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:04:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:04:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:04:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:04:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:04:26.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:04:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.069324 14582 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:04:26.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.070820 14582 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:04:26.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.071223 14582 kserver.cc:163] Server-wide thread pool size limit: 3276
14:04:26.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.145334 14582 rpc_server.cc:307] RPC server started. Bound to: 127.14.58.190:44863
14:04:26.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.145426 14649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.58.190:44863 every 8 connection(s)
14:04:26.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.148082 14582 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/data/info.pb
14:04:26.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.154201 14650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:04:26.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.158720 14570 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu as pid 14582
14:04:26.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.159216 14570 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-0/wal/instance
14:04:26.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.164729 14570 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:26.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:26.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal
14:04:26.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data
14:04:26.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:04:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:04:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:04:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:26.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/logs
14:04:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data/info.pb
14:04:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:26.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:04:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:04:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:04:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:04:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:26.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.189:43579
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.189
14:04:26.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:26.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:26.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:26.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:26.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:26.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:04:26.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:26.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:04:26.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34005/jwks.json with env {}
14:04:26.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.170784 14650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } has no permanent_uuid. Determining permanent_uuid...
14:04:26.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.209589 14650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } has no permanent_uuid. Determining permanent_uuid...
14:04:26.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.212253 14600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:26.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.216403 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:26.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.265902 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 1
14:04:26.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.270253 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:26.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.338663 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 2
14:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.342922 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.434324 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 3
14:04:26.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.439229 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:26.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.488745 14652 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:04:26.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.489573 14652 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:04:26.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.490381 14652 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:04:26.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.525952 14652 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:04:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.526364 14652 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:04:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.526736 14652 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:04:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.527071 14652 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:04:26.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.527443 14652 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:04:26.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.527737 14652 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34005/jwks.json
14:04:26.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.567220 14652 master_runner.cc:387] Master server non-default flags:
14:04:26.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:26.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:26.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:26.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data
14:04:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal
14:04:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:04:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:26.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:04:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.189:43579
14:04:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:04:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:04:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34005/jwks.json
14:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data/info.pb
14:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.189
14:04:26.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:26.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/logs
14:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:04:26.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:04:26.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:04:26.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:04:26.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:04:26.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:04:26.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:22 UTC on e7f111948823
14:04:26.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11959
14:04:26.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:04:26.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.569046 14652 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:04:26.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.571509 14652 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:04:26.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.582677 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 4
14:04:26.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.587132 14661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.588951 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:26.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.888510 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 5
14:04:26.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.892673 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:27.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.440181 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 6
14:04:27.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:27.448495 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.189:43579: Network error: Client connection negotiation failed: client connection to 127.14.58.189:43579: connect: Connection refused (error 111)
14:04:27.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.591728 14662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:27.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:26.592725 14664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:27.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:26.592585 14652 server_base.cc:1061] running on GCE node
14:04:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.812364 14652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:04:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.815572 14652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:04:27.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.816965 14652 hybrid_clock.cc:648] HybridClock initialized: now 1779113067816931 us; error 72 us; skew 500 ppm
14:04:27.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.818091 14652 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:04:27.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.825702 14652 webserver.cc:533] Webserver started at http://127.14.58.189:43619/ using document root <none> and password file <none>
14:04:27.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.826810 14652 fs_manager.cc:362] Metadata directory not provided
14:04:27.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.827097 14652 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:04:27.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.827662 14652 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:04:27.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.832269 14652 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data/instance:
14:04:27.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "768b9510a7ad4fee9083250a50dc308b"
14:04:27.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:27 on dist-test-slave-dvk1"
14:04:27.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.833564 14652 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal/instance:
14:04:27.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "768b9510a7ad4fee9083250a50dc308b"
14:04:27.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:27 on dist-test-slave-dvk1"
14:04:27.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.841235 14652 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
14:04:27.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.847004 14673 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:04:27.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.848157 14652 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
14:04:27.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.848459 14652 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data,/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal
14:04:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "768b9510a7ad4fee9083250a50dc308b"
14:04:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:27 on dist-test-slave-dvk1"
14:04:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.848779 14652 fs_report.cc:389] FS layout report
14:04:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:04:27.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal
14:04:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal
14:04:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data/data
14:04:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:04:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:04:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.912642 14652 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:04:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.914136 14652 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:04:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.914590 14652 kserver.cc:163] Server-wide thread pool size limit: 3276
14:04:27.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.989647 14652 rpc_server.cc:307] RPC server started. Bound to: 127.14.58.189:43579
14:04:27.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.989733 14724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.58.189:43579 every 8 connection(s)
14:04:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.992300 14652 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/data/info.pb
14:04:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.998170 14570 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu as pid 14652
14:04:27.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.998693 14570 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-1/wal/instance
14:04:27.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:27.998893 14725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:04:28.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.001724 14570 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:28.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:28.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal
14:04:28.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/logs
14:04:28.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data/info.pb
14:04:28.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:28.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:04:28.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:04:28.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:04:28.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:04:28.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:04:28.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.188:42487
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.188
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:28.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:04:28.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:28.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:04:28.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34005/jwks.json with env {}
14:04:28.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.014819 14725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } has no permanent_uuid. Determining permanent_uuid...
14:04:28.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.039582 14725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } has no permanent_uuid. Determining permanent_uuid...
14:04:28.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.055124 14725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } has no permanent_uuid. Determining permanent_uuid...
14:04:28.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.057871 14677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.062327 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.111979 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 1
14:04:28.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.116245 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.184787 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 2
14:04:28.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.189236 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.280710 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 3
14:04:28.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.285529 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.341183 14727 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:04:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.341734 14727 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:04:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.342450 14727 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:04:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.377375 14727 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:04:28.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.377691 14727 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:04:28.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.377889 14727 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:04:28.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.378073 14727 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:04:28.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.378342 14727 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:04:28.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.378705 14727 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34005/jwks.json
14:04:28.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.415980 14727 master_runner.cc:387] Master server non-default flags:
14:04:28.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:28.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.188:42487
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34005/jwks.json
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data/info.pb
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.188
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:04:28.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/logs
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:04:28.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:04:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:04:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:04:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:22 UTC on e7f111948823
14:04:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11959
14:04:28.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:04:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.417407 14727 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:04:28.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.419183 14727 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:04:28.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.428992 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 4
14:04:28.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.431018 14737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:28.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.434530 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.508994 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } attempt: 7
14:04:28.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.521555 14650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } has no permanent_uuid. Determining permanent_uuid...
14:04:28.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.527572 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.585999 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 1
14:04:28.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.592691 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.674304 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 2
14:04:28.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.687093 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.734124 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 5
14:04:28.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.744292 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.772850 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 3
14:04:28.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.780524 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:28.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:28.921103 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 4
14:04:28.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.928323 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:29.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.211969 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 5
14:04:29.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:29.219517 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:29.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.291968 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 6
14:04:29.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:29.302527 14725 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:29.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.436435 14740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:29.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:28.433034 14738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:29.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:29.735378 14739 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1302 milliseconds
14:04:29.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.735492 14727 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:04:29.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.736742 14727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:04:29.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.739877 14727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:04:29.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.741428 14727 hybrid_clock.cc:648] HybridClock initialized: now 1779113069741359 us; error 76 us; skew 500 ppm
14:04:29.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.742211 14727 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:04:29.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.749281 14727 webserver.cc:533] Webserver started at http://127.14.58.188:42281/ using document root <none> and password file <none>
14:04:29.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.750301 14727 fs_manager.cc:362] Metadata directory not provided
14:04:29.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.750514 14727 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:04:29.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.751082 14727 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:04:29.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.756201 14727 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data/instance:
14:04:29.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "14dfe6ac79314ec5a37cd539294f6b82"
14:04:29.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:29 on dist-test-slave-dvk1"
14:04:29.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.757462 14727 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal/instance:
14:04:29.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "14dfe6ac79314ec5a37cd539294f6b82"
14:04:29.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:29 on dist-test-slave-dvk1"
14:04:29.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.765874 14727 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.000s
14:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.772267 14751 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:04:29.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.773324 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 6
14:04:29.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.773907 14727 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
14:04:29.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.774282 14727 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data,/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal
14:04:29.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "14dfe6ac79314ec5a37cd539294f6b82"
14:04:29.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:29 on dist-test-slave-dvk1"
14:04:29.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.774781 14727 fs_report.cc:389] FS layout report
14:04:29.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:04:29.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data/data
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:04:29.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:04:29.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:04:29.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:04:29.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:04:29.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:04:29.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:04:29.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:29.783061 14650 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.58.188:42487: Network error: Client connection negotiation failed: client connection to 127.14.58.188:42487: connect: Connection refused (error 111)
14:04:29.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.869957 14727 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:04:29.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.871812 14727 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:04:29.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.872267 14727 kserver.cc:163] Server-wide thread pool size limit: 3276
14:04:29.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.949512 14727 rpc_server.cc:307] RPC server started. Bound to: 127.14.58.188:42487
14:04:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.949594 14804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.58.188:42487 every 8 connection(s)
14:04:29.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.952539 14727 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/data/info.pb
14:04:29.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.953367 14570 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu as pid 14727
14:04:29.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.953868 14570 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/master-2/wal/instance
14:04:29.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.961385 14805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:04:29.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:29.980309 14805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } has no permanent_uuid. Determining permanent_uuid...
14:04:30.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.007566 14805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } has no permanent_uuid. Determining permanent_uuid...
14:04:30.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.019074 14805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } has no permanent_uuid. Determining permanent_uuid...
14:04:30.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.037472 14805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: Bootstrap starting.
14:04:30.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.044127 14805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: Neither blocks nor log segments found. Creating new log.
14:04:30.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.046696 14805 log.cc:826] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: Log is configured to *not* fsync() on all Append() calls
14:04:30.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.051527 14805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: No bootstrap required, opened a new log
14:04:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.072103 14805 raft_consensus.cc:359] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.072813 14805 raft_consensus.cc:385] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:04:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.073103 14805 raft_consensus.cc:740] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14dfe6ac79314ec5a37cd539294f6b82, State: Initialized, Role: FOLLOWER
14:04:30.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.073954 14805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.076469 14814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:30.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.077489 14814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: This master's current role is: FOLLOWER
14:04:30.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.078578 14805 sys_catalog.cc:565] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: configured and running, proceeding with master startup.
14:04:30.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:30.103889 14825 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:04:30.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:30.104198 14825 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:04:30.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:30.128165 14759 tablet.cc:2404] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:04:30.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.100806 14727 master_runner.cc:187] Error getting master registration for 127.14.58.190:44863: OK, instance_id { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" instance_seqno: 1779113066126656 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:04:30.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.130414 14727 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:04:30.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.282737 14814 raft_consensus.cc:493] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:04:30.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.283281 14814 raft_consensus.cc:515] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.285372 14814 leader_election.cc:290] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b904a3029014da58aaa503679da4cb4 (127.14.58.190:44863), 768b9510a7ad4fee9083250a50dc308b (127.14.58.189:43579)
14:04:30.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.363158 14725 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 7
14:04:30.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.387503 14725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: Bootstrap starting.
14:04:30.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.395838 14725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: Neither blocks nor log segments found. Creating new log.
14:04:30.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.398173 14725 log.cc:826] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: Log is configured to *not* fsync() on all Append() calls
14:04:30.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.408234 14725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: No bootstrap required, opened a new log
14:04:30.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.442790 14725 raft_consensus.cc:359] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.444028 14725 raft_consensus.cc:385] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:04:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.444540 14725 raft_consensus.cc:740] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 768b9510a7ad4fee9083250a50dc308b, State: Initialized, Role: FOLLOWER
14:04:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.446573 14725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.451108 14829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:30.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.452625 14725 sys_catalog.cc:565] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: configured and running, proceeding with master startup.
14:04:30.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.453271 14700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "14dfe6ac79314ec5a37cd539294f6b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "768b9510a7ad4fee9083250a50dc308b" is_pre_election: true
14:04:30.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.454124 14700 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14dfe6ac79314ec5a37cd539294f6b82 in term 0.
14:04:30.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.454285 14829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: This master's current role is: FOLLOWER
14:04:30.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.455688 14755 leader_election.cc:304] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14dfe6ac79314ec5a37cd539294f6b82, 768b9510a7ad4fee9083250a50dc308b; no voters: 
14:04:30.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.457240 14814 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:04:30.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.457674 14814 raft_consensus.cc:493] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:04:30.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.458415 14814 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 0 FOLLOWER]: Advancing to term 1
14:04:30.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.475723 14814 raft_consensus.cc:515] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.484740 14814 leader_election.cc:290] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [CANDIDATE]: Term 1 election: Requested vote from peers 0b904a3029014da58aaa503679da4cb4 (127.14.58.190:44863), 768b9510a7ad4fee9083250a50dc308b (127.14.58.189:43579)
14:04:30.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.486171 14700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "14dfe6ac79314ec5a37cd539294f6b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "768b9510a7ad4fee9083250a50dc308b"
14:04:30.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.486982 14700 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 0 FOLLOWER]: Advancing to term 1
14:04:30.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.497480 14700 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14dfe6ac79314ec5a37cd539294f6b82 in term 1.
14:04:30.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.499620 14755 leader_election.cc:304] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14dfe6ac79314ec5a37cd539294f6b82, 768b9510a7ad4fee9083250a50dc308b; no voters: 
14:04:30.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.500814 14814 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 1 FOLLOWER]: Leader election won for term 1
14:04:30.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.515202 14814 raft_consensus.cc:697] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [term 1 LEADER]: Becoming Leader. State: Replica: 14dfe6ac79314ec5a37cd539294f6b82, State: Running, Role: LEADER
14:04:30.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.525532 14814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:30.525301 14840 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:04:30.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:30.526489 14840 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:04:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.537220 14841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14dfe6ac79314ec5a37cd539294f6b82. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.538093 14841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: This master's current role is: LEADER
14:04:30.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.540934 14844 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
14:04:30.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.548230 14844 catalog_manager.cc:1519] Initializing Kudu cluster ID...
14:04:30.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.497505 14652 master_runner.cc:187] Error getting master registration for 127.14.58.190:44863: OK, instance_id { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" instance_seqno: 1779113066126656 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:04:30.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.582619 14652 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:04:30.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.592065 14700 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [term 1 FOLLOWER]: Refusing update from remote peer 14dfe6ac79314ec5a37cd539294f6b82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:04:30.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.594442 14814 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:04:30.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.625316 14829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14dfe6ac79314ec5a37cd539294f6b82. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:30.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.626173 14829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: This master's current role is: FOLLOWER
14:04:30.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.634002 14845 mvcc.cc:204] Tried to move back new op lower bound from 7287247137123090432 to 7287247136883064832. Current Snapshot: MvccSnapshot[applied={T|T < 7287247137123090432}]
14:04:30.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.636206 14814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:30.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.636950 14814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: This master's current role is: LEADER
14:04:30.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.640591 14844 catalog_manager.cc:1382] Generated new cluster ID: b6853fee4ef44cbaa767268ecafbd48a
14:04:30.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.640904 14844 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
14:04:30.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.644250 14846 mvcc.cc:204] Tried to move back new op lower bound from 7287247137123090432 to 7287247136883064832. Current Snapshot: MvccSnapshot[applied={T|T < 7287247137123090432}]
14:04:30.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.659989 14829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:30.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.660712 14829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b [sys.catalog]: This master's current role is: FOLLOWER
14:04:30.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.697060 14844 catalog_manager.cc:1405] Generated new certificate authority record
14:04:30.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.699996 14844 catalog_manager.cc:1539] Loading token signing keys...
14:04:30.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.736690 14844 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82: Generated new TSK 0
14:04:30.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.738360 14844 catalog_manager.cc:1549] Initializing in-progress tserver states...
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.796648 14570 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:04:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/logs
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data/info.pb
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:30.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.129:0
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.58.129
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.129
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:30.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:04:30.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.816511 14650 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } attempt: 7
14:04:30.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.861749 14650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: Bootstrap starting.
14:04:30.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.880349 14650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: Neither blocks nor log segments found. Creating new log.
14:04:30.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.882664 14650 log.cc:826] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: Log is configured to *not* fsync() on all Append() calls
14:04:30.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.905471 14650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: No bootstrap required, opened a new log
14:04:30.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.971436 14650 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:30.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.976168 14650 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:04:30.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.977777 14650 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b904a3029014da58aaa503679da4cb4, State: Initialized, Role: FOLLOWER
14:04:30.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:30.980939 14650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } }
14:04:31.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.011175 14623 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [term 0 FOLLOWER]: Advancing to term 1
14:04:31.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.015527 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "14dfe6ac79314ec5a37cd539294f6b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b904a3029014da58aaa503679da4cb4" is_pre_election: true
14:04:31.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.010485 14624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "14dfe6ac79314ec5a37cd539294f6b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b904a3029014da58aaa503679da4cb4"
14:04:31.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.027112 14623 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [term 1 FOLLOWER]: Refusing update from remote peer 14dfe6ac79314ec5a37cd539294f6b82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:04:31.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.030156 14814 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:04:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.007913 14853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.039300 14853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: This master's current role is: FOLLOWER
14:04:31.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.028420 14650 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: configured and running, proceeding with master startup.
14:04:31.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.078904 14856 mvcc.cc:204] Tried to move back new op lower bound from 7287247137123090432 to 7287247136883064832. Current Snapshot: MvccSnapshot[applied={T|T < 7287247137123090432}]
14:04:31.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.107402 14854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:31.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.108592 14854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: This master's current role is: FOLLOWER
14:04:31.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.106314 14853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14dfe6ac79314ec5a37cd539294f6b82. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:31.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.110466 14853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4 [sys.catalog]: This master's current role is: FOLLOWER
14:04:31.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.163997 14869 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:04:31.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.423537 14850 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:04:31.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.424103 14850 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:04:31.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.424767 14850 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:04:31.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.461932 14850 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:04:31.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.462993 14850 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.58.129
14:04:31.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.522181 14850 tablet_server_runner.cc:78] Tablet server non-default flags:
14:04:31.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:31.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:31.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:31.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:31.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data
14:04:31.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.129:0
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data/info.pb
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.129
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:04:31.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.58.129
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/logs
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:22 UTC on e7f111948823
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11959
14:04:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:04:31.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.524205 14850 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:04:31.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.526522 14850 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:04:31.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.528785 14874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "14dfe6ac79314ec5a37cd539294f6b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b904a3029014da58aaa503679da4cb4" member_type: VOTER last_known_addr { host: "127.14.58.190" port: 44863 } } peers { permanent_uuid: "768b9510a7ad4fee9083250a50dc308b" member_type: VOTER last_known_addr { host: "127.14.58.189" port: 43579 } } peers { permanent_uuid: "14dfe6ac79314ec5a37cd539294f6b82" member_type: VOTER last_known_addr { host: "127.14.58.188" port: 42487 } } }
14:04:31.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.529742 14874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 [sys.catalog]: This master's current role is: LEADER
14:04:31.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.532155 14840 catalog_manager.cc:1294] Loaded cluster ID: b6853fee4ef44cbaa767268ecafbd48a
14:04:31.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.532665 14840 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: loading cluster ID for follower catalog manager: success
14:04:31.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.539820 14840 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: acquiring CA information for follower catalog manager: success
14:04:31.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:31.545776 14840 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 768b9510a7ad4fee9083250a50dc308b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:04:31.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.551640 14878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:32.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:32.195683 14869 catalog_manager.cc:1294] Loaded cluster ID: b6853fee4ef44cbaa767268ecafbd48a
14:04:32.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:32.195971 14869 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: loading cluster ID for follower catalog manager: success
14:04:32.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:32.209519 14869 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: acquiring CA information for follower catalog manager: success
14:04:32.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:32.223178 14869 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0b904a3029014da58aaa503679da4cb4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:04:34.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:32.952919 14877 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 14850
14:04:34.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:34.680087 14877 kernel_stack_watchdog.cc:198] Thread 14850 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
14:04:34.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:04:34.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:04:34.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:04:34.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:04:34.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:34.681655 14881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:34.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:31.554944 14879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:34.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:34.682808 14880 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 3125 milliseconds
14:04:34.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:34.683925 14850 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 3.130s	user 0.841s	sys 1.431s
14:04:34.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:34.684271 14850 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 3.130s	user 0.841s	sys 1.431s
14:04:34.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.684717 14850 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:04:34.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.687559 14850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:04:34.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.690867 14850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:04:34.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.694352 14850 hybrid_clock.cc:648] HybridClock initialized: now 1779113074694296 us; error 64 us; skew 500 ppm
14:04:34.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.695530 14850 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:04:34.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.703336 14850 webserver.cc:533] Webserver started at http://127.14.58.129:43135/ using document root <none> and password file <none>
14:04:34.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.704468 14850 fs_manager.cc:362] Metadata directory not provided
14:04:34.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.704730 14850 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:04:34.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.705302 14850 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:04:34.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.710022 14850 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data/instance:
14:04:34.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d8fa0b74abc84de8867b91881cd9802e"
14:04:34.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:34 on dist-test-slave-dvk1"
14:04:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.711784 14850 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal/instance:
14:04:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d8fa0b74abc84de8867b91881cd9802e"
14:04:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:34 on dist-test-slave-dvk1"
14:04:34.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.721077 14850 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.000s	sys 0.009s
14:04:34.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.728039 14892 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.729400 14850 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.729703 14850 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data,/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d8fa0b74abc84de8867b91881cd9802e"
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:34 on dist-test-slave-dvk1"
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.730021 14850 fs_report.cc:389] FS layout report
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data/data
14:04:34.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:04:34.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:04:34.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.790041 14850 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:04:34.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.791698 14850 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:04:34.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.792219 14850 kserver.cc:163] Server-wide thread pool size limit: 3276
14:04:34.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.796096 14850 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:04:34.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.802824 14850 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:04:34.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.803135 14850 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:04:34.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.803439 14850 ts_tablet_manager.cc:616] Registered 0 tablets
14:04:34.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:34.803653 14850 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:04:35.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.053035 14850 rpc_server.cc:307] RPC server started. Bound to: 127.14.58.129:36077
14:04:35.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.053162 15004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.58.129:36077 every 8 connection(s)
14:04:35.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.057474 14850 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/data/info.pb
14:04:35.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.063262 14570 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu as pid 14850
14:04:35.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.063901 14570 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-0/wal/instance
14:04:35.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.095467 14570 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/logs
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data/info.pb
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:04:35.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.130:0
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.58.130
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.130
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:04:35.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.136018 15005 heartbeater.cc:344] Connected to a master server at 127.14.58.189:43579
14:04:35.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.136518 15005 heartbeater.cc:461] Registering TS with master...
14:04:35.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.137882 15005 heartbeater.cc:507] Master 127.14.58.189:43579 requested a full tablet report, sending...
14:04:35.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.141594 14689 ts_manager.cc:194] Registered new tserver with Master: d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077)
14:04:35.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.145664 15006 heartbeater.cc:344] Connected to a master server at 127.14.58.188:42487
14:04:35.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.146010 15006 heartbeater.cc:461] Registering TS with master...
14:04:35.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.146888 15006 heartbeater.cc:507] Master 127.14.58.188:42487 requested a full tablet report, sending...
14:04:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.149586 14770 ts_manager.cc:194] Registered new tserver with Master: d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077)
14:04:35.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.152294 14770 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.58.129:39109
14:04:35.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.148000 15011 heartbeater.cc:344] Connected to a master server at 127.14.58.190:44863
14:04:35.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.155285 15011 heartbeater.cc:461] Registering TS with master...
14:04:35.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.156370 15011 heartbeater.cc:507] Master 127.14.58.190:44863 requested a full tablet report, sending...
14:04:35.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.159724 14615 ts_manager.cc:194] Registered new tserver with Master: d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077)
14:04:35.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.467267 15012 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:04:35.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.467950 15012 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:04:35.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.468650 15012 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:04:35.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.505898 15012 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:04:35.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.506772 15012 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.58.130
14:04:35.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.545341 15012 tablet_server_runner.cc:78] Tablet server non-default flags:
14:04:35.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:35.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:35.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.130:0
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data/info.pb
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.130
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.58.130
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/logs
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:22 UTC on e7f111948823
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11959
14:04:35.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:04:35.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.546761 15012 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:04:35.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:35.548667 15012 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:04:35.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.564863 15021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:36.156776 15006 heartbeater.cc:499] Master 127.14.58.188:42487 was elected leader, sending a full tablet report...
14:04:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:36.969197 15020 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 15012
14:04:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.277781 15020 kernel_stack_watchdog.cc:198] Thread 15012 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
14:04:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:04:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:04:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:04:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:04:37.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:35.565884 15022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:37.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.279397 15012 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.713s	user 0.001s	sys 0.000s
14:04:37.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.279760 15012 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.713s	user 0.002s	sys 0.000s
14:04:37.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.282320 15024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:37.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.286082 15023 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1710 milliseconds
14:04:37.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.286171 15012 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:04:37.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.287581 15012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:04:37.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.290251 15012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:04:37.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.291791 15012 hybrid_clock.cc:648] HybridClock initialized: now 1779113077291736 us; error 67 us; skew 500 ppm
14:04:37.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.292619 15012 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:04:37.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.298848 15012 webserver.cc:533] Webserver started at http://127.14.58.130:45009/ using document root <none> and password file <none>
14:04:37.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.299885 15012 fs_manager.cc:362] Metadata directory not provided
14:04:37.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.300141 15012 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:04:37.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.300729 15012 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:04:37.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.306743 15012 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data/instance:
14:04:37.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f87b8acaabbb4817845a133357fa1295"
14:04:37.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:37 on dist-test-slave-dvk1"
14:04:37.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.308173 15012 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal/instance:
14:04:37.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f87b8acaabbb4817845a133357fa1295"
14:04:37.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:37 on dist-test-slave-dvk1"
14:04:37.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.316242 15012 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
14:04:37.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.322017 15032 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:04:37.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.323246 15012 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.323618 15012 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data,/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f87b8acaabbb4817845a133357fa1295"
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:37 on dist-test-slave-dvk1"
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.324021 15012 fs_report.cc:389] FS layout report
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data/data
14:04:37.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:04:37.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:04:37.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.373791 15012 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:04:37.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.375456 15012 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:04:37.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.376003 15012 kserver.cc:163] Server-wide thread pool size limit: 3276
14:04:37.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.378690 15012 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:04:37.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.383246 15012 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:04:37.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.383450 15012 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:04:37.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.383739 15012 ts_tablet_manager.cc:616] Registered 0 tablets
14:04:37.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.383874 15012 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:04:37.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.547698 15012 rpc_server.cc:307] RPC server started. Bound to: 127.14.58.130:42517
14:04:37.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.547807 15144 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.58.130:42517 every 8 connection(s)
14:04:37.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.550243 15012 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/data/info.pb
14:04:37.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.558072 14570 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu as pid 15012
14:04:37.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.560258 14570 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-1/wal/instance
14:04:37.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.580255 14570 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/logs
14:04:37.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data/info.pb
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.131:0
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.58.131
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.131
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:37.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:04:37.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.600283 15146 heartbeater.cc:344] Connected to a master server at 127.14.58.188:42487
14:04:37.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.600903 15146 heartbeater.cc:461] Registering TS with master...
14:04:37.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.601132 15145 heartbeater.cc:344] Connected to a master server at 127.14.58.189:43579
14:04:37.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.601467 15145 heartbeater.cc:461] Registering TS with master...
14:04:37.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.602315 15147 heartbeater.cc:344] Connected to a master server at 127.14.58.190:44863
14:04:37.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.602959 15147 heartbeater.cc:461] Registering TS with master...
14:04:37.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.602902 15146 heartbeater.cc:507] Master 127.14.58.188:42487 requested a full tablet report, sending...
14:04:37.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.603474 15145 heartbeater.cc:507] Master 127.14.58.189:43579 requested a full tablet report, sending...
14:04:37.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.604046 15147 heartbeater.cc:507] Master 127.14.58.190:44863 requested a full tablet report, sending...
14:04:37.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.605976 14770 ts_manager.cc:194] Registered new tserver with Master: f87b8acaabbb4817845a133357fa1295 (127.14.58.130:42517)
14:04:37.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.606505 14689 ts_manager.cc:194] Registered new tserver with Master: f87b8acaabbb4817845a133357fa1295 (127.14.58.130:42517)
14:04:37.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.607519 14615 ts_manager.cc:194] Registered new tserver with Master: f87b8acaabbb4817845a133357fa1295 (127.14.58.130:42517)
14:04:37.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:37.607654 14770 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.58.130:54369
14:04:37.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.943236 15155 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:04:37.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.943869 15155 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:04:37.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.944536 15155 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:04:37.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.982106 15155 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:04:37.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:37.983386 15155 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.58.131
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:38.022073 15155 tablet_server_runner.cc:78] Tablet server non-default flags:
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.58.148:35099
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data
14:04:38.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.58.131:0
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data/info.pb
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.58.131
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.58.190:44863,127.14.58.189:43579,127.14.58.188:42487
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.58.131
14:04:38.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/logs
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:22 UTC on e7f111948823
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11959
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:04:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:38.023937 15155 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:04:38.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:38.025790 15155 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:04:38.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:38.040638 15161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:38.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:38.612826 15146 heartbeater.cc:499] Master 127.14.58.188:42487 was elected leader, sending a full tablet report...
14:04:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:39.443303 15160 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 15155
14:04:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:39.463996 15160 kernel_stack_watchdog.cc:198] Thread 15155 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
14:04:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:04:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:04:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:04:39.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:04:39.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:38.041280 15162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:39.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:39.465945 15155 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.426s	user 0.492s	sys 0.865s
14:04:39.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:39.466197 15155 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.427s	user 0.492s	sys 0.865s
14:04:39.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:39.471522 15163 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1424 milliseconds
14:04:39.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:39.473560 15164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:04:39.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.473642 15155 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:04:39.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.475193 15155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:04:39.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.477718 15155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:04:39.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.479154 15155 hybrid_clock.cc:648] HybridClock initialized: now 1779113079479116 us; error 45 us; skew 500 ppm
14:04:39.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.480075 15155 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:04:39.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.486769 15155 webserver.cc:533] Webserver started at http://127.14.58.131:42607/ using document root <none> and password file <none>
14:04:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.487875 15155 fs_manager.cc:362] Metadata directory not provided
14:04:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.488131 15155 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:04:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.488698 15155 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:04:39.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.493235 15155 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data/instance:
14:04:39.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b521f014658b4aafa834d260a2b1ecce"
14:04:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:39 on dist-test-slave-dvk1"
14:04:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.494599 15155 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal/instance:
14:04:39.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b521f014658b4aafa834d260a2b1ecce"
14:04:39.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:39 on dist-test-slave-dvk1"
14:04:39.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.502614 15155 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
14:04:39.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.509272 15172 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:04:39.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.510699 15155 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
14:04:39.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.511083 15155 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data,/tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal
14:04:39.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b521f014658b4aafa834d260a2b1ecce"
14:04:39.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:04:39 on dist-test-slave-dvk1"
14:04:39.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.511531 15155 fs_report.cc:389] FS layout report
14:04:39.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:04:39.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal
14:04:39.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal
14:04:39.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data/data
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:04:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:04:39.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.561240 15155 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:04:39.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.562867 15155 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:04:39.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.563395 15155 kserver.cc:163] Server-wide thread pool size limit: 3276
14:04:39.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.566320 15155 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:04:39.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.571449 15155 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:04:39.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.571825 15155 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:04:39.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.572160 15155 ts_tablet_manager.cc:616] Registered 0 tablets
14:04:39.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.572373 15155 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:04:39.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.740381 15155 rpc_server.cc:307] RPC server started. Bound to: 127.14.58.131:33497
14:04:39.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.740513 15284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.58.131:33497 every 8 connection(s)
14:04:39.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.743343 15155 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/data/info.pb
14:04:39.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.752173 14570 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu as pid 15155
14:04:39.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.752911 14570 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFE7Z_S/test-tmp/mini-kudu-cluster18332557316646226361/ts-2/wal/instance
14:04:39.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.794206 15286 heartbeater.cc:344] Connected to a master server at 127.14.58.188:42487
14:04:39.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.795243 15286 heartbeater.cc:461] Registering TS with master...
14:04:39.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.796571 15286 heartbeater.cc:507] Master 127.14.58.188:42487 requested a full tablet report, sending...
14:04:39.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.798758 15287 heartbeater.cc:344] Connected to a master server at 127.14.58.190:44863
14:04:39.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.799081 15287 heartbeater.cc:461] Registering TS with master...
14:04:39.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.800006 15287 heartbeater.cc:507] Master 127.14.58.190:44863 requested a full tablet report, sending...
14:04:39.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.800655 15285 heartbeater.cc:344] Connected to a master server at 127.14.58.189:43579
14:04:39.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.801005 15285 heartbeater.cc:461] Registering TS with master...
14:04:39.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.801903 15285 heartbeater.cc:507] Master 127.14.58.189:43579 requested a full tablet report, sending...
14:04:39.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.803761 14615 ts_manager.cc:194] Registered new tserver with Master: b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497)
14:04:39.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.804723 14689 ts_manager.cc:194] Registered new tserver with Master: b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497)
14:04:39.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.806278 14770 ts_manager.cc:194] Registered new tserver with Master: b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497)
14:04:39.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.808156 14770 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.58.131:47357
14:04:39.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:39.816388 14570 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:04:39.829 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:04:39.831 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:04:39.844 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.14.58.190"
      port: 44863
    }
    bound_http_address {
      host: "127.14.58.190"
      port: 34861
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.14.58.189"
      port: 43579
    }
    bound_http_address {
      host: "127.14.58.189"
      port: 43619
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.14.58.188"
      port: 42487
    }
    bound_http_address {
      host: "127.14.58.188"
      port: 42281
    }
  }
}

14:04:39.849 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:04:39.852 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.14.58.129"
      port: 36077
    }
    bound_http_address {
      host: "127.14.58.129"
      port: 43135
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.14.58.130"
      port: 42517
    }
    bound_http_address {
      host: "127.14.58.130"
      port: 45009
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.14.58.131"
      port: 33497
    }
    bound_http_address {
      host: "127.14.58.131"
      port: 42607
    }
  }
}

14:04:39.853 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:04:40.072 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
14:04:40.135 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:04:40.336 [DEBUG - main] (Connection.java:748) [peer master-127.14.58.190:44863(127.14.58.190:44863)] connecting to peer
14:04:40.391 [DEBUG - main] (Connection.java:748) [peer master-127.14.58.188:42487(127.14.58.188:42487)] connecting to peer
14:04:40.393 [DEBUG - main] (Connection.java:748) [peer master-127.14.58.189:43579(127.14.58.189:43579)] connecting to peer
14:04:40.419 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.58.189:43579(127.14.58.189:43579)] Successfully connected to peer
14:04:40.418 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.58.188:42487(127.14.58.188:42487)] Successfully connected to peer
14:04:40.435 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.58.190:44863(127.14.58.190:44863)] Successfully connected to peer
14:04:40.564 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.58.190
14:04:40.564 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.58.188
14:04:40.564 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.58.189
14:04:40.807 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe1639262, L:/127.0.0.1:32852 - R:/127.14.58.188:42487] using SASL/PLAIN
14:04:40.811 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x950aa580, L:/127.0.0.1:40976 - R:/127.14.58.189:43579] using SASL/PLAIN
14:04:40.812 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x040d4c91, L:/127.0.0.1:34152 - R:/127.14.58.190:44863] using SASL/PLAIN
14:04:40.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:40.813783 15286 heartbeater.cc:499] Master 127.14.58.188:42487 was elected leader, sending a full tablet report...
14:04:40.854 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:04:40.855 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=564), Traces: [0ms] refreshing cache from master, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.58.190:44863, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.58.188:42487, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.58.189:43579, [532ms] Sub RPC ConnectToMaster: received response from server master-127.14.58.190:44863: OK, [532ms] Sub RPC ConnectToMaster: received response from server master-127.14.58.189:43579: OK, [532ms] Sub RPC ConnectToMaster: received response from server master-127.14.58.188:42487: OK, deferred=null) after lookup
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:40.912336 14769 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32852:
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestLeaderFailover-1779113063048"
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:04:40.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:04:40.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:04:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:04:40.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:40.916903 14769 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestLeaderFailover-1779113063048 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:04:40.998 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table dc291defffc04eb5b3a544657987800a
14:04:41.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.070399 15080 tablet_service.cc:1511] Processing CreateTablet for tablet 0c176908afe7440d8b41f4dd8b7f3993 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779113063048 [id=dc291defffc04eb5b3a544657987800a]), partition=RANGE (key) PARTITION UNBOUNDED
14:04:41.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.073448 15080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c176908afe7440d8b41f4dd8b7f3993. 1 dirs total, 0 dirs full, 0 dirs failed
14:04:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.085695 15220 tablet_service.cc:1511] Processing CreateTablet for tablet 0c176908afe7440d8b41f4dd8b7f3993 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779113063048 [id=dc291defffc04eb5b3a544657987800a]), partition=RANGE (key) PARTITION UNBOUNDED
14:04:41.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.091951 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c176908afe7440d8b41f4dd8b7f3993. 1 dirs total, 0 dirs full, 0 dirs failed
14:04:41.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.106746 14940 tablet_service.cc:1511] Processing CreateTablet for tablet 0c176908afe7440d8b41f4dd8b7f3993 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779113063048 [id=dc291defffc04eb5b3a544657987800a]), partition=RANGE (key) PARTITION UNBOUNDED
14:04:41.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.109259 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c176908afe7440d8b41f4dd8b7f3993. 1 dirs total, 0 dirs full, 0 dirs failed
14:04:41.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.141739 15320 tablet_bootstrap.cc:492] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: Bootstrap starting.
14:04:41.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.144321 15322 tablet_bootstrap.cc:492] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: Bootstrap starting.
14:04:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.149287 15321 tablet_bootstrap.cc:492] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: Bootstrap starting.
14:04:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.151763 15320 tablet_bootstrap.cc:654] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: Neither blocks nor log segments found. Creating new log.
14:04:41.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.153792 15322 tablet_bootstrap.cc:654] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: Neither blocks nor log segments found. Creating new log.
14:04:41.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.154500 15320 log.cc:826] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: Log is configured to *not* fsync() on all Append() calls
14:04:41.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.158959 15322 log.cc:826] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: Log is configured to *not* fsync() on all Append() calls
14:04:41.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.167972 15321 tablet_bootstrap.cc:654] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: Neither blocks nor log segments found. Creating new log.
14:04:41.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.169991 15320 tablet_bootstrap.cc:492] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: No bootstrap required, opened a new log
14:04:41.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.170581 15320 ts_tablet_manager.cc:1403] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.009s
14:04:41.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.170732 15321 log.cc:826] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: Log is configured to *not* fsync() on all Append() calls
14:04:41.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.178629 15322 tablet_bootstrap.cc:492] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: No bootstrap required, opened a new log
14:04:41.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.179553 15322 ts_tablet_manager.cc:1403] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.008s
14:04:41.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.188318 15321 tablet_bootstrap.cc:492] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: No bootstrap required, opened a new log
14:04:41.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.188899 15321 ts_tablet_manager.cc:1403] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.009s
14:04:41.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.209590 15320 raft_consensus.cc:359] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.211059 15320 raft_consensus.cc:385] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:04:41.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.211606 15320 raft_consensus.cc:740] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b521f014658b4aafa834d260a2b1ecce, State: Initialized, Role: FOLLOWER
14:04:41.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.212934 15320 consensus_queue.cc:260] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.215288 15322 raft_consensus.cc:359] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.216416 15322 raft_consensus.cc:385] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:04:41.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.217033 15322 raft_consensus.cc:740] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87b8acaabbb4817845a133357fa1295, State: Initialized, Role: FOLLOWER
14:04:41.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.218886 15322 consensus_queue.cc:260] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.225021 15321 raft_consensus.cc:359] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.228900 15320 ts_tablet_manager.cc:1434] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: Time spent starting tablet: real 0.058s	user 0.038s	sys 0.008s
14:04:41.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.229765 15322 ts_tablet_manager.cc:1434] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: Time spent starting tablet: real 0.050s	user 0.025s	sys 0.017s
14:04:41.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.226246 15321 raft_consensus.cc:385] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:04:41.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.231032 15321 raft_consensus.cc:740] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fa0b74abc84de8867b91881cd9802e, State: Initialized, Role: FOLLOWER
14:04:41.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.231995 15321 consensus_queue.cc:260] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.263443 15321 ts_tablet_manager.cc:1434] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: Time spent starting tablet: real 0.074s	user 0.044s	sys 0.003s
14:04:41.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:41.287421 15292 tablet.cc:2404] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:04:41.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:41.339222 15153 tablet.cc:2404] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:04:41.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:41.376786 15013 tablet.cc:2404] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:04:41.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.438097 15328 raft_consensus.cc:493] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:04:41.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.438972 15328 raft_consensus.cc:515] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.442060 15328 leader_election.cc:290] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f87b8acaabbb4817845a133357fa1295 (127.14.58.130:42517), b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497)
14:04:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.457190 15100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "d8fa0b74abc84de8867b91881cd9802e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87b8acaabbb4817845a133357fa1295" is_pre_election: true
14:04:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.457190 15240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "d8fa0b74abc84de8867b91881cd9802e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b521f014658b4aafa834d260a2b1ecce" is_pre_election: true
14:04:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.458153 15240 raft_consensus.cc:2468] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa0b74abc84de8867b91881cd9802e in term 0.
14:04:41.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.458151 15100 raft_consensus.cc:2468] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fa0b74abc84de8867b91881cd9802e in term 0.
14:04:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.459635 14894 leader_election.cc:304] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa0b74abc84de8867b91881cd9802e, f87b8acaabbb4817845a133357fa1295; no voters: 
14:04:41.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.460455 15328 raft_consensus.cc:2804] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Leader pre-election won for term 1
14:04:41.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.460721 15328 raft_consensus.cc:493] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:04:41.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.460922 15328 raft_consensus.cc:3060] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 0 FOLLOWER]: Advancing to term 1
14:04:41.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.465862 15328 raft_consensus.cc:515] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.467305 15328 leader_election.cc:290] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [CANDIDATE]: Term 1 election: Requested vote from peers f87b8acaabbb4817845a133357fa1295 (127.14.58.130:42517), b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497)
14:04:41.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.468324 15100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "d8fa0b74abc84de8867b91881cd9802e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87b8acaabbb4817845a133357fa1295"
14:04:41.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.468469 15240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "d8fa0b74abc84de8867b91881cd9802e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b521f014658b4aafa834d260a2b1ecce"
14:04:41.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.468878 15100 raft_consensus.cc:3060] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 0 FOLLOWER]: Advancing to term 1
14:04:41.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.469044 15240 raft_consensus.cc:3060] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 0 FOLLOWER]: Advancing to term 1
14:04:41.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.473812 15100 raft_consensus.cc:2468] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa0b74abc84de8867b91881cd9802e in term 1.
14:04:41.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.473929 15240 raft_consensus.cc:2468] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fa0b74abc84de8867b91881cd9802e in term 1.
14:04:41.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.474915 14894 leader_election.cc:304] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8fa0b74abc84de8867b91881cd9802e, f87b8acaabbb4817845a133357fa1295; no voters: 
14:04:41.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.475625 15328 raft_consensus.cc:2804] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 1 FOLLOWER]: Leader election won for term 1
14:04:41.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.477465 15328 raft_consensus.cc:697] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [term 1 LEADER]: Becoming Leader. State: Replica: d8fa0b74abc84de8867b91881cd9802e, State: Running, Role: LEADER
14:04:41.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.479046 15328 consensus_queue.cc:237] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:41.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.493788 14769 catalog_manager.cc:5696] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fa0b74abc84de8867b91881cd9802e (127.14.58.129). New cstate: current_term: 1 leader_uuid: "d8fa0b74abc84de8867b91881cd9802e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } health_report { overall_health: HEALTHY } } }
14:04:41.682 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table dc291defffc04eb5b3a544657987800a
14:04:41.705 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:41.712 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299994, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:41.713 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [11ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=null) after lookup
14:04:41.738 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:41.741 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] Successfully connected to peer
14:04:41.814 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x09dba3a8, L:/127.0.0.1:38880 - R:/127.14.58.129:36077] using TOKEN/null
14:04:41.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.832957 15240 raft_consensus.cc:1275] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 1 FOLLOWER]: Refusing update from remote peer d8fa0b74abc84de8867b91881cd9802e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:04:41.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.833035 15100 raft_consensus.cc:1275] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Refusing update from remote peer d8fa0b74abc84de8867b91881cd9802e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:04:41.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.834782 15332 consensus_queue.cc:1048] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:04:41.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.835366 15328 consensus_queue.cc:1048] T 0c176908afe7440d8b41f4dd8b7f3993 P d8fa0b74abc84de8867b91881cd9802e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:04:41.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:41.865561 15346 mvcc.cc:204] Tried to move back new op lower bound from 7287247183169900544 to 7287247181747859456. Current Snapshot: MvccSnapshot[applied={T|T < 7287247183169900544}]
14:04:42.073 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1779113063048, tablet=0c176908afe7440d8b41f4dd8b7f3993, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:04:42.080 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.14.58.129:36077
14:04:42.082 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

14:04:42.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:42.082732 14570 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu with pid 14850
14:04:42.111 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:04:42.117 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] handling channelInactive
14:04:42.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state READY due to: connection closed
14:04:42.118 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: connection closed
14:04:42.138 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:42.138 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:42.139 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=2, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=27), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test)) after lookup
14:04:42.140 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:42.143 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.143 [DEBUG - kudu-nio-4] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.143 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.159 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:42.159 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:42.160 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=4, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=48), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107))) after lookup
14:04:42.161 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:42.164 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.164 [DEBUG - kudu-nio-5] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.164 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.217 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:42.218 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:42.218 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=6, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=106), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [49ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [53ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [53ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [101ms] refreshing cache from master, [101ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [106ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283))) after lookup
14:04:42.219 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:42.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.221 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.258 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:42.258 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:42.259 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=8, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=147), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [49ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [53ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [53ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [101ms] refreshing cache from master, [101ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [106ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [108ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [110ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [110ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [142ms] refreshing cache from master, [142ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683))) after lookup
14:04:42.261 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:42.263 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.264 [DEBUG - kudu-nio-7] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.264 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.358 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:42.359 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:42.360 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=10, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=247), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [49ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [53ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [53ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [101ms] refreshing cache from master, [101ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [106ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [108ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [110ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [110ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [142ms] refreshing cache from master, [142ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [149ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [153ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [153ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [241ms] refreshing cache from master, [241ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [247ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803))) after lookup
14:04:42.361 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:42.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.362 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.439 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:42.439 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:42.440 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=12, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=328), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [49ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [53ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [53ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [101ms] refreshing cache from master, [101ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [106ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [108ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [110ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [110ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [142ms] refreshing cache from master, [142ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [149ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [153ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [153ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [241ms] refreshing cache from master, [241ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [247ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [249ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [251ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [251ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [322ms] refreshing cache from master, [322ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [327ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803) -> (continuation of Deferred@1741954457 after retry RPC@1143890642), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803) -> (continuation of Deferred@1741954457 after retry RPC@1143890642))) after lookup
14:04:42.441 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:42.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.443 [DEBUG - kudu-nio-1] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:42.443 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:43.257 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:43.258 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)[L],f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)]}]
14:04:43.259 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=14, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=1146), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [49ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [53ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [53ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [101ms] refreshing cache from master, [101ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [106ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [108ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [110ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [110ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [142ms] refreshing cache from master, [142ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [149ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [153ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [153ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [241ms] refreshing cache from master, [241ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [247ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [249ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [251ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [251ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [322ms] refreshing cache from master, [322ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [327ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [329ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [332ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [332ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [1141ms] refreshing cache from master, [1141ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [1146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803) -> (continuation of Deferred@1741954457 after retry RPC@1143890642) -> (continuation of Deferred@175699998 after retry RPC@760271797), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803) -> (continuation of Deferred@1741954457 after retry RPC@1143890642) -> (continuation of Deferred@175699998 after retry RPC@760271797))) after lookup
14:04:43.260 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] connecting to peer
14:04:43.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:43.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] cleaning up while in state CONNECTING due to: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:43.261 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077) for tablet 0c176908afe7440d8b41f4dd8b7f3993: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077
14:04:43.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.478924 15361 raft_consensus.cc:493] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d8fa0b74abc84de8867b91881cd9802e)
14:04:43.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.479442 15361 raft_consensus.cc:515] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:43.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.489727 15361 leader_election.cc:290] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497), d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077)
14:04:43.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.497445 15362 raft_consensus.cc:493] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d8fa0b74abc84de8867b91881cd9802e)
14:04:43.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.498786 15362 raft_consensus.cc:515] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:43.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:43.502317 15033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.58.129:36077: connect: Connection refused (error 111)
14:04:43.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.511195 15362 leader_election.cc:290] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f87b8acaabbb4817845a133357fa1295 (127.14.58.130:42517), d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077)
14:04:43.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.511694 15240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "f87b8acaabbb4817845a133357fa1295" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b521f014658b4aafa834d260a2b1ecce" is_pre_election: true
14:04:43.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.512446 15240 raft_consensus.cc:2468] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f87b8acaabbb4817845a133357fa1295 in term 1.
14:04:43.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:43.516893 15173 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.58.129:36077: connect: Connection refused (error 111)
14:04:43.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.516840 15035 leader_election.cc:304] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b521f014658b4aafa834d260a2b1ecce, f87b8acaabbb4817845a133357fa1295; no voters: 
14:04:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.517796 15361 raft_consensus.cc:2804] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:04:43.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:43.518061 15033 leader_election.cc:336] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077): Network error: Client connection negotiation failed: client connection to 127.14.58.129:36077: connect: Connection refused (error 111)
14:04:43.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.518136 15361 raft_consensus.cc:493] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d8fa0b74abc84de8867b91881cd9802e)
14:04:43.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.518962 15361 raft_consensus.cc:3060] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 1 FOLLOWER]: Advancing to term 2
14:04:43.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:43.523408 15173 leader_election.cc:336] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077): Network error: Client connection negotiation failed: client connection to 127.14.58.129:36077: connect: Connection refused (error 111)
14:04:43.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.527889 15100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "b521f014658b4aafa834d260a2b1ecce" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f87b8acaabbb4817845a133357fa1295" is_pre_election: true
14:04:43.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.563824 15361 raft_consensus.cc:515] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:43.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.565232 15100 raft_consensus.cc:2393] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b521f014658b4aafa834d260a2b1ecce in current term 2: Already voted for candidate f87b8acaabbb4817845a133357fa1295 in this term.
14:04:43.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.567169 15361 leader_election.cc:290] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [CANDIDATE]: Term 2 election: Requested vote from peers b521f014658b4aafa834d260a2b1ecce (127.14.58.131:33497), d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077)
14:04:43.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.567178 15240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c176908afe7440d8b41f4dd8b7f3993" candidate_uuid: "f87b8acaabbb4817845a133357fa1295" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b521f014658b4aafa834d260a2b1ecce"
14:04:43.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.567740 15240 raft_consensus.cc:3060] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 1 FOLLOWER]: Advancing to term 2
14:04:43.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.569500 15174 leader_election.cc:304] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b521f014658b4aafa834d260a2b1ecce; no voters: d8fa0b74abc84de8867b91881cd9802e, f87b8acaabbb4817845a133357fa1295
14:04:43.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:43.571352 15033 leader_election.cc:336] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077): Network error: Client connection negotiation failed: client connection to 127.14.58.129:36077: connect: Connection refused (error 111)
14:04:43.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.607168 15240 raft_consensus.cc:2468] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87b8acaabbb4817845a133357fa1295 in term 2.
14:04:43.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.607841 15362 raft_consensus.cc:2749] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:04:43.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.608578 15035 leader_election.cc:304] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b521f014658b4aafa834d260a2b1ecce, f87b8acaabbb4817845a133357fa1295; no voters: d8fa0b74abc84de8867b91881cd9802e
14:04:43.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.610148 15361 raft_consensus.cc:2804] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 2 FOLLOWER]: Leader election won for term 2
14:04:43.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.612138 15361 raft_consensus.cc:697] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [term 2 LEADER]: Becoming Leader. State: Replica: f87b8acaabbb4817845a133357fa1295, State: Running, Role: LEADER
14:04:43.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.613073 15361 consensus_queue.cc:237] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } }
14:04:43.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:43.623785 14769 catalog_manager.cc:5696] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 reported cstate change: term changed from 1 to 2, leader changed from d8fa0b74abc84de8867b91881cd9802e (127.14.58.129) to f87b8acaabbb4817845a133357fa1295 (127.14.58.130). New cstate: current_term: 2 leader_uuid: "f87b8acaabbb4817845a133357fa1295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f87b8acaabbb4817845a133357fa1295" member_type: VOTER last_known_addr { host: "127.14.58.130" port: 42517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fa0b74abc84de8867b91881cd9802e" member_type: VOTER last_known_addr { host: "127.14.58.129" port: 36077 } health_report { overall_health: UNKNOWN } } }
14:04:43.997 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0c176908afe7440d8b41f4dd8b7f3993 for table 'org.apache.kudu.client.TestLeaderFailover-1779113063048' with partition [<start>, <end>)
14:04:43.997 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=0c176908afe7440d8b41f4dd8b7f3993@[b521f014658b4aafa834d260a2b1ecce(127.14.58.131:33497),d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077),f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)[L]]}]
14:04:43.998 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=0c176908afe7440d8b41f4dd8b7f3993, attempt=16, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=1886), Traces: [0ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [7ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: connection closed, [8ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [26ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [28ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [32ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [32ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [42ms] refreshing cache from master, [42ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [47ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [49ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [53ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [53ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [101ms] refreshing cache from master, [101ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [106ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [108ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [110ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [110ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [142ms] refreshing cache from master, [142ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [149ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [153ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [153ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [241ms] refreshing cache from master, [241ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [247ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [249ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [251ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [251ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [322ms] refreshing cache from master, [322ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [327ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [329ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [332ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [332ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [1141ms] refreshing cache from master, [1141ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [1146ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, [1148ms] sending RPC to server d8fa0b74abc84de8867b91881cd9802e, [1150ms] received response from server d8fa0b74abc84de8867b91881cd9802e: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [1150ms] delaying RPC due to: Network error: Failed to connect to peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077): Connection refused: /127.14.58.129:36077, [1881ms] refreshing cache from master, [1881ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.58.188:42487, [1885ms] Sub RPC GetTableLocations: received response from server master-127.14.58.188:42487: OK, deferred=Deferred@1000022967(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$237/0x00007fe920338000@73db180a -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803) -> (continuation of Deferred@1741954457 after retry RPC@1143890642) -> (continuation of Deferred@175699998 after retry RPC@760271797) -> (continuation of Deferred@694091919 after retry RPC@45720426), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6fe4280e -> wakeup thread Time-limited test -> (continuation of Deferred@1961311141 after retry RPC@1268120107) -> (continuation of Deferred@1271951647 after retry RPC@640401283) -> (continuation of Deferred@1639666108 after retry RPC@1716490683) -> (continuation of Deferred@152707772 after retry RPC@1749643803) -> (continuation of Deferred@1741954457 after retry RPC@1143890642) -> (continuation of Deferred@175699998 after retry RPC@760271797) -> (continuation of Deferred@694091919 after retry RPC@45720426))) after lookup
14:04:43.999 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)] connecting to peer
14:04:44.002 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)] Successfully connected to peer
14:04:44.026 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x4f1f324a, L:/127.0.0.1:35274 - R:/127.14.58.130:42517] using TOKEN/null
14:04:44.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.035954 15240 raft_consensus.cc:1275] T 0c176908afe7440d8b41f4dd8b7f3993 P b521f014658b4aafa834d260a2b1ecce [term 2 FOLLOWER]: Refusing update from remote peer f87b8acaabbb4817845a133357fa1295: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
14:04:44.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.037873 15371 consensus_queue.cc:1048] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b521f014658b4aafa834d260a2b1ecce" member_type: VOTER last_known_addr { host: "127.14.58.131" port: 33497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
14:04:44.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:44.038692 15033 consensus_peers.cc:597] T 0c176908afe7440d8b41f4dd8b7f3993 P f87b8acaabbb4817845a133357fa1295 -> Peer d8fa0b74abc84de8867b91881cd9802e (127.14.58.129:36077): Couldn't send request to peer d8fa0b74abc84de8867b91881cd9802e. Status: Network error: Client connection negotiation failed: client connection to 127.14.58.129:36077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:04:44.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.056418 15384 mvcc.cc:204] Tried to move back new op lower bound from 7287247192194965504 to 7287247190487531520. Current Snapshot: MvccSnapshot[applied={T|T < 7287247192194965504}]
14:04:44.124 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 6 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1779113063048, tablet=0c176908afe7440d8b41f4dd8b7f3993, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:04:44.129 [DEBUG - main] (Connection.java:575) [peer d8fa0b74abc84de8867b91881cd9802e(127.14.58.129:36077)] disconnecting while in state TERMINATED
14:04:44.131 [DEBUG - main] (Connection.java:575) [peer master-127.14.58.190:44863(127.14.58.190:44863)] disconnecting while in state READY
14:04:44.131 [DEBUG - main] (Connection.java:575) [peer master-127.14.58.189:43579(127.14.58.189:43579)] disconnecting while in state READY
14:04:44.131 [DEBUG - main] (Connection.java:575) [peer f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)] disconnecting while in state READY
14:04:44.133 [DEBUG - main] (Connection.java:575) [peer master-127.14.58.188:42487(127.14.58.188:42487)] disconnecting while in state READY
14:04:44.134 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.58.188:42487(127.14.58.188:42487)] handling channelInactive
14:04:44.134 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.58.190:44863(127.14.58.190:44863)] handling channelInactive
14:04:44.135 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.58.189:43579(127.14.58.189:43579)] handling channelInactive
14:04:44.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.58.190:44863(127.14.58.190:44863)] cleaning up while in state READY due to: connection closed
14:04:44.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.58.189:43579(127.14.58.189:43579)] cleaning up while in state READY due to: connection closed
14:04:44.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.58.188:42487(127.14.58.188:42487)] cleaning up while in state READY due to: connection closed
14:04:44.136 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:04:44.141 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)] handling channelInactive
14:04:44.141 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f87b8acaabbb4817845a133357fa1295(127.14.58.130:42517)] cleaning up while in state READY due to: connection closed
14:04:44.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.141193 14570 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu with pid 15012
14:04:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.176298 14570 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu with pid 15155
14:04:44.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.206934 14570 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu with pid 14582
14:04:44.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.238430 14570 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu with pid 14652
14:04:44.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:44.242060 14756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.58.190:44863: connect: Connection refused (error 111)
14:04:44.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:04:44.245414 14756 consensus_peers.cc:597] T 00000000000000000000000000000000 P 14dfe6ac79314ec5a37cd539294f6b82 -> Peer 0b904a3029014da58aaa503679da4cb4 (127.14.58.190:44863): Couldn't send request to peer 0b904a3029014da58aaa503679da4cb4. Status: Network error: Client connection negotiation failed: client connection to 127.14.58.190:44863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:04:44.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:04:44.266094 14570 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFE7Z_S/build/tsan/bin/kudu with pid 14727
14:04:45.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:04:45Z chronyd exiting

Time: 23.56

OK (1 test)

