JUnit version 4.13.2
.20:03:48.526 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779134628516
20:03:48.582 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:03:48.639 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:03:48.647 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskQ0pVph/test-tmp
20:03:48.654 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:03:48.657 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskQ0pVph/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:03:48.852 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:03:49.033 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:03:49.034 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:03:49.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.038337 31081 mini_oidc.cc:150] Starting JWKS server
20:03:49.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.041754 31081 webserver.cc:533] Webserver started at http://127.0.0.1:38459/ using document root <none> and password file <none>
20:03:49.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.042330 31081 mini_oidc.cc:186] Starting OIDC Discovery server
20:03:49.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.044166 31081 webserver.cc:533] Webserver started at http://127.0.0.1:40705/ using document root <none> and password file <none>
20:03:49.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:03:49Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:03:49.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:03:49Z Disabled control of system clock
20:03:49.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.104612 31081 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:49.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal
20:03:49.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data
20:03:49.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:49.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:49.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:49.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:49.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:49.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:49.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/logs
20:03:49.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data/info.pb
20:03:49.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:49.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:49.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:49.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:49.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:49.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:49.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:49.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:49.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:49.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:49.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:49.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:49.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.126:40985
20:03:49.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.126
20:03:49.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:49.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:49.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:49.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:49.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:49.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:49.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:49.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:49.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38459/jwks.json with env {}
20:03:49.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.404742 31093 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:49.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.405295 31093 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:49.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.405896 31093 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:49.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.439540 31093 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:49.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.439847 31093 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:49.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.440060 31093 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:49.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.440256 31093 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:49.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.440436 31093 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:49.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.440662 31093 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38459/jwks.json
20:03:49.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.478179 31093 master_runner.cc:387] Master server non-default flags:
20:03:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:49.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data
20:03:49.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal
20:03:49.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:49.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:49.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:49.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:49.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:49.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.126:40985
20:03:49.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:49.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:49.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:49.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38459/jwks.json
20:03:49.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:49.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:49.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data/info.pb
20:03:49.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.126
20:03:49.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/logs
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:49.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:49.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:49.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:49.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.479599 31093 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:49.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.481808 31093 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:49.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.495481 31099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:50.899344 31098 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 31093
20:03:51.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.203032 31093 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.708s	user 0.565s	sys 1.137s
20:03:51.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.203438 31093 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.708s	user 0.565s	sys 1.137s
20:03:51.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.496330 31100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.206153 31102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.208701 31101 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1708 milliseconds
20:03:51.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.208771 31093 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:51.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.210216 31093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:51.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.212651 31093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:51.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.214035 31093 hybrid_clock.cc:648] HybridClock initialized: now 1779134631213993 us; error 39 us; skew 500 ppm
20:03:51.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.214946 31093 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:51.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.220968 31093 webserver.cc:533] Webserver started at http://127.30.90.126:38445/ using document root <none> and password file <none>
20:03:51.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.222090 31093 fs_manager.cc:362] Metadata directory not provided
20:03:51.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.222342 31093 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:51.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.222981 31093 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.227540 31093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data/instance:
20:03:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "746dfd41629547bfba1779557bd83336"
20:03:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:51 on dist-test-slave-8tr7"
20:03:51.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.229020 31093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal/instance:
20:03:51.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "746dfd41629547bfba1779557bd83336"
20:03:51.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:51 on dist-test-slave-8tr7"
20:03:51.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.236678 31093 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
20:03:51.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.242481 31109 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:51.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.243778 31093 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
20:03:51.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.244066 31093 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal
20:03:51.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "746dfd41629547bfba1779557bd83336"
20:03:51.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:51 on dist-test-slave-8tr7"
20:03:51.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.244524 31093 fs_report.cc:389] FS layout report
20:03:51.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal
20:03:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal
20:03:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data/data
20:03:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:51.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:51.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.294035 31093 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:51.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.295459 31093 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:51.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.295900 31093 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:51.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.367967 31093 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.126:40985
20:03:51.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.368100 31160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.126:40985 every 8 connection(s)
20:03:51.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.370703 31093 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/data/info.pb
20:03:51.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.373247 31081 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31093
20:03:51.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.374385 31081 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-0/wal/instance
20:03:51.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.377246 31161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:51.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.378212 31081 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:51.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:51.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal
20:03:51.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data
20:03:51.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:51.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:51.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:51.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:51.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:51.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:51.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/logs
20:03:51.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data/info.pb
20:03:51.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:51.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:51.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:51.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:51.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:51.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:51.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:51.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:51.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:51.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:51.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:51.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:51.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.125:34471
20:03:51.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.125
20:03:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:51.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:51.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:51.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:51.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38459/jwks.json with env {}
20:03:51.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.390933 31161 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } has no permanent_uuid. Determining permanent_uuid...
20:03:51.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.420003 31161 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } has no permanent_uuid. Determining permanent_uuid...
20:03:51.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.423364 31112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:51.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.428855 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:51.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.478422 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 1
20:03:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.483278 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:51.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.551676 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 2
20:03:51.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.555698 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.647095 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 3
20:03:51.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.651099 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:51.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.707705 31163 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:51.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.708264 31163 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:51.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.708768 31163 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:51.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.741820 31163 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:51.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.742180 31163 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:51.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.742440 31163 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:51.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.742635 31163 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:51.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.742853 31163 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:51.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.742995 31163 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38459/jwks.json
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.780416 31163 master_runner.cc:387] Master server non-default flags:
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal
20:03:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.125:34471
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38459/jwks.json
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:51.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data/info.pb
20:03:51.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.125
20:03:51.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:51.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:51.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:51.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:51.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:51.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:51.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/logs
20:03:51.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:51.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:51.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:51.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:51.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.782037 31163 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:51.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.783998 31163 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:51.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.794508 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 4
20:03:51.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.798641 31173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.799649 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.099061 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 5
20:03:52.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:52.103492 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:52.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.650959 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 6
20:03:52.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:52.659183 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.125:34471: Network error: Client connection negotiation failed: client connection to 127.30.90.125:34471: connect: Connection refused (error 111)
20:03:52.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.805663 31175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:52.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.801946 31172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:52.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:52.991592 31174 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
20:03:52.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.991837 31163 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:52.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.996116 31163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:53.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.000838 31163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:53.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.002224 31163 hybrid_clock.cc:648] HybridClock initialized: now 1779134633002170 us; error 71 us; skew 500 ppm
20:03:53.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.003177 31163 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:53.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.009377 31163 webserver.cc:533] Webserver started at http://127.30.90.125:44841/ using document root <none> and password file <none>
20:03:53.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.010456 31163 fs_manager.cc:362] Metadata directory not provided
20:03:53.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.010703 31163 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:53.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.011327 31163 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:53.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.015794 31163 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data/instance:
20:03:53.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21d4a14b273c45babcf96a70ad05e3c3"
20:03:53.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:53 on dist-test-slave-8tr7"
20:03:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.017151 31163 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal/instance:
20:03:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21d4a14b273c45babcf96a70ad05e3c3"
20:03:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:53 on dist-test-slave-8tr7"
20:03:53.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.024462 31163 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.004s
20:03:53.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.030478 31184 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:53.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.031594 31163 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
20:03:53.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.031951 31163 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal
20:03:53.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21d4a14b273c45babcf96a70ad05e3c3"
20:03:53.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:53 on dist-test-slave-8tr7"
20:03:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.032356 31163 fs_report.cc:389] FS layout report
20:03:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal
20:03:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal
20:03:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data/data
20:03:53.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:53.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:53.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:53.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:53.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:53.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.088014 31163 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.089697 31163 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:53.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.090257 31163 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:53.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.166788 31163 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.125:34471
20:03:53.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.167011 31235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.125:34471 every 8 connection(s)
20:03:53.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.169672 31163 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/data/info.pb
20:03:53.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.175333 31081 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31163
20:03:53.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.175652 31081 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-1/wal/instance
20:03:53.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.176631 31236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.177639 31081 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/logs
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data/info.pb
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:53.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:53.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:53.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:53.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:53.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:53.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:53.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.124:34971
20:03:53.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.124
20:03:53.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:53.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:53.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:53.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:53.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:53.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:53.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:53.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:53.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38459/jwks.json with env {}
20:03:53.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.193814 31236 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.219125 31236 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.234349 31236 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.236769 31188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.240829 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.290409 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 1
20:03:53.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.294425 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.363014 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 2
20:03:53.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.368155 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.459635 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 3
20:03:53.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.464064 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.508291 31238 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.508823 31238 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.509248 31238 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:53.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.542167 31238 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:53.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.542443 31238 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:53.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.542644 31238 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:53.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.542826 31238 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:53.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.543089 31238 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:53.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.543324 31238 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38459/jwks.json
20:03:53.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.581002 31238 master_runner.cc:387] Master server non-default flags:
20:03:53.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:53.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data
20:03:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal
20:03:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.124:34971
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38459/jwks.json
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data/info.pb
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.124
20:03:53.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/logs
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:53.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.582537 31238 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:53.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.584692 31238 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:53.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.596350 31248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:53.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.607458 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 4
20:03:53.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.611430 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.719604 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } attempt: 7
20:03:53.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.743891 31161 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.753878 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.812553 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 1
20:03:53.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.820950 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.902521 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 2
20:03:53.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.910302 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.910835 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 5
20:03:53.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.916797 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:53.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.995860 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 3
20:03:54.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.006359 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:54.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.147009 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 4
20:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.156629 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:54.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.440493 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 5
20:03:54.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.446969 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:54.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.464372 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 6
20:03:54.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.476390 31236 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:54.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.598594 31249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:54.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.846148 31250 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
20:03:54.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.847913 31251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:54.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.850904 31238 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.253s	user 0.479s	sys 0.772s
20:03:54.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.851150 31238 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.253s	user 0.479s	sys 0.772s
20:03:54.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.851317 31238 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:54.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.852382 31238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:54.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.854993 31238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:54.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.856369 31238 hybrid_clock.cc:648] HybridClock initialized: now 1779134634856323 us; error 56 us; skew 500 ppm
20:03:54.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.857249 31238 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:54.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.864723 31238 webserver.cc:533] Webserver started at http://127.30.90.124:37367/ using document root <none> and password file <none>
20:03:54.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.865875 31238 fs_manager.cc:362] Metadata directory not provided
20:03:54.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.866155 31238 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:54.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.866747 31238 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:54.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.871661 31238 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data/instance:
20:03:54.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0124cd258fa349769da8bbe2627c3081"
20:03:54.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:54 on dist-test-slave-8tr7"
20:03:54.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.872900 31238 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal/instance:
20:03:54.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0124cd258fa349769da8bbe2627c3081"
20:03:54.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:54 on dist-test-slave-8tr7"
20:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.881011 31238 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
20:03:54.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.887365 31262 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:54.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.888603 31238 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
20:03:54.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.888978 31238 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal
20:03:54.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0124cd258fa349769da8bbe2627c3081"
20:03:54.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:54 on dist-test-slave-8tr7"
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.889351 31238 fs_report.cc:389] FS layout report
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data/data
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:54.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:54.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:54.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.973230 31238 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:54.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.975104 31238 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:54.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.975608 31238 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:55.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.999560 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 6
20:03:55.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:55.007485 31161 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.124:34971: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:03:55.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.056205 31238 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.124:34971
20:03:55.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.056336 31315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.124:34971 every 8 connection(s)
20:03:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.058729 31238 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/data/info.pb
20:03:55.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.064311 31316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:55.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.066990 31081 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31238
20:03:55.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.067476 31081 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/master-2/wal/instance
20:03:55.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.080854 31316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } has no permanent_uuid. Determining permanent_uuid...
20:03:55.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.112577 31316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } has no permanent_uuid. Determining permanent_uuid...
20:03:55.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.122144 31316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } has no permanent_uuid. Determining permanent_uuid...
20:03:55.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.138616 31316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: Bootstrap starting.
20:03:55.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.146131 31316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: Neither blocks nor log segments found. Creating new log.
20:03:55.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.147804 31316 log.cc:826] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: Log is configured to *not* fsync() on all Append() calls
20:03:55.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.152596 31316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: No bootstrap required, opened a new log
20:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.179322 31316 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.180245 31316 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.180538 31316 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124cd258fa349769da8bbe2627c3081, State: Initialized, Role: FOLLOWER
20:03:55.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.181445 31316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.184419 31325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:55.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.186794 31325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: This master's current role is: FOLLOWER
20:03:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.186437 31316 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: configured and running, proceeding with master startup.
20:03:55.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:55.218820 31336 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:55.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:55.219640 31336 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:55.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:55.231119 31268 tablet.cc:2404] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:55.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.212322 31238 master_runner.cc:187] Error getting master registration for 127.30.90.126:40985: OK, instance_id { permanent_uuid: "746dfd41629547bfba1779557bd83336" instance_seqno: 1779134631347102 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:55.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.233916 31238 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:55.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.394130 31325 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:55.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.394688 31325 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.398160 31325 leader_election.cc:290] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 746dfd41629547bfba1779557bd83336 (127.30.90.126:40985), 21d4a14b273c45babcf96a70ad05e3c3 (127.30.90.125:34471)
20:03:55.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.536918 31236 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 7
20:03:55.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.570534 31236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: Bootstrap starting.
20:03:55.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.579798 31236 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: Neither blocks nor log segments found. Creating new log.
20:03:55.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.582445 31236 log.cc:826] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: Log is configured to *not* fsync() on all Append() calls
20:03:55.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.587844 31236 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: No bootstrap required, opened a new log
20:03:55.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.618448 31236 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.619318 31236 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:55.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.619598 31236 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d4a14b273c45babcf96a70ad05e3c3, State: Initialized, Role: FOLLOWER
20:03:55.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.620576 31236 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.623381 31340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:55.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.624096 31340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.625237 31236 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: configured and running, proceeding with master startup.
20:03:55.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.625412 31211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0124cd258fa349769da8bbe2627c3081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d4a14b273c45babcf96a70ad05e3c3" is_pre_election: true
20:03:55.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.626500 31211 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0124cd258fa349769da8bbe2627c3081 in term 0.
20:03:55.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.628099 31265 leader_election.cc:304] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124cd258fa349769da8bbe2627c3081, 21d4a14b273c45babcf96a70ad05e3c3; no voters: 
20:03:55.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.629071 31325 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:03:55.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.629424 31325 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:55.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.629776 31325 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 0 FOLLOWER]: Advancing to term 1
20:03:55.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.640857 31325 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.651882 31325 leader_election.cc:290] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [CANDIDATE]: Term 1 election: Requested vote from peers 746dfd41629547bfba1779557bd83336 (127.30.90.126:40985), 21d4a14b273c45babcf96a70ad05e3c3 (127.30.90.125:34471)
20:03:55.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.653872 31211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0124cd258fa349769da8bbe2627c3081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d4a14b273c45babcf96a70ad05e3c3"
20:03:55.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.655319 31211 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 0 FOLLOWER]: Advancing to term 1
20:03:55.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.665508 31211 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0124cd258fa349769da8bbe2627c3081 in term 1.
20:03:55.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.666846 31265 leader_election.cc:304] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124cd258fa349769da8bbe2627c3081, 21d4a14b273c45babcf96a70ad05e3c3; no voters: 
20:03:55.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.667855 31325 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 1 FOLLOWER]: Leader election won for term 1
20:03:55.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.670372 31325 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [term 1 LEADER]: Becoming Leader. State: Replica: 0124cd258fa349769da8bbe2627c3081, State: Running, Role: LEADER
20:03:55.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.671630 31325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:55.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.683475 31343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0124cd258fa349769da8bbe2627c3081. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:55.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.684123 31343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: This master's current role is: LEADER
20:03:55.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.696633 31347 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:03:55.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.703348 31347 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:03:55.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.741307 31211 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Refusing update from remote peer 0124cd258fa349769da8bbe2627c3081: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:55.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.743299 31343 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:03:55.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.769986 31351 mvcc.cc:204] Tried to move back new op lower bound from 7287335467963473920 to 7287335467721928704. Current Snapshot: MvccSnapshot[applied={T|T < 7287335467963473920}]
20:03:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.771587 31340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0124cd258fa349769da8bbe2627c3081. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.772207 31340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:55.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.789477 31343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:55.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.790251 31343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: This master's current role is: LEADER
20:03:55.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.793056 31347 catalog_manager.cc:1382] Generated new cluster ID: 1b775cff24ce43a89cbef66d9743f670
20:03:55.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.793355 31347 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:03:55.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.803886 31340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:55.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.804672 31340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:55.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.780433 31163 master_runner.cc:187] Error getting master registration for 127.30.90.126:40985: OK, instance_id { permanent_uuid: "746dfd41629547bfba1779557bd83336" instance_seqno: 1779134631347102 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:55.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.813992 31163 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:55.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.831879 31358 catalog_manager.cc:1294] Loaded cluster ID: 1b775cff24ce43a89cbef66d9743f670
20:03:55.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.832185 31358 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: loading cluster ID for follower catalog manager: success
20:03:55.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:55.836277 31358 catalog_manager.cc:1611] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: acquiring CA information for follower catalog manager: Not found: root CA entry not found
20:03:55.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:55.837544 31358 catalog_manager.cc:883] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
20:03:55.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.855911 31347 catalog_manager.cc:1405] Generated new certificate authority record
20:03:55.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.858335 31347 catalog_manager.cc:1539] Loading token signing keys...
20:03:55.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.884382 31347 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081: Generated new TSK 0
20:03:55.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.885905 31347 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:03:55.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.935397 31081 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/logs
20:03:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data/info.pb
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.65:0
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.65
20:03:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.65
20:03:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:56.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.040992 31161 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } attempt: 7
20:03:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.102116 31161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: Bootstrap starting.
20:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.123034 31161 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: Neither blocks nor log segments found. Creating new log.
20:03:56.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.129391 31161 log.cc:826] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: Log is configured to *not* fsync() on all Append() calls
20:03:56.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.161319 31161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: No bootstrap required, opened a new log
20:03:56.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.368888 31161 raft_consensus.cc:359] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:56.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.369810 31161 raft_consensus.cc:385] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:56.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.370111 31161 raft_consensus.cc:740] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 746dfd41629547bfba1779557bd83336, State: Initialized, Role: FOLLOWER
20:03:56.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.370966 31161 consensus_queue.cc:260] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:03:56.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.414906 31368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:56.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.417972 31368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: This master's current role is: FOLLOWER
20:03:56.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.420572 31161 sys_catalog.cc:565] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: configured and running, proceeding with master startup.
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.420710 31136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0124cd258fa349769da8bbe2627c3081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746dfd41629547bfba1779557bd83336" is_pre_election: true
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.421609 31136 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0124cd258fa349769da8bbe2627c3081 in term 0.
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.422216 31136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47102 (request call id 2) took 1024 ms. Trace:
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.422535 31136 rpcz_store.cc:276] 0518 20:03:55.397543 (+     0us) service_pool.cc:167] Inserting onto call queue
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 20:03:55.397675 (+   132us) service_pool.cc:224] Handling call
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 20:03:56.422146 (+1024471us) inbound_call.cc:177] Queueing success response
20:03:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
20:03:56.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.425478 31134 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 0 FOLLOWER]: Advancing to term 1
20:03:56.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.426129 31135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0124cd258fa349769da8bbe2627c3081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "746dfd41629547bfba1779557bd83336"
20:03:56.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.445425 31134 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 1 FOLLOWER]: Refusing update from remote peer 0124cd258fa349769da8bbe2627c3081: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:56.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.449204 31343 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.478360 31361 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.479525 31361 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:56.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.480558 31361 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:56.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.531544 31371 mvcc.cc:204] Tried to move back new op lower bound from 7287335467963473920 to 7287335467721928704. Current Snapshot: MvccSnapshot[applied={T|T < 7287335467963473920}]
20:03:56.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.547811 31361 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:56.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.549546 31361 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.90.65
20:03:56.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.551681 31368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0124cd258fa349769da8bbe2627c3081. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:56.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.552522 31368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: This master's current role is: FOLLOWER
20:03:56.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.553603 31370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:56.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.554952 31370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: This master's current role is: FOLLOWER
20:03:56.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.591511 31384 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.618927 31361 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data
20:03:56.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.65:0
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data/info.pb
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.65
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.65
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/logs
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:56.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.623344 31361 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:56.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.625819 31361 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:56.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.661270 31386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.875308 31358 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: acquiring CA information for follower catalog manager: success
20:03:56.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.884351 31358 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:56.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.994287 31343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0124cd258fa349769da8bbe2627c3081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:03:56.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:56.995347 31343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0124cd258fa349769da8bbe2627c3081 [sys.catalog]: This master's current role is: LEADER
20:03:57.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.611294 31384 catalog_manager.cc:1294] Loaded cluster ID: 1b775cff24ce43a89cbef66d9743f670
20:03:57.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.612294 31384 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: loading cluster ID for follower catalog manager: success
20:03:57.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.620878 31384 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: acquiring CA information for follower catalog manager: success
20:03:57.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.637362 31384 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:58.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.062583 31385 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 31361
20:03:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.402957 31385 kernel_stack_watchdog.cc:198] Thread 31361 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 392ms:
20:03:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:03:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:03:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:03:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:03:58.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.669883 31387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.408929 31361 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.741s	user 0.503s	sys 0.906s
20:03:58.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.410066 31361 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.742s	user 0.503s	sys 0.906s
20:03:58.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.426056 31361 server_base.cc:1061] running on GCE node
20:03:58.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.426914 31394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:58.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.428632 31361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:58.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.444087 31361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:58.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.446020 31361 hybrid_clock.cc:648] HybridClock initialized: now 1779134638445917 us; error 96 us; skew 500 ppm
20:03:58.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.447461 31361 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:58.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.480497 31361 webserver.cc:533] Webserver started at http://127.30.90.65:42221/ using document root <none> and password file <none>
20:03:58.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.482323 31361 fs_manager.cc:362] Metadata directory not provided
20:03:58.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.483234 31361 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:58.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.484081 31361 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.491003 31361 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data/instance:
20:03:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1f1504c3a051491d9d7efb01471b378f"
20:03:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:58 on dist-test-slave-8tr7"
20:03:58.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.493114 31361 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal/instance:
20:03:58.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1f1504c3a051491d9d7efb01471b378f"
20:03:58.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:58 on dist-test-slave-8tr7"
20:03:58.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.508949 31361 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.013s	sys 0.000s
20:03:58.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.522053 31399 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:58.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.523823 31361 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.000s	sys 0.008s
20:03:58.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.524525 31361 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal
20:03:58.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1f1504c3a051491d9d7efb01471b378f"
20:03:58.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:58 on dist-test-slave-8tr7"
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.525318 31361 fs_report.cc:389] FS layout report
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data/data
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:58.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:58.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:58.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.632138 31361 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:58.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.635003 31361 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:58.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.636062 31361 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:58.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.646448 31361 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:58.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.662127 31361 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:58.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.662837 31361 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
20:03:58.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.663372 31361 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:58.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.663801 31361 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:58.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.884816 31361 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.65:46079
20:03:58.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.885016 31511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.65:46079 every 8 connection(s)
20:03:58.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.889040 31361 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/data/info.pb
20:03:58.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.889755 31081 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31361
20:03:58.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.890240 31081 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-0/wal/instance
20:03:58.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.901075 31081 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:58.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:03:58.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal
20:03:58.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/logs
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data/info.pb
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:58.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.66:0
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.66
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.66
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:58.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:59.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.038916 31516 heartbeater.cc:344] Connected to a master server at 127.30.90.125:34471
20:03:59.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.039449 31516 heartbeater.cc:461] Registering TS with master...
20:03:59.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.040557 31516 heartbeater.cc:507] Master 127.30.90.125:34471 requested a full tablet report, sending...
20:03:59.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.044839 31201 ts_manager.cc:194] Registered new tserver with Master: 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:03:59.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.048830 31512 heartbeater.cc:344] Connected to a master server at 127.30.90.124:34971
20:03:59.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.049170 31512 heartbeater.cc:461] Registering TS with master...
20:03:59.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.050100 31512 heartbeater.cc:507] Master 127.30.90.124:34971 requested a full tablet report, sending...
20:03:59.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.052477 31280 ts_manager.cc:194] Registered new tserver with Master: 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:03:59.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.055083 31280 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.90.65:33079
20:03:59.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.063324 31517 heartbeater.cc:344] Connected to a master server at 127.30.90.126:40985
20:03:59.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.063634 31517 heartbeater.cc:461] Registering TS with master...
20:03:59.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.064283 31517 heartbeater.cc:507] Master 127.30.90.126:40985 requested a full tablet report, sending...
20:03:59.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.068172 31126 ts_manager.cc:194] Registered new tserver with Master: 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:03:59.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.459651 31515 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:59.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.460211 31515 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:59.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.460774 31515 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:59.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.497457 31515 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:59.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.498525 31515 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.90.66
20:03:59.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.537379 31515 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:59.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:59.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:03:59.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:59.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.66:0
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data/info.pb
20:03:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.66
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:59.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.66
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/logs
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:59.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:59.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.539026 31515 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:59.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.541282 31515 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:59.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.557570 31530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:00.060345 31512 heartbeater.cc:499] Master 127.30.90.124:34971 was elected leader, sending a full tablet report...
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.959982 31529 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 31515
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.114497 31529 kernel_stack_watchdog.cc:198] Thread 31515 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 396ms:
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:01.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:59.559795 31531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:01.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.116394 31515 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.555s	user 0.000s	sys 0.001s
20:04:01.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.116917 31515 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.556s	user 0.000s	sys 0.002s
20:04:01.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.121717 31532 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1561 milliseconds
20:04:01.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.123441 31534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:01.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.123564 31515 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:01.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.126538 31515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:01.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.130368 31515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:01.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.132125 31515 hybrid_clock.cc:648] HybridClock initialized: now 1779134641132045 us; error 77 us; skew 500 ppm
20:04:01.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.133287 31515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:01.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.141729 31515 webserver.cc:533] Webserver started at http://127.30.90.66:45605/ using document root <none> and password file <none>
20:04:01.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.142941 31515 fs_manager.cc:362] Metadata directory not provided
20:04:01.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.143217 31515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:01.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.143781 31515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.151000 31515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data/instance:
20:04:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7"
20:04:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:01 on dist-test-slave-8tr7"
20:04:01.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.152439 31515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal/instance:
20:04:01.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7"
20:04:01.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:01 on dist-test-slave-8tr7"
20:04:01.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.161454 31515 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.010s	sys 0.001s
20:04:01.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.169131 31540 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:01.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.170483 31515 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.004s
20:04:01.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.170869 31515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal
20:04:01.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7"
20:04:01.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:01 on dist-test-slave-8tr7"
20:04:01.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.171294 31515 fs_report.cc:389] FS layout report
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data/data
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:01.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:01.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.248373 31515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:01.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.249928 31515 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:01.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.250385 31515 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:01.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.253252 31515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:01.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.258038 31515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:01.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.258234 31515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:01.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.258430 31515 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:01.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.258563 31515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:01.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.438637 31515 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.66:36409
20:04:01.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.438730 31652 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.66:36409 every 8 connection(s)
20:04:01.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.441115 31515 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/data/info.pb
20:04:01.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.443753 31081 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31515
20:04:01.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.444392 31081 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-1/wal/instance
20:04:01.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.469355 31081 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/logs
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data/info.pb
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.67:0
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.67
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.67
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:01.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.499658 31654 heartbeater.cc:344] Connected to a master server at 127.30.90.125:34471
20:04:01.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.500164 31654 heartbeater.cc:461] Registering TS with master...
20:04:01.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.501495 31653 heartbeater.cc:344] Connected to a master server at 127.30.90.124:34971
20:04:01.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.501793 31653 heartbeater.cc:461] Registering TS with master...
20:04:01.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.501952 31654 heartbeater.cc:507] Master 127.30.90.125:34471 requested a full tablet report, sending...
20:04:01.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.502833 31653 heartbeater.cc:507] Master 127.30.90.124:34971 requested a full tablet report, sending...
20:04:01.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.504984 31280 ts_manager.cc:194] Registered new tserver with Master: 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409)
20:04:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.506716 31280 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.90.66:45843
20:04:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.506855 31201 ts_manager.cc:194] Registered new tserver with Master: 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409)
20:04:01.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.511613 31655 heartbeater.cc:344] Connected to a master server at 127.30.90.126:40985
20:04:01.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.511971 31655 heartbeater.cc:461] Registering TS with master...
20:04:01.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.512566 31655 heartbeater.cc:507] Master 127.30.90.126:40985 requested a full tablet report, sending...
20:04:01.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.515133 31126 ts_manager.cc:194] Registered new tserver with Master: 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409)
20:04:01.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.809930 31660 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:01.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.810475 31660 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:01.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.811082 31660 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:01.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.845166 31660 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:01.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.846169 31660 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.90.67
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.886929 31660 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.84:33683
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal
20:04:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.67:0
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data/info.pb
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.67
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.126:40985,127.30.90.125:34471,127.30.90.124:34971
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.67
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/logs
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:01.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.888690 31660 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:01.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.890601 31660 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:01.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.903954 31670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:02.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:02.511879 31653 heartbeater.cc:499] Master 127.30.90.124:34971 was elected leader, sending a full tablet report...
20:04:03.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.904199 31671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:03.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.259876 31672 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1350 milliseconds
20:04:03.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.260972 31673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:03.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.262071 31660 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.359s	user 0.432s	sys 0.924s
20:04:03.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.262413 31660 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.359s	user 0.432s	sys 0.924s
20:04:03.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.262714 31660 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:03.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.264231 31660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:03.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.267688 31660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:03.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.269352 31660 hybrid_clock.cc:648] HybridClock initialized: now 1779134643269298 us; error 50 us; skew 500 ppm
20:04:03.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.271036 31660 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:03.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.281229 31660 webserver.cc:533] Webserver started at http://127.30.90.67:38087/ using document root <none> and password file <none>
20:04:03.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.282183 31660 fs_manager.cc:362] Metadata directory not provided
20:04:03.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.282368 31660 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:03.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.282747 31660 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:03.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.287348 31660 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data/instance:
20:04:03.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "681f02ddc39e452d82ee80d3020df9b3"
20:04:03.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:03 on dist-test-slave-8tr7"
20:04:03.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.288645 31660 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal/instance:
20:04:03.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "681f02ddc39e452d82ee80d3020df9b3"
20:04:03.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:03 on dist-test-slave-8tr7"
20:04:03.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.296384 31660 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
20:04:03.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.302657 31680 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:03.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.303882 31660 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
20:04:03.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.304243 31660 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal
20:04:03.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "681f02ddc39e452d82ee80d3020df9b3"
20:04:03.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:03 on dist-test-slave-8tr7"
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.304597 31660 fs_report.cc:389] FS layout report
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data/data
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:03.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:03.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.395148 31660 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:03.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.396776 31660 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:03.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.397287 31660 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:03.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.400354 31660 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:03.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.404861 31660 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:03.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.405102 31660 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:03.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.405438 31660 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:03.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.405651 31660 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:03.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.564630 31660 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.67:44847
20:04:03.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.564749 31794 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.67:44847 every 8 connection(s)
20:04:03.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.567344 31660 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/data/info.pb
20:04:03.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.570150 31081 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31660
20:04:03.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.570657 31081 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal/instance
20:04:03.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.606159 31796 heartbeater.cc:344] Connected to a master server at 127.30.90.125:34471
20:04:03.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.606704 31796 heartbeater.cc:461] Registering TS with master...
20:04:03.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.608004 31796 heartbeater.cc:507] Master 127.30.90.125:34471 requested a full tablet report, sending...
20:04:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.611169 31797 heartbeater.cc:344] Connected to a master server at 127.30.90.126:40985
20:04:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.611326 31795 heartbeater.cc:344] Connected to a master server at 127.30.90.124:34971
20:04:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.611532 31797 heartbeater.cc:461] Registering TS with master...
20:04:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.611624 31795 heartbeater.cc:461] Registering TS with master...
20:04:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.611903 31201 ts_manager.cc:194] Registered new tserver with Master: 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847)
20:04:03.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.612488 31797 heartbeater.cc:507] Master 127.30.90.126:40985 requested a full tablet report, sending...
20:04:03.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.612552 31795 heartbeater.cc:507] Master 127.30.90.124:34971 requested a full tablet report, sending...
20:04:03.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.615342 31280 ts_manager.cc:194] Registered new tserver with Master: 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847)
20:04:03.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.615803 31126 ts_manager.cc:194] Registered new tserver with Master: 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847)
20:04:03.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.617270 31280 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.90.67:48099
20:04:03.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.623742 31081 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
20:04:03.636 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:03.637 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:04:03.646 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.90.126"
      port: 40985
    }
    bound_http_address {
      host: "127.30.90.126"
      port: 38445
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.90.125"
      port: 34471
    }
    bound_http_address {
      host: "127.30.90.125"
      port: 44841
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.90.124"
      port: 34971
    }
    bound_http_address {
      host: "127.30.90.124"
      port: 37367
    }
  }
}

20:04:03.650 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:04:03.652 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.90.65"
      port: 46079
    }
    bound_http_address {
      host: "127.30.90.65"
      port: 42221
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.90.66"
      port: 36409
    }
    bound_http_address {
      host: "127.30.90.66"
      port: 45605
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.90.67"
      port: 44847
    }
    bound_http_address {
      host: "127.30.90.67"
      port: 38087
    }
  }
}

20:04:03.652 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:04:03.834 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
20:04:03.900 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:04.083 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.90.126:40985(127.30.90.126:40985)] connecting to peer
20:04:04.143 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:04.146 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.90.125:34471(127.30.90.125:34471)] connecting to peer
20:04:04.162 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.90.125:34471(127.30.90.125:34471)] Successfully connected to peer
20:04:04.166 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.90.124:34971(127.30.90.124:34971)] Successfully connected to peer
20:04:04.167 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.90.126:40985(127.30.90.126:40985)] Successfully connected to peer
20:04:04.261 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.90.124
20:04:04.261 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.90.126
20:04:04.262 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.30.90.125
20:04:04.509 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xcb2cba90, L:/127.0.0.1:57794 - R:/127.30.90.125:34471] using SASL/PLAIN
20:04:04.509 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6ff21b50, L:/127.0.0.1:47108 - R:/127.30.90.126:40985] using SASL/PLAIN
20:04:04.511 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x765f7f50, L:/127.0.0.1:52062 - R:/127.30.90.124:34971] using SASL/PLAIN
20:04:04.552 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:04.553 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=517), Traces: [0ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [485ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [485ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [487ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: OK, deferred=null) after lookup
20:04:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.606914 31280 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52062:
20:04:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
20:04:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:04:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:04.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.610847 31280 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:04:04.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.620997 31795 heartbeater.cc:499] Master 127.30.90.124:34971 was elected leader, sending a full tablet report...
20:04:04.673 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 78891c7b65fe4f0e91b0ca7c11dd521c
20:04:04.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.698920 31729 tablet_service.cc:1511] Processing CreateTablet for tablet 77b8655617d74907a0813305ebbc3192 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=78891c7b65fe4f0e91b0ca7c11dd521c]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:04.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.700429 31729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b8655617d74907a0813305ebbc3192. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:04.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.731256 31447 tablet_service.cc:1511] Processing CreateTablet for tablet 77b8655617d74907a0813305ebbc3192 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=78891c7b65fe4f0e91b0ca7c11dd521c]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:04.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.733739 31831 tablet_bootstrap.cc:492] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Bootstrap starting.
20:04:04.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.734360 31447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b8655617d74907a0813305ebbc3192. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:04.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.736474 31588 tablet_service.cc:1511] Processing CreateTablet for tablet 77b8655617d74907a0813305ebbc3192 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=78891c7b65fe4f0e91b0ca7c11dd521c]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:04.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.737924 31588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b8655617d74907a0813305ebbc3192. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:04.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.745574 31831 tablet_bootstrap.cc:654] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Neither blocks nor log segments found. Creating new log.
20:04:04.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.748507 31831 log.cc:826] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Log is configured to *not* fsync() on all Append() calls
20:04:04.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.754760 31831 tablet_bootstrap.cc:492] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: No bootstrap required, opened a new log
20:04:04.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.755275 31831 ts_tablet_manager.cc:1403] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
20:04:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.765506 31834 tablet_bootstrap.cc:492] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Bootstrap starting.
20:04:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.766206 31833 tablet_bootstrap.cc:492] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Bootstrap starting.
20:04:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.775449 31833 tablet_bootstrap.cc:654] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Neither blocks nor log segments found. Creating new log.
20:04:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.775449 31834 tablet_bootstrap.cc:654] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Neither blocks nor log segments found. Creating new log.
20:04:04.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.778290 31834 log.cc:826] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Log is configured to *not* fsync() on all Append() calls
20:04:04.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.778290 31833 log.cc:826] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Log is configured to *not* fsync() on all Append() calls
20:04:04.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.780933 31831 raft_consensus.cc:359] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.782116 31831 raft_consensus.cc:385] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:04.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.783211 31831 raft_consensus.cc:740] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681f02ddc39e452d82ee80d3020df9b3, State: Initialized, Role: FOLLOWER
20:04:04.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.785020 31833 tablet_bootstrap.cc:492] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: No bootstrap required, opened a new log
20:04:04.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.785753 31833 ts_tablet_manager.cc:1403] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
20:04:04.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.785916 31831 consensus_queue.cc:260] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.788122 31834 tablet_bootstrap.cc:492] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: No bootstrap required, opened a new log
20:04:04.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.789140 31834 ts_tablet_manager.cc:1403] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.012s
20:04:04.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.794108 31831 ts_tablet_manager.cc:1434] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Time spent starting tablet: real 0.039s	user 0.025s	sys 0.010s
20:04:04.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.815088 31833 raft_consensus.cc:359] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.815811 31833 raft_consensus.cc:385] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:04.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.816102 31833 raft_consensus.cc:740] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad1dde7759c438aaf2bb6b3e0d7a1c7, State: Initialized, Role: FOLLOWER
20:04:04.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.817252 31833 consensus_queue.cc:260] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.824847 31834 raft_consensus.cc:359] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.825882 31833 ts_tablet_manager.cc:1434] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Time spent starting tablet: real 0.040s	user 0.023s	sys 0.012s
20:04:04.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.826049 31834 raft_consensus.cc:385] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:04.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.826335 31834 raft_consensus.cc:740] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f1504c3a051491d9d7efb01471b378f, State: Initialized, Role: FOLLOWER
20:04:04.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.827332 31834 consensus_queue.cc:260] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.841121 31834 ts_tablet_manager.cc:1434] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Time spent starting tablet: real 0.052s	user 0.024s	sys 0.017s
20:04:04.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.848058 31800 tablet.cc:2404] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:04.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.939826 31838 raft_consensus.cc:493] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:04.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.940727 31838 raft_consensus.cc:515] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.943336 31838 leader_election.cc:290] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847), 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:04:04.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.957100 31750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "681f02ddc39e452d82ee80d3020df9b3" is_pre_election: true
20:04:04.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.957821 31750 raft_consensus.cc:2468] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ad1dde7759c438aaf2bb6b3e0d7a1c7 in term 0.
20:04:04.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.958595 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1504c3a051491d9d7efb01471b378f" is_pre_election: true
20:04:04.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.959329 31467 raft_consensus.cc:2468] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ad1dde7759c438aaf2bb6b3e0d7a1c7 in term 0.
20:04:04.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.959437 31544 leader_election.cc:304] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad1dde7759c438aaf2bb6b3e0d7a1c7, 681f02ddc39e452d82ee80d3020df9b3; no voters: 
20:04:04.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.960296 31838 raft_consensus.cc:2804] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:04.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.960588 31838 raft_consensus.cc:493] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:04.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.960904 31838 raft_consensus.cc:3060] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 0 FOLLOWER]: Advancing to term 1
20:04:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.965723 31838 raft_consensus.cc:515] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.967358 31838 leader_election.cc:290] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [CANDIDATE]: Term 1 election: Requested vote from peers 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847), 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:04:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.968189 31750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "681f02ddc39e452d82ee80d3020df9b3"
20:04:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.968536 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f1504c3a051491d9d7efb01471b378f"
20:04:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.968894 31750 raft_consensus.cc:3060] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 0 FOLLOWER]: Advancing to term 1
20:04:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.969045 31467 raft_consensus.cc:3060] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 0 FOLLOWER]: Advancing to term 1
20:04:04.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.976631 31467 raft_consensus.cc:2468] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad1dde7759c438aaf2bb6b3e0d7a1c7 in term 1.
20:04:04.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.976619 31750 raft_consensus.cc:2468] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ad1dde7759c438aaf2bb6b3e0d7a1c7 in term 1.
20:04:04.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.977595 31544 leader_election.cc:304] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ad1dde7759c438aaf2bb6b3e0d7a1c7, 681f02ddc39e452d82ee80d3020df9b3; no voters: 
20:04:04.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.978399 31838 raft_consensus.cc:2804] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 1 FOLLOWER]: Leader election won for term 1
20:04:04.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.981328 31838 raft_consensus.cc:697] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [term 1 LEADER]: Becoming Leader. State: Replica: 5ad1dde7759c438aaf2bb6b3e0d7a1c7, State: Running, Role: LEADER
20:04:04.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.982352 31838 consensus_queue.cc:237] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:04.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.992079 31661 tablet.cc:2404] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:04.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.992898 31280 catalog_manager.cc:5696] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66). New cstate: current_term: 1 leader_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } health_report { overall_health: UNKNOWN } } }
20:04:05.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:05.045176 31521 tablet.cc:2404] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:05.087 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 78891c7b65fe4f0e91b0ca7c11dd521c
20:04:05.110 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 77b8655617d74907a0813305ebbc3192 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
20:04:05.117 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=77b8655617d74907a0813305ebbc3192@[1f1504c3a051491d9d7efb01471b378f(127.30.90.65:46079),5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)[L],681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)]}]
20:04:05.119 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=21), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.90.124:34971, [10ms] Sub RPC GetTableLocations: received response from server master-127.30.90.124:34971: OK, deferred=null) after lookup
20:04:05.141 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] connecting to peer
20:04:05.144 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] Successfully connected to peer
20:04:05.211 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc04bef0f, L:/127.0.0.1:58990 - R:/127.30.90.66:36409] using TOKEN/null
20:04:05.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.234905 31467 raft_consensus.cc:1275] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 1 FOLLOWER]: Refusing update from remote peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:05.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.235716 31750 raft_consensus.cc:1275] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Refusing update from remote peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:05.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.237201 31838 consensus_queue.cc:1048] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:05.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.238798 31842 consensus_queue.cc:1048] T 77b8655617d74907a0813305ebbc3192 P 5ad1dde7759c438aaf2bb6b3e0d7a1c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:04:05.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.321219 31848 mvcc.cc:204] Tried to move back new op lower bound from 7287335506864775168 to 7287335505855172608. Current Snapshot: MvccSnapshot[applied={T|T < 7287335506864775168}]
20:04:05.597 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=77b8655617d74907a0813305ebbc3192, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:05.598 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.30.90.124:34971
20:04:05.600 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:04:05.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.600800 31081 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31238
20:04:05.631 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.90.124:34971(127.30.90.124:34971)] handling channelInactive
20:04:05.632 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state READY due to: connection closed
20:04:05.638 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:05.638 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.30.90.66:36409
20:04:05.639 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

20:04:05.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:05.639369 31081 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31515
20:04:05.677 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] handling channelInactive
20:04:05.678 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] cleaning up while in state READY due to: connection closed
20:04:05.678 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:05.679 [DEBUG - Time-limited test] (Connection.java:748) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] connecting to peer
20:04:05.681 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409): Connection refused: /127.30.90.66:36409
20:04:05.681 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409): Connection refused: /127.30.90.66:36409
20:04:05.681 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409) for tablet 77b8655617d74907a0813305ebbc3192: Failed to connect to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409): Connection refused: /127.30.90.66:36409
20:04:05.698 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.702 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.702 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.30.90.124:34971(127.30.90.124:34971) for tablet Kudu Master: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.719 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.721 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.721 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.722 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.726 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:05.739 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.742 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.742 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.743 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:05.758 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.759 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.759 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.760 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.762 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:05.778 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.779 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.779 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.779 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.781 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:05.819 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.821 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.823 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:05.858 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.860 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.863 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:05.959 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:05.960 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.960 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.960 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:05.963 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:06.158 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:06.160 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.160 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.161 [INFO - pool-2-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.166 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:06.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.327683 31512 heartbeater.cc:646] Failed to heartbeat to 127.30.90.124:34971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:04:06.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.354656 31795 heartbeater.cc:646] Failed to heartbeat to 127.30.90.124:34971 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:04:06.359 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:06.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.363 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:06.739 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:06.741 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.741 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.742 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:06.743 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471; will retry
20:04:06.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.897737 31863 raft_consensus.cc:493] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0124cd258fa349769da8bbe2627c3081)
20:04:06.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.898293 31863 raft_consensus.cc:515] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:04:06.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.900462 31863 leader_election.cc:290] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21d4a14b273c45babcf96a70ad05e3c3 (127.30.90.125:34471), 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971)
20:04:06.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.901487 31211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "746dfd41629547bfba1779557bd83336" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "21d4a14b273c45babcf96a70ad05e3c3" is_pre_election: true
20:04:06.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.902925 31113 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111) [suppressed 13 similar messages]
20:04:06.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.905965 31113 leader_election.cc:336] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971): Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:04:06.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.906327 31113 leader_election.cc:304] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 746dfd41629547bfba1779557bd83336; no voters: 0124cd258fa349769da8bbe2627c3081, 21d4a14b273c45babcf96a70ad05e3c3
20:04:06.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.907016 31863 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:04:06.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.908118 31866 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0124cd258fa349769da8bbe2627c3081)
20:04:06.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.908526 31866 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:04:06.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.910562 31866 leader_election.cc:290] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 746dfd41629547bfba1779557bd83336 (127.30.90.126:40985), 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971)
20:04:06.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.911087 31133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21d4a14b273c45babcf96a70ad05e3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "746dfd41629547bfba1779557bd83336" is_pre_election: true
20:04:06.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.911643 31133 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d4a14b273c45babcf96a70ad05e3c3 in term 1.
20:04:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.912932 31188 leader_election.cc:304] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d4a14b273c45babcf96a70ad05e3c3, 746dfd41629547bfba1779557bd83336; no voters: 
20:04:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.913741 31866 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.913765 31188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:04:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.914084 31866 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0124cd258fa349769da8bbe2627c3081)
20:04:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.914469 31866 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 1 FOLLOWER]: Advancing to term 2
20:04:06.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.916931 31188 leader_election.cc:336] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971): Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:04:06.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.920300 31866 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:04:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.921656 31866 leader_election.cc:290] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [CANDIDATE]: Term 2 election: Requested vote from peers 746dfd41629547bfba1779557bd83336 (127.30.90.126:40985), 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971)
20:04:06.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.922497 31133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21d4a14b273c45babcf96a70ad05e3c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "746dfd41629547bfba1779557bd83336"
20:04:06.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.922952 31133 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 1 FOLLOWER]: Advancing to term 2
20:04:06.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.925112 31188 leader_election.cc:336] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971): Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111)
20:04:06.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.928550 31133 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d4a14b273c45babcf96a70ad05e3c3 in term 2.
20:04:06.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.929244 31188 leader_election.cc:304] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d4a14b273c45babcf96a70ad05e3c3, 746dfd41629547bfba1779557bd83336; no voters: 0124cd258fa349769da8bbe2627c3081
20:04:06.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.930027 31866 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 2 FOLLOWER]: Leader election won for term 2
20:04:06.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.930895 31866 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [term 2 LEADER]: Becoming Leader. State: Replica: 21d4a14b273c45babcf96a70ad05e3c3, State: Running, Role: LEADER
20:04:06.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.931838 31866 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } }
20:04:06.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.936568 31869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21d4a14b273c45babcf96a70ad05e3c3. Latest consensus state: current_term: 2 leader_uuid: "21d4a14b273c45babcf96a70ad05e3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:04:06.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.937273 31869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: This master's current role is: LEADER
20:04:06.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.939759 31871 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:06.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.946419 31871 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=78891c7b65fe4f0e91b0ca7c11dd521c]
20:04:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.951157 31871 tablet_loader.cc:96] loaded metadata for tablet 77b8655617d74907a0813305ebbc3192 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=78891c7b65fe4f0e91b0ca7c11dd521c])
20:04:06.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.951953 31871 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.954347 31871 catalog_manager.cc:1294] Loaded cluster ID: 1b775cff24ce43a89cbef66d9743f670
20:04:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.954548 31871 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:06.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.957317 31871 catalog_manager.cc:1539] Loading token signing keys...
20:04:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.959830 31871 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: Loaded TSK: 0
20:04:06.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.960690 31871 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:07.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.035601 31872 raft_consensus.cc:493] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ad1dde7759c438aaf2bb6b3e0d7a1c7)
20:04:07.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.036057 31872 raft_consensus.cc:515] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:07.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.038486 31872 leader_election.cc:290] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409), 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:04:07.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.052453 31682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111)
20:04:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.053122 31873 raft_consensus.cc:493] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ad1dde7759c438aaf2bb6b3e0d7a1c7)
20:04:07.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.054276 31873 raft_consensus.cc:515] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:07.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.057004 31682 leader_election.cc:336] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409): Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111)
20:04:07.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.058430 31873 leader_election.cc:290] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847), 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409)
20:04:07.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.062862 31400 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111)
20:04:07.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.066931 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "681f02ddc39e452d82ee80d3020df9b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "1f1504c3a051491d9d7efb01471b378f" is_pre_election: true
20:04:07.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.067747 31466 raft_consensus.cc:2468] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 681f02ddc39e452d82ee80d3020df9b3 in term 1.
20:04:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.069288 31400 leader_election.cc:336] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409): Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111)
20:04:07.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.070499 31684 leader_election.cc:304] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f1504c3a051491d9d7efb01471b378f, 681f02ddc39e452d82ee80d3020df9b3; no voters: 5ad1dde7759c438aaf2bb6b3e0d7a1c7
20:04:07.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.071339 31872 raft_consensus.cc:2804] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:07.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.071664 31872 raft_consensus.cc:493] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ad1dde7759c438aaf2bb6b3e0d7a1c7)
20:04:07.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.072008 31872 raft_consensus.cc:3060] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 1 FOLLOWER]: Advancing to term 2
20:04:07.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.073508 31749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "1f1504c3a051491d9d7efb01471b378f" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "681f02ddc39e452d82ee80d3020df9b3" is_pre_election: true
20:04:07.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.076820 31872 raft_consensus.cc:515] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:07.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.077966 31749 raft_consensus.cc:2393] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1f1504c3a051491d9d7efb01471b378f in current term 2: Already voted for candidate 681f02ddc39e452d82ee80d3020df9b3 in this term.
20:04:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.079288 31872 leader_election.cc:290] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [CANDIDATE]: Term 2 election: Requested vote from peers 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409), 1f1504c3a051491d9d7efb01471b378f (127.30.90.65:46079)
20:04:07.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.080574 31466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b8655617d74907a0813305ebbc3192" candidate_uuid: "681f02ddc39e452d82ee80d3020df9b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "1f1504c3a051491d9d7efb01471b378f"
20:04:07.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.081100 31466 raft_consensus.cc:3060] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 1 FOLLOWER]: Advancing to term 2
20:04:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.081691 31403 leader_election.cc:304] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f1504c3a051491d9d7efb01471b378f; no voters: 5ad1dde7759c438aaf2bb6b3e0d7a1c7, 681f02ddc39e452d82ee80d3020df9b3
20:04:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.082444 31682 leader_election.cc:336] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409): Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111)
20:04:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.086247 31466 raft_consensus.cc:2468] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 681f02ddc39e452d82ee80d3020df9b3 in term 2.
20:04:07.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.086675 31873 raft_consensus.cc:2749] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:04:07.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.087212 31684 leader_election.cc:304] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f1504c3a051491d9d7efb01471b378f, 681f02ddc39e452d82ee80d3020df9b3; no voters: 5ad1dde7759c438aaf2bb6b3e0d7a1c7
20:04:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.087850 31872 raft_consensus.cc:2804] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 2 FOLLOWER]: Leader election won for term 2
20:04:07.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.089888 31872 raft_consensus.cc:697] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 2 LEADER]: Becoming Leader. State: Replica: 681f02ddc39e452d82ee80d3020df9b3, State: Running, Role: LEADER
20:04:07.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.090806 31872 consensus_queue.cc:237] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } }
20:04:07.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.100076 31201 catalog_manager.cc:5696] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 reported cstate change: term changed from 1 to 2, leader changed from 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66) to 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67). New cstate: current_term: 2 leader_uuid: "681f02ddc39e452d82ee80d3020df9b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "681f02ddc39e452d82ee80d3020df9b3" member_type: VOTER last_known_addr { host: "127.30.90.67" port: 44847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ad1dde7759c438aaf2bb6b3e0d7a1c7" member_type: VOTER last_known_addr { host: "127.30.90.66" port: 36409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 } health_report { overall_health: UNKNOWN } } }
20:04:07.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.108530 31133 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [term 2 FOLLOWER]: Refusing update from remote peer 21d4a14b273c45babcf96a70ad05e3c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
20:04:07.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.109759 31866 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
20:04:07.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.110399 31188 consensus_peers.cc:597] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 -> Peer 0124cd258fa349769da8bbe2627c3081 (127.30.90.124:34971): Couldn't send request to peer 0124cd258fa349769da8bbe2627c3081. Status: Network error: Client connection negotiation failed: client connection to 127.30.90.124:34971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:04:07.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.115437 31863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21d4a14b273c45babcf96a70ad05e3c3. Latest consensus state: current_term: 2 leader_uuid: "21d4a14b273c45babcf96a70ad05e3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:04:07.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.116040 31863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: This master's current role is: FOLLOWER
20:04:07.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.120039 31866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "21d4a14b273c45babcf96a70ad05e3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:04:07.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.120728 31866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3 [sys.catalog]: This master's current role is: LEADER
20:04:07.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.120932 31863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "21d4a14b273c45babcf96a70ad05e3c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "746dfd41629547bfba1779557bd83336" member_type: VOTER last_known_addr { host: "127.30.90.126" port: 40985 } } peers { permanent_uuid: "21d4a14b273c45babcf96a70ad05e3c3" member_type: VOTER last_known_addr { host: "127.30.90.125" port: 34471 } } peers { permanent_uuid: "0124cd258fa349769da8bbe2627c3081" member_type: VOTER last_known_addr { host: "127.30.90.124" port: 34971 } } }
20:04:07.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.121556 31863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 746dfd41629547bfba1779557bd83336 [sys.catalog]: This master's current role is: FOLLOWER
20:04:07.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.508248 31466 raft_consensus.cc:1275] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 2 FOLLOWER]: Refusing update from remote peer 681f02ddc39e452d82ee80d3020df9b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
20:04:07.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.509545 31872 consensus_queue.cc:1048] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f1504c3a051491d9d7efb01471b378f" member_type: VOTER last_known_addr { host: "127.30.90.65" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
20:04:07.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.512668 31516 heartbeater.cc:499] Master 127.30.90.125:34471 was elected leader, sending a full tablet report...
20:04:07.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.522588 31796 heartbeater.cc:499] Master 127.30.90.125:34471 was elected leader, sending a full tablet report...
20:04:07.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.525906 31682 consensus_peers.cc:597] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 -> Peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409): Couldn't send request to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7. Status: Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:04:08.279 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.124:34971(127.30.90.124:34971)] connecting to peer
20:04:08.280 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:08.280 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.90.124:34971(127.30.90.124:34971)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:08.280 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.124:34971: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971
20:04:08.285 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:08.287 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=29981, elapsed=2587), Traces: [0ms] sending RPC to server master-127.30.90.124:34971, [4ms] received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [24ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [29ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [44ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [45ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [45ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [61ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [64ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [79ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [84ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [123ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [124ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [125ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [162ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [164ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [165ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [262ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [264ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [264ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [265ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [459ms] refreshing cache from master, [459ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [463ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [464ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [467ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [468ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [660ms] refreshing cache from master, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [662ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [664ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [665ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [665ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [1042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [1044ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [1045ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [1045ms] delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [2580ms] refreshing cache from master, [2580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [2580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [2584ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [2586ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, deferred=Deferred@955558890(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@1191629239 after retry RPC after error@836475011) -> (continuation of Deferred@1066172462 after retry RPC after error@582666190) -> (continuation of Deferred@1396711751 after retry RPC after error@1051898924) -> (continuation of Deferred@1709497892 after retry RPC after error@294969825) -> (continuation of Deferred@1133289613 after retry RPC after error@1756659460) -> (continuation of Deferred@736266696 after retry RPC after error@491777724) -> (continuation of Deferred@996261200 after retry RPC after error@1885776231) -> (continuation of Deferred@1333117546 after retry RPC after error@766373686) -> (continuation of Deferred@454057198 after retry RPC after error@1584980858) -> (continuation of Deferred@1065294925 after retry RPC after error@2112458955), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1191629239 after retry RPC after error@836475011) -> (continuation of Deferred@1066172462 after retry RPC after error@582666190) -> (continuation of Deferred@1396711751 after retry RPC after error@1051898924) -> (continuation of Deferred@1709497892 after retry RPC after error@294969825) -> (continuation of Deferred@1133289613 after retry RPC after error@1756659460) -> (continuation of Deferred@736266696 after retry RPC after error@491777724) -> (continuation of Deferred@996261200 after retry RPC after error@1885776231) -> (continuation of Deferred@1333117546 after retry RPC after error@766373686) -> (continuation of Deferred@454057198 after retry RPC after error@1584980858) -> (continuation of Deferred@1065294925 after retry RPC after error@2112458955))) after lookup
20:04:08.292 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 77b8655617d74907a0813305ebbc3192 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
20:04:08.292 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=77b8655617d74907a0813305ebbc3192@[1f1504c3a051491d9d7efb01471b378f(127.30.90.65:46079),5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409),681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)[L]]}]
20:04:08.294 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=77b8655617d74907a0813305ebbc3192, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2614), Traces: [0ms] sending RPC to server 5ad1dde7759c438aaf2bb6b3e0d7a1c7, [3ms] received response from server 5ad1dde7759c438aaf2bb6b3e0d7a1c7: Network error: Failed to connect to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409): Connection refused: /127.30.90.66:36409, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409): Connection refused: /127.30.90.66:36409, [20ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.90.124:34971, [24ms] Sub RPC GetTableLocations: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [24ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [40ms] Sub RPC GetTableLocations: refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [44ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [44ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [49ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [64ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [65ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [65ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [79ms] Sub RPC GetTableLocations: refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [81ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [83ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [84ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [99ms] Sub RPC GetTableLocations: refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [101ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [102ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [104ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [140ms] Sub RPC GetTableLocations: refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [143ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [145ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [145ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [180ms] Sub RPC GetTableLocations: refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [182ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [184ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [185ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [279ms] Sub RPC GetTableLocations: refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [284ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [284ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [285ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [479ms] Sub RPC GetTableLocations: refreshing cache from master, [479ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [483ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [484ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [487ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [488ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [682ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [684ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [685ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [685ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [1060ms] Sub RPC GetTableLocations: refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [1064ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [1065ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [1065ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.126:40985,127.30.90.124:34971,127.30.90.125:34471) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [2600ms] Sub RPC GetTableLocations: refreshing cache from master, [2600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.126:40985, [2600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.124:34971, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.125:34471, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.124:34971: Network error: Failed to connect to peer master-127.30.90.124:34971(127.30.90.124:34971): Connection refused: /127.30.90.124:34971, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.126:40985: OK, [2606ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.125:34471: OK, [2610ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.90.125:34471, [2614ms] Sub RPC GetTableLocations: received response from server master-127.30.90.125:34471: OK, deferred=Deferred@2105346157(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3a27eefb -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@b795ebc -> wakeup thread Time-limited test)) after lookup
20:04:08.296 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)] connecting to peer
20:04:08.297 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)] Successfully connected to peer
20:04:08.323 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x6557d73e, L:/127.0.0.1:33938 - R:/127.30.90.67:44847] using TOKEN/null
20:04:08.483 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=77b8655617d74907a0813305ebbc3192, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:08.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.488651 31200 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57794:
20:04:08.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
20:04:08.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.489408 31200 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57794:
20:04:08.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
20:04:08.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.521315 31200 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 21d4a14b273c45babcf96a70ad05e3c3: Sending DeleteTablet for 3 replicas of tablet 77b8655617d74907a0813305ebbc3192
20:04:08.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.540421 31729 tablet_service.cc:1558] Processing DeleteTablet for tablet 77b8655617d74907a0813305ebbc3192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 20:04:08 UTC) from {username='slave'} at 127.0.0.1:33948
20:04:08.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.549099 31447 tablet_service.cc:1558] Processing DeleteTablet for tablet 77b8655617d74907a0813305ebbc3192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 20:04:08 UTC) from {username='slave'} at 127.0.0.1:48996
20:04:08.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:08.550736 31185 catalog_manager.cc:4754] TS 5ad1dde7759c438aaf2bb6b3e0d7a1c7 (127.30.90.66:36409): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77b8655617d74907a0813305ebbc3192: Network error: Client connection negotiation failed: client connection to 127.30.90.66:36409: connect: Connection refused (error 111)
20:04:08.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.559742 31919 tablet_replica.cc:333] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: stopping tablet replica
20:04:08.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.560947 31919 raft_consensus.cc:2243] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 2 FOLLOWER]: Raft consensus shutting down.
20:04:08.565 [DEBUG - main] (Connection.java:575) [peer 5ad1dde7759c438aaf2bb6b3e0d7a1c7(127.30.90.66:36409)] disconnecting while in state TERMINATED
20:04:08.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.565101 31918 tablet_replica.cc:333] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: stopping tablet replica
20:04:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.566169 31918 raft_consensus.cc:2243] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 2 LEADER]: Raft consensus shutting down.
20:04:08.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.567935 31918 raft_consensus.cc:2272] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3 [term 2 FOLLOWER]: Raft consensus is shut down!
20:04:08.568 [DEBUG - main] (Connection.java:575) [peer master-127.30.90.126:40985(127.30.90.126:40985)] disconnecting while in state READY
20:04:08.571 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.90.126:40985(127.30.90.126:40985)] handling channelInactive
20:04:08.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.571429 31918 ts_tablet_manager.cc:1916] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Deleting tablet data with delete state TABLET_DATA_DELETED
20:04:08.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.90.126:40985(127.30.90.126:40985)] cleaning up while in state READY due to: connection closed
20:04:08.573 [DEBUG - main] (Connection.java:575) [peer master-127.30.90.124:34971(127.30.90.124:34971)] disconnecting while in state TERMINATED
20:04:08.574 [DEBUG - main] (Connection.java:575) [peer master-127.30.90.125:34471(127.30.90.125:34471)] disconnecting while in state READY
20:04:08.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.574172 31919 raft_consensus.cc:2272] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f [term 2 FOLLOWER]: Raft consensus is shut down!
20:04:08.574 [DEBUG - main] (Connection.java:575) [peer 681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)] disconnecting while in state READY
20:04:08.575 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.90.125:34471(127.30.90.125:34471)] handling channelInactive
20:04:08.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.90.125:34471(127.30.90.125:34471)] cleaning up while in state READY due to: connection closed
20:04:08.576 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)] handling channelInactive
20:04:08.576 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 681f02ddc39e452d82ee80d3020df9b3(127.30.90.67:44847)] cleaning up while in state READY due to: connection closed
20:04:08.577 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:08.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.577998 31919 ts_tablet_manager.cc:1916] T 77b8655617d74907a0813305ebbc3192 P 1f1504c3a051491d9d7efb01471b378f: Deleting tablet data with delete state TABLET_DATA_DELETED
20:04:08.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.585314 31081 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31361
20:04:08.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.591252 31918 ts_tablet_manager.cc:1929] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
20:04:08.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.591614 31918 log.cc:1199] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Deleting WAL directory at /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster3946575926370271489/ts-2/wal/wals/77b8655617d74907a0813305ebbc3192
20:04:08.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.592500 31918 ts_tablet_manager.cc:1950] T 77b8655617d74907a0813305ebbc3192 P 681f02ddc39e452d82ee80d3020df9b3: Deleting consensus metadata
20:04:08.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.596843 31188 catalog_manager.cc:5027] TS 681f02ddc39e452d82ee80d3020df9b3 (127.30.90.67:44847): tablet 77b8655617d74907a0813305ebbc3192 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=78891c7b65fe4f0e91b0ca7c11dd521c]) successfully deleted
20:04:08.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.621296 31081 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31660
20:04:08.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.653991 31081 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31093
20:04:08.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.692164 31081 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31163
20:04:09.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:09Z chronyd exiting
.20:04:11.190 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779134651190
20:04:11.195 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:04:11.196 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:04:11.196 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskQ0pVph/test-tmp
20:04:11.196 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:04:11.196 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskQ0pVph/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:04:11.199 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:04:11.528 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:11.529 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:04:11.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.532516 31925 mini_oidc.cc:150] Starting JWKS server
20:04:11.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.535573 31925 webserver.cc:533] Webserver started at http://127.0.0.1:33679/ using document root <none> and password file <none>
20:04:11.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.535960 31925 mini_oidc.cc:186] Starting OIDC Discovery server
20:04:11.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.537590 31925 webserver.cc:533] Webserver started at http://127.0.0.1:46195/ using document root <none> and password file <none>
20:04:11.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:11Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:04:11.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:11Z Disabled control of system clock
20:04:11.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.597234 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:11.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:11.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal
20:04:11.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data
20:04:11.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:11.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/logs
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data/info.pb
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.126:46515
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.126
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json with env {}
20:04:11.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.888710 31937 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:11.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.889253 31937 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:11.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.889699 31937 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:11.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.924355 31937 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:11.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.924659 31937 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.924852 31937 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.925038 31937 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.925230 31937 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.925377 31937 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33679/jwks.json
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.962062 31937 master_runner.cc:387] Master server non-default flags:
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.126:46515
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data/info.pb
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.126
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/logs
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:11.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.963465 31937 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:11.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:11.965240 31937 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:11.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.976078 31943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:13.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.381222 31942 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 31937
20:04:13.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.754894 31942 kernel_stack_watchdog.cc:198] Thread 31937 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 402ms:
20:04:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:11.976784 31944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.756520 31945 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1779 milliseconds
20:04:13.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.760306 31937 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.784s	user 0.000s	sys 0.005s
20:04:13.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.760705 31937 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.784s	user 0.000s	sys 0.005s
20:04:13.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.762318 31946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:13.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.762319 31937 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:13.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.763625 31937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:13.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.765941 31937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:13.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.767275 31937 hybrid_clock.cc:648] HybridClock initialized: now 1779134653767244 us; error 45 us; skew 500 ppm
20:04:13.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.768038 31937 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:13.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.773924 31937 webserver.cc:533] Webserver started at http://127.31.45.126:33511/ using document root <none> and password file <none>
20:04:13.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.774789 31937 fs_manager.cc:362] Metadata directory not provided
20:04:13.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.774966 31937 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:13.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.775338 31937 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.779637 31937 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data/instance:
20:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b47645b60bdd4b81aaa13fa3e1b832f6"
20:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:13 on dist-test-slave-8tr7"
20:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.780622 31937 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal/instance:
20:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b47645b60bdd4b81aaa13fa3e1b832f6"
20:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:13 on dist-test-slave-8tr7"
20:04:13.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.788070 31937 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.008s
20:04:13.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.793605 31953 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.794688 31937 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.794960 31937 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b47645b60bdd4b81aaa13fa3e1b832f6"
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:13 on dist-test-slave-8tr7"
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.795243 31937 fs_report.cc:389] FS layout report
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data/data
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:13.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:13.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.853771 31937 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.855332 31937 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.855748 31937 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:13.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.927119 31937 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.126:46515
20:04:13.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.927211 32004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.126:46515 every 8 connection(s)
20:04:13.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.930019 31937 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/data/info.pb
20:04:13.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.935796 32005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:13.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.936249 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 31937
20:04:13.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.936589 31925 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-0/wal/instance
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.939946 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/logs
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data/info.pb
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:13.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.125:45739
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.125
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json with env {}
20:04:13.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.947824 32005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } has no permanent_uuid. Determining permanent_uuid...
20:04:13.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.977921 32005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } has no permanent_uuid. Determining permanent_uuid...
20:04:13.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.980459 31956 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:13.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.984771 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:14.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.034298 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 1
20:04:14.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.038265 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:14.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.106753 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 2
20:04:14.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.110774 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:14.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.202234 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 3
20:04:14.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.206125 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:14.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.254340 32007 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.254916 32007 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:14.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.255367 32007 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.288127 32007 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.288415 32007 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.288771 32007 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.289002 32007 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.289211 32007 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.289355 32007 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33679/jwks.json
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.324496 32007 master_runner.cc:387] Master server non-default flags:
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.125:45739
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data/info.pb
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.125
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:14.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/logs
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.325732 32007 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:14.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.327349 32007 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:14.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.339025 32016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:14.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.349609 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 4
20:04:14.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.356737 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:14.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.656280 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 5
20:04:14.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.663872 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:15.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.211452 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 6
20:04:15.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.245815 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.125:45739: Network error: Client connection negotiation failed: client connection to 127.31.45.125:45739: connect: Connection refused (error 111)
20:04:15.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.742391 32015 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 32007
20:04:15.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.339764 32017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:15.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.942351 32007 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.604s	user 0.538s	sys 1.065s
20:04:15.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.944026 32007 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.605s	user 0.538s	sys 1.065s
20:04:15.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.944849 32019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:15.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.948192 32018 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1603 milliseconds
20:04:15.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.948220 32007 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:15.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.949481 32007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:15.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.951983 32007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:15.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.953366 32007 hybrid_clock.cc:648] HybridClock initialized: now 1779134655953331 us; error 32 us; skew 500 ppm
20:04:15.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.954289 32007 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:15.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.960736 32007 webserver.cc:533] Webserver started at http://127.31.45.125:37215/ using document root <none> and password file <none>
20:04:15.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.961716 32007 fs_manager.cc:362] Metadata directory not provided
20:04:15.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.961963 32007 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:15.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.962380 32007 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:15.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.966920 32007 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data/instance:
20:04:15.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce07b81c56d4457ba6b0f730711d5c47"
20:04:15.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:15 on dist-test-slave-8tr7"
20:04:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.967979 32007 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal/instance:
20:04:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce07b81c56d4457ba6b0f730711d5c47"
20:04:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:15 on dist-test-slave-8tr7"
20:04:15.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.975661 32007 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
20:04:15.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.981096 32028 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:15.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.982162 32007 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
20:04:15.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.982511 32007 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal
20:04:15.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce07b81c56d4457ba6b0f730711d5c47"
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:15 on dist-test-slave-8tr7"
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.982872 32007 fs_report.cc:389] FS layout report
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data/data
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:16.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.037030 32007 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:16.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.038722 32007 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:16.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.039253 32007 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.111035 32007 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.125:45739
20:04:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.111137 32079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.125:45739 every 8 connection(s)
20:04:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.114995 32007 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/data/info.pb
20:04:16.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.120819 32080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.124876 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 32007
20:04:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.125195 31925 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-1/wal/instance
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.127146 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/logs
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/info.pb
20:04:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.124:40383
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.124
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json with env {}
20:04:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.131923 32080 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.159633 32080 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.174995 32080 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.177457 32029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.181757 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.231240 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 1
20:04:16.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.235888 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.304301 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 2
20:04:16.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.306399 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } attempt: 7
20:04:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.309051 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.318368 32005 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.324064 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.382481 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 1
20:04:16.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.386329 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.400483 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 3
20:04:16.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.404573 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.449076 32082 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:16.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.449801 32082 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:16.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.450471 32082 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.467767 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 2
20:04:16.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.472126 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.485499 32082 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.485895 32082 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.486233 32082 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.486572 32082 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:16.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.486903 32082 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:16.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.487152 32082 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33679/jwks.json
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.525014 32082 master_runner.cc:387] Master server non-default flags:
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:16.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.124:40383
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/info.pb
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.124
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/logs
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:16.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:16.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.526818 32082 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:16.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.528610 32082 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:16.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.539227 32094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:16.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.547958 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 4
20:04:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.554086 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.557565 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 3
20:04:16.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.564740 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.705355 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 4
20:04:16.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.714236 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.853555 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 5
20:04:16.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.861675 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:16.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.997925 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 5
20:04:17.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.007987 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:17.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.409307 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 6
20:04:17.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.436496 32080 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:17.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.560614 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 6
20:04:17.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.597041 32005 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.124:40383: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:17.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.539837 32095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:17.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.806373 32097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:17.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.810261 32096 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1269 milliseconds
20:04:17.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.811113 32082 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.272s	user 0.420s	sys 0.844s
20:04:17.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.811353 32082 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.272s	user 0.420s	sys 0.844s
20:04:17.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.811528 32082 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:17.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.812551 32082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:17.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.815083 32082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:17.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.816465 32082 hybrid_clock.cc:648] HybridClock initialized: now 1779134657816404 us; error 56 us; skew 500 ppm
20:04:17.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.817351 32082 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:17.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.824687 32082 webserver.cc:533] Webserver started at http://127.31.45.124:36685/ using document root <none> and password file <none>
20:04:17.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.825750 32082 fs_manager.cc:362] Metadata directory not provided
20:04:17.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.826086 32082 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:17.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.826669 32082 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.831178 32082 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/instance:
20:04:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f60ef483fa024f40a6d304440cbaa346"
20:04:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-8tr7"
20:04:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.832347 32082 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal/instance:
20:04:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f60ef483fa024f40a6d304440cbaa346"
20:04:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-8tr7"
20:04:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.839843 32082 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
20:04:17.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.845916 32108 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.847168 32082 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
20:04:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.847558 32082 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f60ef483fa024f40a6d304440cbaa346"
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-8tr7"
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.847915 32082 fs_report.cc:389] FS layout report
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/data
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:17.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.911146 32082 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:17.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.912695 32082 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:17.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.913218 32082 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:17.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.986763 32082 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.124:40383
20:04:17.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.986855 32159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.124:40383 every 8 connection(s)
20:04:17.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.989730 32082 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/info.pb
20:04:17.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.992533 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 32082
20:04:17.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.992995 31925 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal/instance
20:04:17.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.996841 32160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:18.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.016127 32160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } has no permanent_uuid. Determining permanent_uuid...
20:04:18.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.039716 32160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } has no permanent_uuid. Determining permanent_uuid...
20:04:18.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.049114 32160 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } has no permanent_uuid. Determining permanent_uuid...
20:04:18.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.064589 32160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Bootstrap starting.
20:04:18.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.070780 32160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Neither blocks nor log segments found. Creating new log.
20:04:18.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.072463 32160 log.cc:826] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Log is configured to *not* fsync() on all Append() calls
20:04:18.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.077310 32160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: No bootstrap required, opened a new log
20:04:18.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.095908 32160 raft_consensus.cc:359] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.096823 32160 raft_consensus.cc:385] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.097117 32160 raft_consensus.cc:740] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f60ef483fa024f40a6d304440cbaa346, State: Initialized, Role: FOLLOWER
20:04:18.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.097949 32160 consensus_queue.cc:260] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.100307 32169 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.100852 32169 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.101637 32160 sys_catalog.cc:565] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: configured and running, proceeding with master startup.
20:04:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.128636 32180 catalog_manager.cc:1593] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:04:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.129314 32180 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:04:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.123221 32082 master_runner.cc:187] Error getting master registration for 127.31.45.126:46515: OK, instance_id { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" instance_seqno: 1779134653906448 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:04:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.148743 32082 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:04:18.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.168085 32114 tablet.cc:2404] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:18.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.253513 32169 raft_consensus.cc:493] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:18.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.254097 32169 raft_consensus.cc:515] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.256248 32169 leader_election.cc:290] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b47645b60bdd4b81aaa13fa3e1b832f6 (127.31.45.126:46515), ce07b81c56d4457ba6b0f730711d5c47 (127.31.45.125:45739)
20:04:18.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.496976 32080 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 7
20:04:18.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.521063 32080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: Bootstrap starting.
20:04:18.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.530237 32080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: Neither blocks nor log segments found. Creating new log.
20:04:18.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.532474 32080 log.cc:826] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: Log is configured to *not* fsync() on all Append() calls
20:04:18.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.537655 32080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: No bootstrap required, opened a new log
20:04:18.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.565084 32080 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.565991 32080 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:18.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.566489 32080 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce07b81c56d4457ba6b0f730711d5c47, State: Initialized, Role: FOLLOWER
20:04:18.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.567366 32080 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.569989 32184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.570725 32184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.571969 32080 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: configured and running, proceeding with master startup.
20:04:18.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.572311 32055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f60ef483fa024f40a6d304440cbaa346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce07b81c56d4457ba6b0f730711d5c47" is_pre_election: true
20:04:18.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.573889 32055 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f60ef483fa024f40a6d304440cbaa346 in term 0.
20:04:18.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.576287 32111 leader_election.cc:304] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce07b81c56d4457ba6b0f730711d5c47, f60ef483fa024f40a6d304440cbaa346; no voters: 
20:04:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.577349 32169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.577867 32169 raft_consensus.cc:493] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.578225 32169 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 0 FOLLOWER]: Advancing to term 1
20:04:18.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.587101 32169 raft_consensus.cc:515] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.600965 32055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f60ef483fa024f40a6d304440cbaa346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce07b81c56d4457ba6b0f730711d5c47"
20:04:18.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.601531 32055 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 0 FOLLOWER]: Advancing to term 1
20:04:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.600975 32169 leader_election.cc:290] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [CANDIDATE]: Term 1 election: Requested vote from peers b47645b60bdd4b81aaa13fa3e1b832f6 (127.31.45.126:46515), ce07b81c56d4457ba6b0f730711d5c47 (127.31.45.125:45739)
20:04:18.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.613116 32055 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f60ef483fa024f40a6d304440cbaa346 in term 1.
20:04:18.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.615752 32111 leader_election.cc:304] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce07b81c56d4457ba6b0f730711d5c47, f60ef483fa024f40a6d304440cbaa346; no voters: 
20:04:18.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.616585 32169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 1 FOLLOWER]: Leader election won for term 1
20:04:18.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.619123 32169 raft_consensus.cc:697] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 1 LEADER]: Becoming Leader. State: Replica: f60ef483fa024f40a6d304440cbaa346, State: Running, Role: LEADER
20:04:18.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.620229 32169 consensus_queue.cc:237] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.630462 32005 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } attempt: 7
20:04:18.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.641027 32196 catalog_manager.cc:1593] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:04:18.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.641568 32196 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:04:18.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.649592 32195 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60ef483fa024f40a6d304440cbaa346. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.656708 32195 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: LEADER
20:04:18.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.677018 32005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: Bootstrap starting.
20:04:18.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.692451 32200 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:18.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.698575 32005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: Neither blocks nor log segments found. Creating new log.
20:04:18.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.701205 32005 log.cc:826] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: Log is configured to *not* fsync() on all Append() calls
20:04:18.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.705009 32200 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:18.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.656390 32007 master_runner.cc:187] Error getting master registration for 127.31.45.126:46515: OK, instance_id { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" instance_seqno: 1779134653906448 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:04:18.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.717725 32007 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:04:18.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.729324 32005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: No bootstrap required, opened a new log
20:04:18.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.773969 32055 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Refusing update from remote peer f60ef483fa024f40a6d304440cbaa346: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.776463 32195 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:18.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.780660 32005 raft_consensus.cc:359] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.782438 32005 raft_consensus.cc:385] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:18.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.783072 32005 raft_consensus.cc:740] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b47645b60bdd4b81aaa13fa3e1b832f6, State: Initialized, Role: FOLLOWER
20:04:18.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.784998 32005 consensus_queue.cc:260] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:18.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.797189 32034 tablet.cc:2404] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:18.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.803277 31979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f60ef483fa024f40a6d304440cbaa346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6"
20:04:18.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.804090 31979 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 0 FOLLOWER]: Advancing to term 1
20:04:18.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.796432 32204 sys_catalog.cc:455] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.810192 32204 sys_catalog.cc:458] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.810160 31980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f60ef483fa024f40a6d304440cbaa346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" is_pre_election: true
20:04:18.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.812947 31979 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f60ef483fa024f40a6d304440cbaa346 in term 1.
20:04:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.814409 31978 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Refusing update from remote peer f60ef483fa024f40a6d304440cbaa346: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:18.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.819950 32005 sys_catalog.cc:565] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: configured and running, proceeding with master startup.
20:04:18.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.820488 32184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60ef483fa024f40a6d304440cbaa346. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.821169 32184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.828913 32195 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:04:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.846164 32203 mvcc.cc:204] Tried to move back new op lower bound from 7287335562321276928 to 7287335561720156160. Current Snapshot: MvccSnapshot[applied={T|T < 7287335562321276928}]
20:04:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.862605 32195 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.863448 32195 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: LEADER
20:04:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.864773 32184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.865711 32184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.868127 31959 tablet.cc:2404] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:18.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.874190 32204 sys_catalog.cc:455] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60ef483fa024f40a6d304440cbaa346. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.874656 32200 catalog_manager.cc:1382] Generated new cluster ID: 5fdf3bce6b634b5aa4ff8e6a384f4957
20:04:18.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.874926 32200 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:18.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.874897 32204 sys_catalog.cc:458] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.880261 32169 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.882362 32169 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: LEADER
20:04:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.895888 32207 mvcc.cc:204] Tried to move back new op lower bound from 7287335562321276928 to 7287335561720156160. Current Snapshot: MvccSnapshot[applied={T|T < 7287335562321276928}]
20:04:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.902773 32204 sys_catalog.cc:455] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f60ef483fa024f40a6d304440cbaa346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.903479 32204 sys_catalog.cc:458] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.978363 32200 catalog_manager.cc:1405] Generated new certificate authority record
20:04:18.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.981958 32200 catalog_manager.cc:1539] Loading token signing keys...
20:04:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.990952 32222 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:04:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.040885 32200 catalog_manager.cc:6069] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Generated new TSK 0
20:04:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.042305 32200 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.065094 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/logs
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data/info.pb
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.65:0
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.65
20:04:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.65
20:04:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:19.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.522465 32223 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:19.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.523471 32223 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:19.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.524179 32223 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:19.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.584388 32223 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:19.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.585775 32223 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.45.65
20:04:19.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.647264 32196 catalog_manager.cc:1294] Loaded cluster ID: 5fdf3bce6b634b5aa4ff8e6a384f4957
20:04:19.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.647872 32196 catalog_manager.cc:1587] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: loading cluster ID for follower catalog manager: success
20:04:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.652246 32223 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.65:0
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data/info.pb
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.65
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.65
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/logs
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:19.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.655352 32223 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:19.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.655177 32196 catalog_manager.cc:1609] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: acquiring CA information for follower catalog manager: success
20:04:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.658041 32223 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:19.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.660655 32196 catalog_manager.cc:1637] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:19.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.673645 32229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.015673 32222 catalog_manager.cc:1294] Loaded cluster ID: 5fdf3bce6b634b5aa4ff8e6a384f4957
20:04:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.015965 32222 catalog_manager.cc:1587] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: loading cluster ID for follower catalog manager: success
20:04:20.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.038893 32222 catalog_manager.cc:1609] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: acquiring CA information for follower catalog manager: success
20:04:20.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.046120 32222 catalog_manager.cc:1637] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:21.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.675830 32230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:21.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:21.075995 32228 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 32223
20:04:21.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:21.461517 32223 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.788s	user 0.407s	sys 0.736s
20:04:21.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:21.464161 32223 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.791s	user 0.407s	sys 0.736s
20:04:21.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.477759 32223 server_base.cc:1061] running on GCE node
20:04:21.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:21.478288 32235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:21.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.479702 32223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:21.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.492875 32223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:21.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.494778 32223 hybrid_clock.cc:648] HybridClock initialized: now 1779134661494317 us; error 472 us; skew 500 ppm
20:04:21.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.496065 32223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:21.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.504848 32223 webserver.cc:533] Webserver started at http://127.31.45.65:40811/ using document root <none> and password file <none>
20:04:21.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.506079 32223 fs_manager.cc:362] Metadata directory not provided
20:04:21.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.506343 32223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:21.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.506858 32223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:21.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.513129 32223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data/instance:
20:04:21.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b7a663594600424d89bdc7f3e2b2b491"
20:04:21.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:21 on dist-test-slave-8tr7"
20:04:21.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.514607 32223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal/instance:
20:04:21.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b7a663594600424d89bdc7f3e2b2b491"
20:04:21.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:21 on dist-test-slave-8tr7"
20:04:21.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.524114 32223 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.000s	sys 0.007s
20:04:21.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.531569 32241 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:21.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.533051 32223 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.004s
20:04:21.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.533433 32223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal
20:04:21.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b7a663594600424d89bdc7f3e2b2b491"
20:04:21.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:21 on dist-test-slave-8tr7"
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.533901 32223 fs_report.cc:389] FS layout report
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data/data
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:21.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:21.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:21.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.615284 32223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:21.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.617192 32223 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:21.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.617744 32223 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:21.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.621333 32223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:21.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.627142 32223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.627413 32223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.627717 32223 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.627918 32223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:21.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.829821 32223 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.65:43567
20:04:21.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.829952 32353 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.65:43567 every 8 connection(s)
20:04:21.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.832476 32223 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/data/info.pb
20:04:21.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.833855 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 32223
20:04:21.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.834650 31925 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-0/wal/instance
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.851539 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/logs
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data/info.pb
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:21.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.66:0
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.66
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.66
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:21.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.920231 32355 heartbeater.cc:344] Connected to a master server at 127.31.45.125:45739
20:04:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.920719 32355 heartbeater.cc:461] Registering TS with master...
20:04:21.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.922093 32355 heartbeater.cc:507] Master 127.31.45.125:45739 requested a full tablet report, sending...
20:04:21.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.926016 32045 ts_manager.cc:194] Registered new tserver with Master: b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567)
20:04:21.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.933727 32354 heartbeater.cc:344] Connected to a master server at 127.31.45.124:40383
20:04:21.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.946688 32354 heartbeater.cc:461] Registering TS with master...
20:04:21.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.947618 32354 heartbeater.cc:507] Master 127.31.45.124:40383 requested a full tablet report, sending...
20:04:21.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.950861 32125 ts_manager.cc:194] Registered new tserver with Master: b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567)
20:04:21.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.953608 32125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.45.65:43691
20:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.964852 32358 heartbeater.cc:344] Connected to a master server at 127.31.45.126:46515
20:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.965219 32358 heartbeater.cc:461] Registering TS with master...
20:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.965982 32358 heartbeater.cc:507] Master 127.31.45.126:46515 requested a full tablet report, sending...
20:04:21.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.970142 31970 ts_manager.cc:194] Registered new tserver with Master: b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567)
20:04:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.269661 32361 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.270285 32361 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.270978 32361 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:22.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.304155 32361 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:22.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.304906 32361 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.45.66
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.341636 32361 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.66:0
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data/info.pb
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.66
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.66
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/logs
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.342928 32361 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.344497 32361 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.357671 32371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:22.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.958763 32354 heartbeater.cc:499] Master 127.31.45.124:40383 was elected leader, sending a full tablet report...
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.760190 32370 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 32361
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.895789 32370 kernel_stack_watchdog.cc:198] Thread 32361 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.358592 32372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.897292 32361 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.538s	user 0.001s	sys 0.000s
20:04:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.897655 32361 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.538s	user 0.001s	sys 0.000s
20:04:23.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.902271 32373 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1541 milliseconds
20:04:23.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.903105 32374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:23.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.903162 32361 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:23.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.904393 32361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:23.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.906395 32361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:23.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.907730 32361 hybrid_clock.cc:648] HybridClock initialized: now 1779134663907704 us; error 37 us; skew 500 ppm
20:04:23.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.908491 32361 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:23.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.914155 32361 webserver.cc:533] Webserver started at http://127.31.45.66:41169/ using document root <none> and password file <none>
20:04:23.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.914997 32361 fs_manager.cc:362] Metadata directory not provided
20:04:23.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.915176 32361 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:23.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.915561 32361 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:23.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.919943 32361 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data/instance:
20:04:23.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "63640de53d4f4251889063107089c05d"
20:04:23.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:23 on dist-test-slave-8tr7"
20:04:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.920987 32361 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal/instance:
20:04:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "63640de53d4f4251889063107089c05d"
20:04:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:23 on dist-test-slave-8tr7"
20:04:23.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.927798 32361 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.008s
20:04:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.934623 32381 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.935832 32361 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
20:04:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.936177 32361 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal
20:04:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "63640de53d4f4251889063107089c05d"
20:04:23.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:23 on dist-test-slave-8tr7"
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.936599 32361 fs_report.cc:389] FS layout report
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data/data
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:23.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:23.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.993528 32361 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:23.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.995468 32361 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:23.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.995973 32361 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:23.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.999171 32361 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:24.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.004768 32361 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:24.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.005019 32361 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:24.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.005291 32361 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:24.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.005486 32361 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:24.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.147862 32361 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.66:42583
20:04:24.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.147941 32493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.66:42583 every 8 connection(s)
20:04:24.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.151361 32361 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/data/info.pb
20:04:24.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.154048 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 32361
20:04:24.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.155067 31925 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-1/wal/instance
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.168725 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/logs
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data/info.pb
20:04:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.67:0
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.67
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.67
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:24.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.216768 32498 heartbeater.cc:344] Connected to a master server at 127.31.45.126:46515
20:04:24.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.216849 32495 heartbeater.cc:344] Connected to a master server at 127.31.45.125:45739
20:04:24.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.217339 32498 heartbeater.cc:461] Registering TS with master...
20:04:24.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.217339 32495 heartbeater.cc:461] Registering TS with master...
20:04:24.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.218660 32494 heartbeater.cc:344] Connected to a master server at 127.31.45.124:40383
20:04:24.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.218878 32498 heartbeater.cc:507] Master 127.31.45.126:46515 requested a full tablet report, sending...
20:04:24.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.218990 32494 heartbeater.cc:461] Registering TS with master...
20:04:24.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.218880 32495 heartbeater.cc:507] Master 127.31.45.125:45739 requested a full tablet report, sending...
20:04:24.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.219977 32494 heartbeater.cc:507] Master 127.31.45.124:40383 requested a full tablet report, sending...
20:04:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.222040 32045 ts_manager.cc:194] Registered new tserver with Master: 63640de53d4f4251889063107089c05d (127.31.45.66:42583)
20:04:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.222113 32125 ts_manager.cc:194] Registered new tserver with Master: 63640de53d4f4251889063107089c05d (127.31.45.66:42583)
20:04:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.222580 31970 ts_manager.cc:194] Registered new tserver with Master: 63640de53d4f4251889063107089c05d (127.31.45.66:42583)
20:04:24.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.223793 32125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.45.66:47975
20:04:24.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.506150 32501 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:24.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.506711 32501 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:24.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.507385 32501 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:24.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.541404 32501 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:24.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.542383 32501 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.45.67
20:04:24.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.580164 32501 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:24.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:24.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:24.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:24.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.67:0
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data/info.pb
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.67
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:24.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.67
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/logs
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.581947 32501 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:24.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.583877 32501 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:24.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.596235 32511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:25.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.227023 32494 heartbeater.cc:499] Master 127.31.45.124:40383 was elected leader, sending a full tablet report...
20:04:25.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.596765 32512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:25.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.891165 32501 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.295s	user 0.430s	sys 0.848s
20:04:25.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.891563 32501 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.295s	user 0.431s	sys 0.849s
20:04:25.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.892805 32513 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1288 milliseconds
20:04:25.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.893419 32514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:25.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.893711 32501 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:25.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.895381 32501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:25.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.898298 32501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:25.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.899792 32501 hybrid_clock.cc:648] HybridClock initialized: now 1779134665899647 us; error 137 us; skew 500 ppm
20:04:25.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.901018 32501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:25.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.909996 32501 webserver.cc:533] Webserver started at http://127.31.45.67:36415/ using document root <none> and password file <none>
20:04:25.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.911427 32501 fs_manager.cc:362] Metadata directory not provided
20:04:25.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.911757 32501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:25.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.912381 32501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:25.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.919821 32501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data/instance:
20:04:25.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10282f6265e14e00b2a43309e01fc951"
20:04:25.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:25 on dist-test-slave-8tr7"
20:04:25.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.921386 32501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal/instance:
20:04:25.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10282f6265e14e00b2a43309e01fc951"
20:04:25.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:25 on dist-test-slave-8tr7"
20:04:25.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.931926 32501 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.004s	sys 0.004s
20:04:25.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.940097 32521 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:25.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.941412 32501 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
20:04:25.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.941800 32501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal
20:04:25.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10282f6265e14e00b2a43309e01fc951"
20:04:25.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:25 on dist-test-slave-8tr7"
20:04:25.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.942245 32501 fs_report.cc:389] FS layout report
20:04:25.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:25.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data/data
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.025645 32501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.027431 32501 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:26.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.027938 32501 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:26.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.031337 32501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:26.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.035571 32501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:26.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.035799 32501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:26.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.036147 32501 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:26.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.036350 32501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:26.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.186996 32501 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.67:38577
20:04:26.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.187096 32633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.67:38577 every 8 connection(s)
20:04:26.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.189769 32501 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/data/info.pb
20:04:26.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.201416 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 32501
20:04:26.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.202028 31925 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/ts-2/wal/instance
20:04:26.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.245118 32634 heartbeater.cc:344] Connected to a master server at 127.31.45.124:40383
20:04:26.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.245630 32634 heartbeater.cc:461] Registering TS with master...
20:04:26.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.246950 32634 heartbeater.cc:507] Master 127.31.45.124:40383 requested a full tablet report, sending...
20:04:26.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.249326 32635 heartbeater.cc:344] Connected to a master server at 127.31.45.125:45739
20:04:26.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.249679 32635 heartbeater.cc:461] Registering TS with master...
20:04:26.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.250133 32125 ts_manager.cc:194] Registered new tserver with Master: 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:26.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.250583 32635 heartbeater.cc:507] Master 127.31.45.125:45739 requested a full tablet report, sending...
20:04:26.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.250859 32636 heartbeater.cc:344] Connected to a master server at 127.31.45.126:46515
20:04:26.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.251191 32636 heartbeater.cc:461] Registering TS with master...
20:04:26.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.251883 32125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.45.67:33331
20:04:26.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.251930 32636 heartbeater.cc:507] Master 127.31.45.126:46515 requested a full tablet report, sending...
20:04:26.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.253270 32045 ts_manager.cc:194] Registered new tserver with Master: 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:26.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.254407 31970 ts_manager.cc:194] Registered new tserver with Master: 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:26.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.270577 31925 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
20:04:26.281 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:26.281 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:04:26.284 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.45.126"
      port: 46515
    }
    bound_http_address {
      host: "127.31.45.126"
      port: 33511
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.45.125"
      port: 45739
    }
    bound_http_address {
      host: "127.31.45.125"
      port: 37215
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.45.124"
      port: 40383
    }
    bound_http_address {
      host: "127.31.45.124"
      port: 36685
    }
  }
}

20:04:26.284 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:04:26.285 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.45.65"
      port: 43567
    }
    bound_http_address {
      host: "127.31.45.65"
      port: 40811
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.45.66"
      port: 42583
    }
    bound_http_address {
      host: "127.31.45.66"
      port: 41169
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.45.67"
      port: 38577
    }
    bound_http_address {
      host: "127.31.45.67"
      port: 36415
    }
  }
}

20:04:26.285 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:04:26.287 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:26.289 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.31.45.126:46515(127.31.45.126:46515)] connecting to peer
20:04:26.291 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.31.45.125:45739(127.31.45.125:45739)] connecting to peer
20:04:26.292 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.31.45.124:40383(127.31.45.124:40383)] connecting to peer
20:04:26.292 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.45.126:46515(127.31.45.126:46515)] Successfully connected to peer
20:04:26.293 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.45.125:45739(127.31.45.125:45739)] Successfully connected to peer
20:04:26.296 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.45.124:40383(127.31.45.124:40383)] Successfully connected to peer
20:04:26.298 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.45.126
20:04:26.299 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.45.125
20:04:26.300 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.45.124
20:04:26.321 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1537bc3a, L:/127.0.0.1:60374 - R:/127.31.45.125:45739] using SASL/PLAIN
20:04:26.327 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd84dc311, L:/127.0.0.1:58822 - R:/127.31.45.126:46515] using SASL/PLAIN
20:04:26.333 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x82a36efd, L:/127.0.0.1:51394 - R:/127.31.45.124:40383] using SASL/PLAIN
20:04:26.338 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:26.338 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=50), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [38ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: OK, [50ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, deferred=null) after lookup
20:04:26.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.340975 32125 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51394:
20:04:26.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
20:04:26.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:26.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:26.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:26.344604 32125 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:04:26.374 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 005834fc28fb49d1891af927d6ad5d93
20:04:26.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.431454 32429 tablet_service.cc:1511] Processing CreateTablet for tablet 25d73e9c67f74a51afb7a9ff7274921b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=005834fc28fb49d1891af927d6ad5d93]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:26.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.435745 32429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d73e9c67f74a51afb7a9ff7274921b. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:26.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.444404 32569 tablet_service.cc:1511] Processing CreateTablet for tablet 25d73e9c67f74a51afb7a9ff7274921b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=005834fc28fb49d1891af927d6ad5d93]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:26.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.446106 32569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d73e9c67f74a51afb7a9ff7274921b. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:26.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.445825 32289 tablet_service.cc:1511] Processing CreateTablet for tablet 25d73e9c67f74a51afb7a9ff7274921b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=005834fc28fb49d1891af927d6ad5d93]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:26.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.447711 32289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d73e9c67f74a51afb7a9ff7274921b. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:26.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.471781 32667 tablet_bootstrap.cc:492] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: Bootstrap starting.
20:04:26.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.475926 32668 tablet_bootstrap.cc:492] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: Bootstrap starting.
20:04:26.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.479825 32667 tablet_bootstrap.cc:654] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: Neither blocks nor log segments found. Creating new log.
20:04:26.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.482192 32667 log.cc:826] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: Log is configured to *not* fsync() on all Append() calls
20:04:26.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.483359 32668 tablet_bootstrap.cc:654] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: Neither blocks nor log segments found. Creating new log.
20:04:26.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.483525 32669 tablet_bootstrap.cc:492] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Bootstrap starting.
20:04:26.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.485862 32668 log.cc:826] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: Log is configured to *not* fsync() on all Append() calls
20:04:26.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.487977 32667 tablet_bootstrap.cc:492] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: No bootstrap required, opened a new log
20:04:26.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.488487 32667 ts_tablet_manager.cc:1403] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
20:04:26.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.490868 32669 tablet_bootstrap.cc:654] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Neither blocks nor log segments found. Creating new log.
20:04:26.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.492575 32668 tablet_bootstrap.cc:492] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: No bootstrap required, opened a new log
20:04:26.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.493206 32668 ts_tablet_manager.cc:1403] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
20:04:26.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.493194 32669 log.cc:826] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Log is configured to *not* fsync() on all Append() calls
20:04:26.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.502584 32669 tablet_bootstrap.cc:492] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: No bootstrap required, opened a new log
20:04:26.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.503348 32669 ts_tablet_manager.cc:1403] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
20:04:26.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.514258 32668 raft_consensus.cc:359] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.514991 32668 raft_consensus.cc:385] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:26.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.515282 32668 raft_consensus.cc:740] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63640de53d4f4251889063107089c05d, State: Initialized, Role: FOLLOWER
20:04:26.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.516515 32668 consensus_queue.cc:260] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.519837 32667 raft_consensus.cc:359] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.520547 32668 ts_tablet_manager.cc:1434] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: Time spent starting tablet: real 0.027s	user 0.014s	sys 0.012s
20:04:26.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.520717 32667 raft_consensus.cc:385] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:26.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.521106 32667 raft_consensus.cc:740] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7a663594600424d89bdc7f3e2b2b491, State: Initialized, Role: FOLLOWER
20:04:26.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.522109 32667 consensus_queue.cc:260] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.540475 32667 ts_tablet_manager.cc:1434] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: Time spent starting tablet: real 0.052s	user 0.030s	sys 0.013s
20:04:26.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.541297 32669 raft_consensus.cc:359] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.542405 32669 raft_consensus.cc:385] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:26.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.542889 32669 raft_consensus.cc:740] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10282f6265e14e00b2a43309e01fc951, State: Initialized, Role: FOLLOWER
20:04:26.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.543815 32669 consensus_queue.cc:260] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.547045 32634 heartbeater.cc:499] Master 127.31.45.124:40383 was elected leader, sending a full tablet report...
20:04:26.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.547823 32669 ts_tablet_manager.cc:1434] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Time spent starting tablet: real 0.044s	user 0.020s	sys 0.014s
20:04:26.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.648665 32674 raft_consensus.cc:493] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:26.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.649199 32674 raft_consensus.cc:515] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.651846 32674 leader_election.cc:290] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63640de53d4f4251889063107089c05d (127.31.45.66:42583), 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:26.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.663033 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "b7a663594600424d89bdc7f3e2b2b491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10282f6265e14e00b2a43309e01fc951" is_pre_election: true
20:04:26.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.663048 32449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "b7a663594600424d89bdc7f3e2b2b491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63640de53d4f4251889063107089c05d" is_pre_election: true
20:04:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.663728 32449 raft_consensus.cc:2468] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7a663594600424d89bdc7f3e2b2b491 in term 0.
20:04:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.663802 32589 raft_consensus.cc:2468] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7a663594600424d89bdc7f3e2b2b491 in term 0.
20:04:26.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.664853 32244 leader_election.cc:304] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63640de53d4f4251889063107089c05d, b7a663594600424d89bdc7f3e2b2b491; no voters: 
20:04:26.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.665625 32674 raft_consensus.cc:2804] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:26.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.665942 32674 raft_consensus.cc:493] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:26.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.666257 32674 raft_consensus.cc:3060] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 0 FOLLOWER]: Advancing to term 1
20:04:26.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.671147 32674 raft_consensus.cc:515] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.672619 32674 leader_election.cc:290] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [CANDIDATE]: Term 1 election: Requested vote from peers 63640de53d4f4251889063107089c05d (127.31.45.66:42583), 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:26.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.673669 32449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "b7a663594600424d89bdc7f3e2b2b491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63640de53d4f4251889063107089c05d"
20:04:26.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.673671 32589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "b7a663594600424d89bdc7f3e2b2b491" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10282f6265e14e00b2a43309e01fc951"
20:04:26.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.674142 32449 raft_consensus.cc:3060] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 0 FOLLOWER]: Advancing to term 1
20:04:26.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.674211 32589 raft_consensus.cc:3060] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 0 FOLLOWER]: Advancing to term 1
20:04:26.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.678695 32449 raft_consensus.cc:2468] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a663594600424d89bdc7f3e2b2b491 in term 1.
20:04:26.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.678766 32589 raft_consensus.cc:2468] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7a663594600424d89bdc7f3e2b2b491 in term 1.
20:04:26.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.679513 32244 leader_election.cc:304] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63640de53d4f4251889063107089c05d, b7a663594600424d89bdc7f3e2b2b491; no voters: 
20:04:26.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.680181 32674 raft_consensus.cc:2804] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 1 FOLLOWER]: Leader election won for term 1
20:04:26.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.681680 32674 raft_consensus.cc:697] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [term 1 LEADER]: Becoming Leader. State: Replica: b7a663594600424d89bdc7f3e2b2b491, State: Running, Role: LEADER
20:04:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.682610 32674 consensus_queue.cc:237] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:26.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:26.690156 32363 tablet.cc:2404] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.691680 32124 catalog_manager.cc:5696] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65). New cstate: current_term: 1 leader_uuid: "b7a663594600424d89bdc7f3e2b2b491" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } health_report { overall_health: UNKNOWN } } }
20:04:26.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:26.698640 32502 tablet.cc:2404] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:26.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:26.705049 32639 tablet.cc:2404] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:26.937 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 005834fc28fb49d1891af927d6ad5d93
20:04:26.942 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:26.942 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:26.942 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [4ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: OK, deferred=null) after lookup
20:04:26.943 [DEBUG - kudu-nio-2] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:26.944 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] Successfully connected to peer
20:04:26.968 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x68995a12, L:/127.0.0.1:51430 - R:/127.31.45.65:43567] using TOKEN/null
20:04:26.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.998580 32449 raft_consensus.cc:1275] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Refusing update from remote peer b7a663594600424d89bdc7f3e2b2b491: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:26.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.998574 32589 raft_consensus.cc:1275] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Refusing update from remote peer b7a663594600424d89bdc7f3e2b2b491: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.000437 32678 consensus_queue.cc:1048] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:04:27.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.001502 32674 consensus_queue.cc:1048] T 25d73e9c67f74a51afb7a9ff7274921b P b7a663594600424d89bdc7f3e2b2b491 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:27.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.041471 32684 mvcc.cc:204] Tried to move back new op lower bound from 7287335595987623936 to 7287335594739625984. Current Snapshot: MvccSnapshot[applied={T|T < 7287335595987623936}]
20:04:27.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.037638 32683 mvcc.cc:204] Tried to move back new op lower bound from 7287335595987623936 to 7287335594739625984. Current Snapshot: MvccSnapshot[applied={T|T < 7287335595987623936}]
20:04:27.272 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=25d73e9c67f74a51afb7a9ff7274921b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:27.273 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.31.45.124:40383
20:04:27.273 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:04:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.274147 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 32082
20:04:27.309 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.45.124:40383(127.31.45.124:40383)] handling channelInactive
20:04:27.309 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.45.124:40383(127.31.45.124:40383)] cleaning up while in state READY due to: connection closed
20:04:27.311 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:27.311 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.31.45.124:40383
20:04:27.314 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:04:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.316377 31925 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu
20:04:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/logs
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/info.pb
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.124:40383
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.124
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36685
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json with env {}
20:04:27.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.653540 32693 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:27.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.654374 32693 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:27.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.655052 32693 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.690294 32693 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.690654 32693 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:27.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.690991 32693 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:27.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.691325 32693 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:27.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.691656 32693 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:27.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.691907 32693 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33679/jwks.json
20:04:27.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.732348 32693 master_runner.cc:387] Master server non-default flags:
20:04:27.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.84:36697
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.126:46515,127.31.45.125:45739,127.31.45.124:40383
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.124:40383
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33679/jwks.json
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/info.pb
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.124
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36685
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:27.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/logs
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:27.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:27.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:27.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.734148 32693 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:27.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.736060 32693 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:27.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.749225 32699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:28.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.111677 32634 heartbeater.cc:646] Failed to heartbeat to 127.31.45.124:40383 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:28.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.122635 32354 heartbeater.cc:646] Failed to heartbeat to 127.31.45.124:40383 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:28.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.144027 32494 heartbeater.cc:646] Failed to heartbeat to 127.31.45.124:40383 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:28.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.609923 32709 raft_consensus.cc:493] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f60ef483fa024f40a6d304440cbaa346)
20:04:28.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.610931 32709 raft_consensus.cc:515] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:28.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.614516 32054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ce07b81c56d4457ba6b0f730711d5c47" is_pre_election: true
20:04:28.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.630257 32709 leader_election.cc:290] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce07b81c56d4457ba6b0f730711d5c47 (127.31.45.125:45739), f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383)
20:04:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.635401 31954 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111) [suppressed 13 similar messages]
20:04:28.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.649760 31954 leader_election.cc:336] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383): Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:28.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.650480 31954 leader_election.cc:304] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b47645b60bdd4b81aaa13fa3e1b832f6; no voters: ce07b81c56d4457ba6b0f730711d5c47, f60ef483fa024f40a6d304440cbaa346
20:04:28.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.651405 32709 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:04:28.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.687938 32712 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f60ef483fa024f40a6d304440cbaa346)
20:04:28.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.689198 32712 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:28.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.694401 31978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce07b81c56d4457ba6b0f730711d5c47" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" is_pre_election: true
20:04:28.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.695027 31978 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce07b81c56d4457ba6b0f730711d5c47 in term 1.
20:04:28.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.696569 32029 leader_election.cc:304] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b47645b60bdd4b81aaa13fa3e1b832f6, ce07b81c56d4457ba6b0f730711d5c47; no voters: 
20:04:28.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.723101 32713 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:28.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.738390 32713 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f60ef483fa024f40a6d304440cbaa346)
20:04:28.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.742353 32713 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 1 FOLLOWER]: Advancing to term 2
20:04:28.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.696542 32712 leader_election.cc:290] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b47645b60bdd4b81aaa13fa3e1b832f6 (127.31.45.126:46515), f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383)
20:04:28.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.747661 32029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:04:28.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.760848 32029 leader_election.cc:336] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383): Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:28.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.781594 32713 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:28.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.792586 31978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce07b81c56d4457ba6b0f730711d5c47" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6"
20:04:28.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.793146 31978 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 1 FOLLOWER]: Advancing to term 2
20:04:28.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.799831 32029 leader_election.cc:336] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383): Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111)
20:04:28.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.800326 31978 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce07b81c56d4457ba6b0f730711d5c47 in term 2.
20:04:28.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.797946 32713 leader_election.cc:290] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [CANDIDATE]: Term 2 election: Requested vote from peers b47645b60bdd4b81aaa13fa3e1b832f6 (127.31.45.126:46515), f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383)
20:04:28.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.801342 32029 leader_election.cc:304] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b47645b60bdd4b81aaa13fa3e1b832f6, ce07b81c56d4457ba6b0f730711d5c47; no voters: f60ef483fa024f40a6d304440cbaa346
20:04:28.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.805866 32712 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 2 FOLLOWER]: Leader election won for term 2
20:04:28.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.835310 32712 raft_consensus.cc:697] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [term 2 LEADER]: Becoming Leader. State: Replica: ce07b81c56d4457ba6b0f730711d5c47, State: Running, Role: LEADER
20:04:28.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.836660 32712 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:28.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.879575 32716 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce07b81c56d4457ba6b0f730711d5c47. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:28.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.881435 32716 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: This master's current role is: LEADER
20:04:28.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.889912 32718 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:28.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.909101 32718 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=005834fc28fb49d1891af927d6ad5d93]
20:04:28.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.932191 32718 tablet_loader.cc:96] loaded metadata for tablet 25d73e9c67f74a51afb7a9ff7274921b (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=005834fc28fb49d1891af927d6ad5d93])
20:04:28.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.935766 32718 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:28.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.941190 32718 catalog_manager.cc:1294] Loaded cluster ID: 5fdf3bce6b634b5aa4ff8e6a384f4957
20:04:28.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.945575 32718 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:28.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.952970 32718 catalog_manager.cc:1539] Loading token signing keys...
20:04:28.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.961339 32718 catalog_manager.cc:6080] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: Loaded TSK: 0
20:04:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.967634 32718 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:29.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.281294 32029 consensus_peers.cc:597] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 -> Peer f60ef483fa024f40a6d304440cbaa346 (127.31.45.124:40383): Couldn't send request to peer f60ef483fa024f40a6d304440cbaa346. Status: Network error: Client connection negotiation failed: client connection to 127.31.45.124:40383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:04:29.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.304229 31978 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [term 2 FOLLOWER]: Refusing update from remote peer ce07b81c56d4457ba6b0f730711d5c47: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
20:04:29.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.306177 32716 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
20:04:29.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.318329 32722 sys_catalog.cc:455] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce07b81c56d4457ba6b0f730711d5c47. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:29.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.319588 32722 sys_catalog.cc:458] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: This master's current role is: FOLLOWER
20:04:29.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.331278 32722 sys_catalog.cc:455] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:29.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.332257 32722 sys_catalog.cc:458] T 00000000000000000000000000000000 P b47645b60bdd4b81aaa13fa3e1b832f6 [sys.catalog]: This master's current role is: FOLLOWER
20:04:29.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.337534 32713 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:29.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.338325 32713 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: This master's current role is: LEADER
20:04:29.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.750852 32700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:29.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.157325 32698 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 32693
20:04:29.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.731789 32693 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.982s	user 0.661s	sys 0.862s
20:04:29.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.733515 32693 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.983s	user 0.662s	sys 0.863s
20:04:29.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.735061 32702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:29.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.737447 32701 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1982 milliseconds
20:04:29.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.737452 32693 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:29.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.738802 32693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:29.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.741102 32693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:29.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.742420 32693 hybrid_clock.cc:648] HybridClock initialized: now 1779134669742365 us; error 59 us; skew 500 ppm
20:04:29.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.743140 32693 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:29.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.754472 32693 webserver.cc:533] Webserver started at http://127.31.45.124:36685/ using document root <none> and password file <none>
20:04:29.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.755332 32693 fs_manager.cc:362] Metadata directory not provided
20:04:29.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.755537 32693 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:29.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.763341 32693 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.004s	sys 0.000s
20:04:29.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.768038 32731 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:29.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.769222 32693 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
20:04:29.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.769544 32693 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data,/tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:29.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f60ef483fa024f40a6d304440cbaa346"
20:04:29.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-8tr7"
20:04:29.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.771430 32693 fs_report.cc:389] FS layout report
20:04:29.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/wal
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/data
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:29.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:29.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.833915 32693 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:29.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.835784 32693 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:29.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.836300 32693 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:29.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.932487 32693 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.124:40383
20:04:29.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.932567   316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.124:40383 every 8 connection(s)
20:04:29.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.937207 32693 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskQ0pVph/test-tmp/mini-kudu-cluster1210023656951928689/master-2/data/info.pb
20:04:29.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.944619 31925 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu as pid 32693
20:04:29.945 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:29.946 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.31.45.65:43567
20:04:29.946 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

20:04:29.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.947268 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 32223
20:04:29.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.951932   317 sys_catalog.cc:263] Verifying existing consensus state
20:04:29.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.959472   317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Bootstrap starting.
20:04:29.999 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] handling channelInactive
20:04:29.999 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state READY due to: connection closed
20:04:30.000 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:30.001 [DEBUG - Time-limited test] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:30.005 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.005 [DEBUG - kudu-nio-4] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.006 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.009 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.31.45.124:40383(127.31.45.124:40383)] connecting to peer
20:04:30.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.011623   317 log.cc:826] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Log is configured to *not* fsync() on all Append() calls
20:04:30.012 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.31.45.124:40383(127.31.45.124:40383)] Successfully connected to peer
20:04:30.026 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.45.124
20:04:30.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.046514   317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
20:04:30.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.047925   317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: Bootstrap complete.
20:04:30.051 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xf6341ac9, L:/127.0.0.1:51506 - R:/127.31.45.124:40383] using SASL/PLAIN
20:04:30.055 [DEBUG - kudu-nio-5] (RemoteTablet.java:166) master-127.31.45.124:40383 was demoted as the leader for Kudu Master
20:04:30.077 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:30.078 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.45.124:40383: Catalog manager is not initialized. State: Starting
20:04:30.079 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29992, elapsed=69), Traces: [0ms] sending RPC to server master-127.31.45.124:40383, [46ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [46ms] received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [69ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), deferred=Deferred@126536603(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
20:04:30.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.077111   317 raft_consensus.cc:359] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:30.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.080487   317 raft_consensus.cc:740] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f60ef483fa024f40a6d304440cbaa346, State: Initialized, Role: FOLLOWER
20:04:30.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.081456   317 consensus_queue.cc:260] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } }
20:04:30.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.082692 32635 heartbeater.cc:499] Master 127.31.45.125:45739 was elected leader, sending a full tablet report...
20:04:30.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.087141   323 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:30.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.088126   323 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: FOLLOWER
20:04:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.088927   317 sys_catalog.cc:565] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: configured and running, proceeding with master startup.
20:04:30.091 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:30.091 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:30.092 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=90), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test)) after lookup
20:04:30.094 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:30.098 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.099 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.115 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:30.115 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:30.116 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=115), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352))) after lookup
20:04:30.117 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:30.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.120 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.130995   335 catalog_manager.cc:1294] Loaded cluster ID: 5fdf3bce6b634b5aa4ff8e6a384f4957
20:04:30.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.131019 32495 heartbeater.cc:499] Master 127.31.45.125:45739 was elected leader, sending a full tablet report...
20:04:30.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.131659   335 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: loading cluster ID for follower catalog manager: success
20:04:30.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.142715   335 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: acquiring CA information for follower catalog manager: success
20:04:30.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.150430   335 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:30.174 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:30.175 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:30.177 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=174), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [115ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [119ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [119ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [168ms] refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [173ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073))) after lookup
20:04:30.179 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:30.183 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.183 [DEBUG - kudu-nio-0] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.183 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.201220 32634 heartbeater.cc:344] Connected to a master server at 127.31.45.124:40383
20:04:30.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.209337 32750 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "10282f6265e14e00b2a43309e01fc951" instance_seqno: 1779134666145695) as {username='slave'} at 127.31.45.67:37699; Asking this server to re-register.
20:04:30.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.211052 32634 heartbeater.cc:461] Registering TS with master...
20:04:30.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.214398 32750 ts_manager.cc:194] Registered new tserver with Master: 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:30.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.225387 32494 heartbeater.cc:344] Connected to a master server at 127.31.45.124:40383
20:04:30.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.227972 32750 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "63640de53d4f4251889063107089c05d" instance_seqno: 1779134664113312) as {username='slave'} at 127.31.45.66:51189; Asking this server to re-register.
20:04:30.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.229154 32494 heartbeater.cc:461] Registering TS with master...
20:04:30.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.231642 32750 ts_manager.cc:194] Registered new tserver with Master: 63640de53d4f4251889063107089c05d (127.31.45.66:42583)
20:04:30.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.249082 32760 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [term 1 FOLLOWER]: Advancing to term 2
20:04:30.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.266423   346 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:30.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.267876   346 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: FOLLOWER
20:04:30.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.271205   323 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce07b81c56d4457ba6b0f730711d5c47. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:30.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.271740   323 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60ef483fa024f40a6d304440cbaa346 [sys.catalog]: This master's current role is: FOLLOWER
20:04:30.274 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:30.274 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:30.275 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=274), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [115ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [119ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [119ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [168ms] refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [173ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [178ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [182ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [182ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [268ms] refreshing cache from master, [268ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [272ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096))) after lookup
20:04:30.276 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:30.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.277 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.688185 32716 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ce07b81c56d4457ba6b0f730711d5c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b47645b60bdd4b81aaa13fa3e1b832f6" member_type: VOTER last_known_addr { host: "127.31.45.126" port: 46515 } } peers { permanent_uuid: "ce07b81c56d4457ba6b0f730711d5c47" member_type: VOTER last_known_addr { host: "127.31.45.125" port: 45739 } } peers { permanent_uuid: "f60ef483fa024f40a6d304440cbaa346" member_type: VOTER last_known_addr { host: "127.31.45.124" port: 40383 } } }
20:04:30.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.689616 32716 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47 [sys.catalog]: This master's current role is: LEADER
20:04:30.753 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:30.753 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:30.754 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=753), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [115ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [119ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [119ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [168ms] refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [173ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [178ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [182ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [182ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [268ms] refreshing cache from master, [268ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [272ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [274ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [276ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [276ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [748ms] refreshing cache from master, [748ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [752ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346))) after lookup
20:04:30.755 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:30.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.756 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:30.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.961614   350 raft_consensus.cc:493] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7a663594600424d89bdc7f3e2b2b491)
20:04:30.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.962652   350 raft_consensus.cc:515] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:30.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:30.965780   350 leader_election.cc:290] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567), 10282f6265e14e00b2a43309e01fc951 (127.31.45.67:38577)
20:04:30.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:30.985046 32384 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111)
20:04:30.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:30.999385 32384 leader_election.cc:336] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567): Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111)
20:04:31.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.001677 32588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "63640de53d4f4251889063107089c05d" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "10282f6265e14e00b2a43309e01fc951" is_pre_election: true
20:04:31.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.003271 32382 leader_election.cc:304] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63640de53d4f4251889063107089c05d; no voters: 10282f6265e14e00b2a43309e01fc951, b7a663594600424d89bdc7f3e2b2b491
20:04:31.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.003968   350 raft_consensus.cc:2749] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:04:31.034 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:31.034 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:31.035 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1034), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [115ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [119ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [119ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [168ms] refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [173ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [178ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [182ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [182ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [268ms] refreshing cache from master, [268ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [272ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [274ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [276ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [276ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [748ms] refreshing cache from master, [748ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [752ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [753ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [755ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [755ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1028ms] refreshing cache from master, [1028ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [1033ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346) -> (continuation of Deferred@802983790 after retry RPC@466002776), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346) -> (continuation of Deferred@802983790 after retry RPC@466002776))) after lookup
20:04:31.036 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:31.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:31.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:31.037 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:31.073 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:31.074 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577),63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)[L]]}]
20:04:31.074 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=14, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1073), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [115ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [119ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [119ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [168ms] refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [173ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [178ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [182ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [182ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [268ms] refreshing cache from master, [268ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [272ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [274ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [276ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [276ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [748ms] refreshing cache from master, [748ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [752ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [753ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [755ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [755ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1028ms] refreshing cache from master, [1028ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [1033ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [1034ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [1036ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1036ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1068ms] refreshing cache from master, [1068ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [1072ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346) -> (continuation of Deferred@802983790 after retry RPC@466002776) -> (continuation of Deferred@1191054213 after retry RPC@1745665121), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346) -> (continuation of Deferred@802983790 after retry RPC@466002776) -> (continuation of Deferred@1191054213 after retry RPC@1745665121))) after lookup
20:04:31.075 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] connecting to peer
20:04:31.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:31.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] cleaning up while in state CONNECTING due to: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:31.077 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567) for tablet 25d73e9c67f74a51afb7a9ff7274921b: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567
20:04:31.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.427150   355 raft_consensus.cc:493] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7a663594600424d89bdc7f3e2b2b491)
20:04:31.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.427549   355 raft_consensus.cc:515] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:31.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.429991   355 leader_election.cc:290] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63640de53d4f4251889063107089c05d (127.31.45.66:42583), b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567)
20:04:31.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:31.435958 32524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111)
20:04:31.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:31.440834 32524 leader_election.cc:336] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567): Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111)
20:04:31.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.442432 32449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "10282f6265e14e00b2a43309e01fc951" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "63640de53d4f4251889063107089c05d" is_pre_election: true
20:04:31.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.442891 32449 raft_consensus.cc:2468] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10282f6265e14e00b2a43309e01fc951 in term 1.
20:04:31.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.443790 32524 leader_election.cc:304] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10282f6265e14e00b2a43309e01fc951, 63640de53d4f4251889063107089c05d; no voters: b7a663594600424d89bdc7f3e2b2b491
20:04:31.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.444536   355 raft_consensus.cc:2804] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:31.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.444808   355 raft_consensus.cc:493] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7a663594600424d89bdc7f3e2b2b491)
20:04:31.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.445122   355 raft_consensus.cc:3060] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 1 FOLLOWER]: Advancing to term 2
20:04:31.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.449409   355 raft_consensus.cc:515] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:31.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.450994   355 leader_election.cc:290] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [CANDIDATE]: Term 2 election: Requested vote from peers 63640de53d4f4251889063107089c05d (127.31.45.66:42583), b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567)
20:04:31.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.451870 32449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d73e9c67f74a51afb7a9ff7274921b" candidate_uuid: "10282f6265e14e00b2a43309e01fc951" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "63640de53d4f4251889063107089c05d"
20:04:31.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.452431 32449 raft_consensus.cc:3060] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 1 FOLLOWER]: Advancing to term 2
20:04:31.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:31.454872 32524 leader_election.cc:336] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567): Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111)
20:04:31.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.457196 32449 raft_consensus.cc:2468] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10282f6265e14e00b2a43309e01fc951 in term 2.
20:04:31.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.458127 32524 leader_election.cc:304] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10282f6265e14e00b2a43309e01fc951, 63640de53d4f4251889063107089c05d; no voters: b7a663594600424d89bdc7f3e2b2b491
20:04:31.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.458861   355 raft_consensus.cc:2804] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 2 FOLLOWER]: Leader election won for term 2
20:04:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.460490   355 raft_consensus.cc:697] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 2 LEADER]: Becoming Leader. State: Replica: 10282f6265e14e00b2a43309e01fc951, State: Running, Role: LEADER
20:04:31.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.461278   355 consensus_queue.cc:237] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } }
20:04:31.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.470860 32045 catalog_manager.cc:5696] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 reported cstate change: term changed from 1 to 2, leader changed from b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65) to 10282f6265e14e00b2a43309e01fc951 (127.31.45.67). New cstate: current_term: 2 leader_uuid: "10282f6265e14e00b2a43309e01fc951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7a663594600424d89bdc7f3e2b2b491" member_type: VOTER last_known_addr { host: "127.31.45.65" port: 43567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10282f6265e14e00b2a43309e01fc951" member_type: VOTER last_known_addr { host: "127.31.45.67" port: 38577 } health_report { overall_health: HEALTHY } } }
20:04:31.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.927356 32449 raft_consensus.cc:1275] T 25d73e9c67f74a51afb7a9ff7274921b P 63640de53d4f4251889063107089c05d [term 2 FOLLOWER]: Refusing update from remote peer 10282f6265e14e00b2a43309e01fc951: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
20:04:31.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:31.929106   355 consensus_queue.cc:1048] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63640de53d4f4251889063107089c05d" member_type: VOTER last_known_addr { host: "127.31.45.66" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
20:04:32.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.028968 32524 consensus_peers.cc:597] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 -> Peer b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567): Couldn't send request to peer b7a663594600424d89bdc7f3e2b2b491. Status: Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:04:33.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:33.290794 32490 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8cc0 after lost signal to thread 32366
20:04:33.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:33.291685 32490 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc7c0 after lost signal to thread 32493
20:04:33.394 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 25d73e9c67f74a51afb7a9ff7274921b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:04:33.394 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=25d73e9c67f74a51afb7a9ff7274921b@[10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577)[L],63640de53d4f4251889063107089c05d(127.31.45.66:42583),b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)]}]
20:04:33.395 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=25d73e9c67f74a51afb7a9ff7274921b, attempt=16, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=3394), Traces: [0ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [5ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [5ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [8ms] refreshing cache from master, [8ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.124:40383, [54ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [54ms] Sub RPC GetTableLocations: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.126:46515, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.125:45739, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.124:40383, [73ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.126:46515: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.125:45739: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.124:40383: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [92ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [97ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [98ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [108ms] refreshing cache from master, [108ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [113ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [115ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [119ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [119ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [168ms] refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [173ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [178ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [182ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [182ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [268ms] refreshing cache from master, [268ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [272ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [274ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [276ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [276ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [748ms] refreshing cache from master, [748ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [752ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [753ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [755ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [755ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1028ms] refreshing cache from master, [1028ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [1033ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [1034ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [1036ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1036ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1068ms] refreshing cache from master, [1068ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [1072ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, [1074ms] sending RPC to server b7a663594600424d89bdc7f3e2b2b491, [1076ms] received response from server b7a663594600424d89bdc7f3e2b2b491: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [1076ms] delaying RPC due to: Network error: Failed to connect to peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567): Connection refused: /127.31.45.65:43567, [3388ms] refreshing cache from master, [3388ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.125:45739, [3393ms] Sub RPC GetTableLocations: received response from server master-127.31.45.125:45739: OK, deferred=Deferred@919022035(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fc430332948@3622e798 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346) -> (continuation of Deferred@802983790 after retry RPC@466002776) -> (continuation of Deferred@1191054213 after retry RPC@1745665121) -> (continuation of Deferred@155248991 after retry RPC@77767586), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@67a534d4 -> wakeup thread Time-limited test -> (continuation of Deferred@126536603 after retry RPC@1676390352) -> (continuation of Deferred@2137730556 after retry RPC@1404036073) -> (continuation of Deferred@2006200856 after retry RPC@1527261096) -> (continuation of Deferred@1156821513 after retry RPC@378816346) -> (continuation of Deferred@802983790 after retry RPC@466002776) -> (continuation of Deferred@1191054213 after retry RPC@1745665121) -> (continuation of Deferred@155248991 after retry RPC@77767586))) after lookup
20:04:33.397 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577)] connecting to peer
20:04:33.398 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577)] Successfully connected to peer
20:04:33.423 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x8aab0752, L:/127.0.0.1:33840 - R:/127.31.45.67:38577] using TOKEN/null
20:04:33.599 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=25d73e9c67f74a51afb7a9ff7274921b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:33.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.602339 32045 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60374:
20:04:33.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
20:04:33.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.603044 32045 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60374:
20:04:33.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
20:04:33.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.665547 32045 catalog_manager.cc:5983] T 00000000000000000000000000000000 P ce07b81c56d4457ba6b0f730711d5c47: Sending DeleteTablet for 3 replicas of tablet 25d73e9c67f74a51afb7a9ff7274921b
20:04:33.687 [DEBUG - main] (Connection.java:575) [peer master-127.31.45.124:40383(127.31.45.124:40383)] disconnecting while in state READY
20:04:33.687 [DEBUG - main] (Connection.java:575) [peer master-127.31.45.125:45739(127.31.45.125:45739)] disconnecting while in state READY
20:04:33.688 [DEBUG - main] (Connection.java:575) [peer 10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577)] disconnecting while in state READY
20:04:33.688 [DEBUG - main] (Connection.java:575) [peer master-127.31.45.126:46515(127.31.45.126:46515)] disconnecting while in state READY
20:04:33.688 [DEBUG - main] (Connection.java:575) [peer b7a663594600424d89bdc7f3e2b2b491(127.31.45.65:43567)] disconnecting while in state TERMINATED
20:04:33.689 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.31.45.124:40383(127.31.45.124:40383)] handling channelInactive
20:04:33.689 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.45.124:40383(127.31.45.124:40383)] cleaning up while in state READY due to: connection closed
20:04:33.690 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577)] handling channelInactive
20:04:33.690 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 10282f6265e14e00b2a43309e01fc951(127.31.45.67:38577)] cleaning up while in state READY due to: connection closed
20:04:33.691 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.45.126:46515(127.31.45.126:46515)] handling channelInactive
20:04:33.692 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.45.126:46515(127.31.45.126:46515)] cleaning up while in state READY due to: connection closed
20:04:33.696 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:33.698 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.45.125:45739(127.31.45.125:45739)] handling channelInactive
20:04:33.698 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.45.125:45739(127.31.45.125:45739)] cleaning up while in state READY due to: connection closed
20:04:33.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.698966 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 32361
20:04:33.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.704972 32569 tablet_service.cc:1558] Processing DeleteTablet for tablet 25d73e9c67f74a51afb7a9ff7274921b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 20:04:33 UTC) from {username='slave'} at 127.0.0.1:33848
20:04:33.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.720708   411 tablet_replica.cc:333] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: stopping tablet replica
20:04:33.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.721606   411 raft_consensus.cc:2243] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 2 LEADER]: Raft consensus shutting down.
20:04:33.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.723352   411 raft_consensus.cc:2272] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951 [term 2 FOLLOWER]: Raft consensus is shut down!
20:04:33.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.726884   411 ts_tablet_manager.cc:1916] T 25d73e9c67f74a51afb7a9ff7274921b P 10282f6265e14e00b2a43309e01fc951: Deleting tablet data with delete state TABLET_DATA_DELETED
20:04:33.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:33.732445 32031 catalog_manager.cc:4754] TS b7a663594600424d89bdc7f3e2b2b491 (127.31.45.65:43567): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 25d73e9c67f74a51afb7a9ff7274921b: Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111)
20:04:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:33.740145 32031 connection.cc:582] client connection to 127.31.45.66:42583 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:04:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.741190 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 32501
20:04:33.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:33.764145 32031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.65:43567: connect: Connection refused (error 111) [suppressed 5 similar messages]
20:04:33.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.775367 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 31937
20:04:33.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.801263 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 32007
20:04:33.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:33.826838 31925 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskQ0pVph/build/tsan/bin/kudu with pid 32693
20:04:34.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:34Z chronyd exiting

Time: 47.522

OK (2 tests)

