JUnit version 4.13.2
.20:03:46.319 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779134626309
20:03:46.378 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:03:46.439 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:03:46.450 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskP4R3uz/test-tmp
20:03:46.455 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:03:46.458 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskP4R3uz/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:03:46.641 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:03:46.865 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:03:46.867 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:03:46.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:46.870565  1498 mini_oidc.cc:150] Starting JWKS server
20:03:46.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:46.874014  1498 webserver.cc:533] Webserver started at http://127.0.0.1:40133/ using document root <none> and password file <none>
20:03:46.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:46.874560  1498 mini_oidc.cc:186] Starting OIDC Discovery server
20:03:46.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:46.877315  1498 webserver.cc:533] Webserver started at http://127.0.0.1:38805/ using document root <none> and password file <none>
20:03:46.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:03:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:03:46.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:03:46Z Disabled control of system clock
20:03:46.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:46.938174  1498 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:46.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:46.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal
20:03:46.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data
20:03:46.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:46.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:46.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:46.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:46.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:46.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:46.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/logs
20:03:46.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data/info.pb
20:03:46.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:46.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:46.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:46.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:46.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:46.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:46.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:46.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:46.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:46.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:46.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:46.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:46.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.190:34817
20:03:46.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.190
20:03:46.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:46.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:46.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:46.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:46.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:46.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40133/jwks.json with env {}
20:03:47.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.246547  1511 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:47.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.247274  1511 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:47.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.248093  1511 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:47.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.280640  1511 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:47.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.281023  1511 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:47.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.281338  1511 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:47.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.281677  1511 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:47.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.282012  1511 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:47.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.282281  1511 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40133/jwks.json
20:03:47.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:47.319173  1511 master_runner.cc:387] Master server non-default flags:
20:03:47.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:47.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:47.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:47.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:47.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data
20:03:47.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal
20:03:47.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:47.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:47.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:47.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:47.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:47.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.190:34817
20:03:47.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:47.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40133/jwks.json
20:03:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data/info.pb
20:03:47.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.190
20:03:47.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:47.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:47.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:47.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:47.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:47.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:47.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/logs
20:03:47.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:47.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:47.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:47.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:47.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:47.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:47.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:47.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:47.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:47.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:47.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:47.320964  1511 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:47.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:47.323242  1511 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:47.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.336820  1517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:48.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.341066  1520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:48.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:47.338214  1518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:48.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:48.642302  1519 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1300 milliseconds
20:03:48.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.642417  1511 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:48.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.644027  1511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:48.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.647205  1511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:48.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.648646  1511 hybrid_clock.cc:648] HybridClock initialized: now 1779134628648616 us; error 46 us; skew 500 ppm
20:03:48.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.649500  1511 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:48.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.656107  1511 webserver.cc:533] Webserver started at http://127.1.118.190:38493/ using document root <none> and password file <none>
20:03:48.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.657119  1511 fs_manager.cc:362] Metadata directory not provided
20:03:48.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.657305  1511 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:48.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.657675  1511 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:48.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.662145  1511 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data/instance:
20:03:48.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd"
20:03:48.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:48 on dist-test-slave-nsdw"
20:03:48.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.663252  1511 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal/instance:
20:03:48.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd"
20:03:48.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:48 on dist-test-slave-nsdw"
20:03:48.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.670418  1511 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
20:03:48.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.676534  1527 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:48.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.677783  1511 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
20:03:48.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.678086  1511 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal
20:03:48.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd"
20:03:48.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:48 on dist-test-slave-nsdw"
20:03:48.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.678364  1511 fs_report.cc:389] FS layout report
20:03:48.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:48.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal
20:03:48.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal
20:03:48.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data/data
20:03:48.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:48.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:48.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:48.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:48.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:48.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:48.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.740051  1511 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:48.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.741520  1511 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:48.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.741933  1511 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:48.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.823562  1511 rpc_server.cc:307] RPC server started. Bound to: 127.1.118.190:34817
20:03:48.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.823645  1578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.118.190:34817 every 8 connection(s)
20:03:48.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.826618  1511 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/data/info.pb
20:03:48.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.828359  1498 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 1511
20:03:48.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.828912  1498 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-0/wal/instance
20:03:48.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.834805  1579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:48.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.834667  1498 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:48.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:48.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal
20:03:48.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data
20:03:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:48.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:48.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:48.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/logs
20:03:48.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data/info.pb
20:03:48.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:48.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:48.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:48.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:48.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:48.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:48.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.189:35039
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.189
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:48.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:48.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:48.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:48.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:48.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:48.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:48.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40133/jwks.json with env {}
20:03:48.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.847909  1579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } has no permanent_uuid. Determining permanent_uuid...
20:03:48.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.874986  1579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } has no permanent_uuid. Determining permanent_uuid...
20:03:48.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:48.878064  1529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:48.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:48.882032  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:48.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:48.931567  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 1
20:03:48.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:48.935981  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:49.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.004402  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 2
20:03:49.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.008565  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:49.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.099937  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 3
20:03:49.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.104796  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:49.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.167346  1581 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:49.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.168260  1581 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:49.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.168772  1581 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:49.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.202320  1581 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:49.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.202608  1581 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:49.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.202807  1581 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:49.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.203066  1581 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:49.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.203254  1581 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:49.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.203392  1581 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40133/jwks.json
20:03:49.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.240888  1581 master_runner.cc:387] Master server non-default flags:
20:03:49.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:49.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.189:35039
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40133/jwks.json
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data/info.pb
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.189
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/logs
20:03:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:49.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:49.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:49.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:49.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:49.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:49.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:49.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.242270  1581 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:49.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.244248  1581 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.248211  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 4
20:03:49.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.253466  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:49.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.257787  1590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:49.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:49.553293  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 5
20:03:49.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.561246  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:50.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:50.108779  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 6
20:03:50.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:50.151556  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:51.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:50.661434  1589 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 1581
20:03:51.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.079573  1589 kernel_stack_watchdog.cc:198] Thread 1581 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
20:03:51.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:03:51.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:03:51.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:03:51.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:03:51.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.081053  1581 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.823s	user 0.605s	sys 1.213s
20:03:51.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.081513  1581 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.823s	user 0.606s	sys 1.213s
20:03:51.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:49.259967  1591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.082360  1592 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1820 milliseconds
20:03:51.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.083317  1593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.083274  1581 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:51.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.089262  1581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:51.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.092118  1581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.093613  1581 hybrid_clock.cc:648] HybridClock initialized: now 1779134631093546 us; error 71 us; skew 500 ppm
20:03:51.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.094460  1581 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:51.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.101244  1581 webserver.cc:533] Webserver started at http://127.1.118.189:45765/ using document root <none> and password file <none>
20:03:51.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.102269  1581 fs_manager.cc:362] Metadata directory not provided
20:03:51.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.102473  1581 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:51.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.102943  1581 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:51.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.107568  1581 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data/instance:
20:03:51.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a01a9d8291f42cbadd70e09ffc146f0"
20:03:51.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:51 on dist-test-slave-nsdw"
20:03:51.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.108853  1581 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal/instance:
20:03:51.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a01a9d8291f42cbadd70e09ffc146f0"
20:03:51.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:51 on dist-test-slave-nsdw"
20:03:51.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.117509  1581 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
20:03:51.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.123678  1602 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:51.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.124965  1581 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
20:03:51.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.125321  1581 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal
20:03:51.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a01a9d8291f42cbadd70e09ffc146f0"
20:03:51.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:51 on dist-test-slave-nsdw"
20:03:51.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.125631  1581 fs_report.cc:389] FS layout report
20:03:51.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal
20:03:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal
20:03:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data/data
20:03:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:51.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:51.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:51.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:51.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.187548  1581 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:51.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.189503  1581 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:51.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.189906  1581 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:51.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.212141  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 7
20:03:51.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.221283  1579 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.189:35039: Network error: Client connection negotiation failed: client connection to 127.1.118.189:35039: connect: Connection refused (error 111)
20:03:51.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.272639  1581 rpc_server.cc:307] RPC server started. Bound to: 127.1.118.189:35039
20:03:51.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.272723  1655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.118.189:35039 every 8 connection(s)
20:03:51.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.275250  1581 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/data/info.pb
20:03:51.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.280654  1498 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 1581
20:03:51.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.281131  1498 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-1/wal/instance
20:03:51.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.282904  1656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:51.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.284498  1498 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:51.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/logs
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data/info.pb
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:51.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:51.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:51.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:51.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:51.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:51.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.188:34999
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.188
20:03:51.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:51.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40133/jwks.json with env {}
20:03:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.297808  1656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } has no permanent_uuid. Determining permanent_uuid...
20:03:51.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.324558  1656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } has no permanent_uuid. Determining permanent_uuid...
20:03:51.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.340251  1656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } has no permanent_uuid. Determining permanent_uuid...
20:03:51.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.342417  1605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:51.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.347334  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:51.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.396890  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 1
20:03:51.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.401655  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:51.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.470099  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 2
20:03:51.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.474800  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:51.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.566274  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 3
20:03:51.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.570477  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:51.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.621129  1658 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:51.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.621834  1658 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:51.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.622541  1658 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:51.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.659238  1658 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:51.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.659608  1658 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:51.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.659960  1658 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:51.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.660313  1658 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:51.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.660713  1658 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:51.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.661010  1658 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40133/jwks.json
20:03:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.698527  1658 master_runner.cc:387] Master server non-default flags:
20:03:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.188:34999
20:03:51.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:51.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:51.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:51.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40133/jwks.json
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data/info.pb
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.188
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/logs
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.700335  1658 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.702698  1658 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:51.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:51.713845  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 4
20:03:51.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.714398  1668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:51.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.720536  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:52.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.019974  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 5
20:03:52.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:52.026485  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:52.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.574054  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 6
20:03:52.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:52.586284  1656 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.118.188:34999: Network error: Client connection negotiation failed: client connection to 127.1.118.188:34999: connect: Connection refused (error 111)
20:03:52.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.723215  1671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:52.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:51.716701  1669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:52.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:52.967341  1670 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1247 milliseconds
20:03:52.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.967447  1658 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:52.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.968724  1658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:52.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.972169  1658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:52.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.973608  1658 hybrid_clock.cc:648] HybridClock initialized: now 1779134632973558 us; error 67 us; skew 500 ppm
20:03:52.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.974370  1658 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:52.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.981383  1658 webserver.cc:533] Webserver started at http://127.1.118.188:37449/ using document root <none> and password file <none>
20:03:52.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.982270  1658 fs_manager.cc:362] Metadata directory not provided
20:03:52.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.982452  1658 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:52.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.982894  1658 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:52.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.987274  1658 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data/instance:
20:03:52.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f5b9905d793497a849e36d6d1030a61"
20:03:52.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:52 on dist-test-slave-nsdw"
20:03:52.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.988350  1658 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal/instance:
20:03:52.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f5b9905d793497a849e36d6d1030a61"
20:03:52.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:52 on dist-test-slave-nsdw"
20:03:52.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:52.995522  1658 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
20:03:53.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.001508  1680 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:53.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.002787  1658 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
20:03:53.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.003243  1658 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal
20:03:53.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f5b9905d793497a849e36d6d1030a61"
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:52 on dist-test-slave-nsdw"
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.003677  1658 fs_report.cc:389] FS layout report
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data/data
20:03:53.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:53.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:53.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:53.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.058584  1658 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:53.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.060276  1658 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.060828  1658 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:53.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.141705  1658 rpc_server.cc:307] RPC server started. Bound to: 127.1.118.188:34999
20:03:53.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.141788  1731 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.118.188:34999 every 8 connection(s)
20:03:53.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.144640  1658 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/data/info.pb
20:03:53.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.152441  1732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:53.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.154976  1498 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 1658
20:03:53.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.155301  1498 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/master-2/wal/instance
20:03:53.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.167467  1732 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.193318  1732 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.204334  1732 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.221310  1732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: Bootstrap starting.
20:03:53.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.227660  1732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: Neither blocks nor log segments found. Creating new log.
20:03:53.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.230777  1732 log.cc:826] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: Log is configured to *not* fsync() on all Append() calls
20:03:53.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.236068  1732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: No bootstrap required, opened a new log
20:03:53.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.256183  1732 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.257472  1732 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:53.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.258109  1732 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5b9905d793497a849e36d6d1030a61, State: Initialized, Role: FOLLOWER
20:03:53.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.259001  1732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.262427  1741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.263288  1741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: This master's current role is: FOLLOWER
20:03:53.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.264222  1732 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: configured and running, proceeding with master startup.
20:03:53.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.300243  1752 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:53.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.301107  1752 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:53.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.311861  1579 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } attempt: 8
20:03:53.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.316941  1686 tablet.cc:2404] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:53.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.293345  1658 master_runner.cc:187] Error getting master registration for 127.1.118.190:34817: OK, instance_id { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" instance_seqno: 1779134628802026 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:53.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.327780  1658 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:53.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.329099  1579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } has no permanent_uuid. Determining permanent_uuid...
20:03:53.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.346148  1579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: Bootstrap starting.
20:03:53.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.352027  1579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: Neither blocks nor log segments found. Creating new log.
20:03:53.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.354312  1579 log.cc:826] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: Log is configured to *not* fsync() on all Append() calls
20:03:53.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.360677  1579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: No bootstrap required, opened a new log
20:03:53.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.381199  1579 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.381832  1579 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:53.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.382019  1579 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2fc80c8a704c8e9d4810f0c7bad3fd, State: Initialized, Role: FOLLOWER
20:03:53.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.382772  1579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.386308  1756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.387130  1756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: This master's current role is: FOLLOWER
20:03:53.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.388352  1579 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: configured and running, proceeding with master startup.
20:03:53.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.429226  1767 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:53.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.430145  1767 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.427666  1511 master_runner.cc:187] Error getting master registration for 127.1.118.189:35039: OK, instance_id { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" instance_seqno: 1779134631250544 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.458580  1511 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:53.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.503801  1533 tablet.cc:2404] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:53.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.646868  1656 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } attempt: 7
20:03:53.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.669585  1656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: Bootstrap starting.
20:03:53.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.677628  1656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: Neither blocks nor log segments found. Creating new log.
20:03:53.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.682241  1656 log.cc:826] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: Log is configured to *not* fsync() on all Append() calls
20:03:53.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.684571  1756 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:53.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.685112  1756 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.688939  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f5b9905d793497a849e36d6d1030a61" is_pre_election: true
20:03:53.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.689828  1707 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2fc80c8a704c8e9d4810f0c7bad3fd in term 0.
20:03:53.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.692729  1530 leader_election.cc:304] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61, 9e2fc80c8a704c8e9d4810f0c7bad3fd; no voters: 
20:03:53.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.695689  1756 leader_election.cc:290] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a01a9d8291f42cbadd70e09ffc146f0 (127.1.118.189:35039), 2f5b9905d793497a849e36d6d1030a61 (127.1.118.188:34999)
20:03:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.696188  1756 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Leader pre-election won for term 1
20:03:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.696514  1756 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:53.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.696812  1756 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 0 FOLLOWER]: Advancing to term 1
20:03:53.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.727880  1756 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.743160  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f5b9905d793497a849e36d6d1030a61"
20:03:53.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.743757  1707 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 0 FOLLOWER]: Advancing to term 1
20:03:53.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.757133  1756 leader_election.cc:290] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [CANDIDATE]: Term 1 election: Requested vote from peers 6a01a9d8291f42cbadd70e09ffc146f0 (127.1.118.189:35039), 2f5b9905d793497a849e36d6d1030a61 (127.1.118.188:34999)
20:03:53.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.758657  1707 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2fc80c8a704c8e9d4810f0c7bad3fd in term 1.
20:03:53.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.761653  1530 leader_election.cc:304] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61, 9e2fc80c8a704c8e9d4810f0c7bad3fd; no voters: 
20:03:53.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.762778  1756 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 1 FOLLOWER]: Leader election won for term 1
20:03:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.763711  1756 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [term 1 LEADER]: Becoming Leader. State: Replica: 9e2fc80c8a704c8e9d4810f0c7bad3fd, State: Running, Role: LEADER
20:03:53.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.765419  1756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.770943  1656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: No bootstrap required, opened a new log
20:03:53.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.782688  1771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e2fc80c8a704c8e9d4810f0c7bad3fd. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.783459  1771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: This master's current role is: LEADER
20:03:53.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.794035  1773 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:03:53.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.802105  1773 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:03:53.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.828347  1707 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Refusing update from remote peer 9e2fc80c8a704c8e9d4810f0c7bad3fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:53.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.830574  1771 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:53.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.876884  1775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e2fc80c8a704c8e9d4810f0c7bad3fd. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.878185  1775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: This master's current role is: FOLLOWER
20:03:53.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.875319  1656 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.880443  1656 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:53.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.882314  1656 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a01a9d8291f42cbadd70e09ffc146f0, State: Initialized, Role: FOLLOWER
20:03:53.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.885706  1774 mvcc.cc:204] Tried to move back new op lower bound from 7287335460130234368 to 7287335459924074496. Current Snapshot: MvccSnapshot[applied={T|T < 7287335460130234368}]
20:03:53.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.889166  1776 mvcc.cc:204] Tried to move back new op lower bound from 7287335460130234368 to 7287335459924074496. Current Snapshot: MvccSnapshot[applied={T|T < 7287335460130234368}]
20:03:53.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.887737  1656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:03:53.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.898423  1756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.899189  1756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: This master's current role is: LEADER
20:03:53.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.900388  1773 catalog_manager.cc:1382] Generated new cluster ID: 1dcfb37ad35344ef8bef0c6c966983a1
20:03:53.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.900673  1773 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:03:53.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.907779  1775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.908540  1775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: This master's current role is: FOLLOWER
20:03:53.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.945407  1629 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 0 FOLLOWER]: Advancing to term 1
20:03:53.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.947063  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a01a9d8291f42cbadd70e09ffc146f0"
20:03:53.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.948529  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" is_pre_election: true
20:03:53.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.951368  1773 catalog_manager.cc:1405] Generated new certificate authority record
20:03:53.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:53.951427  1608 tablet.cc:2404] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:53.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.953779  1773 catalog_manager.cc:1539] Loading token signing keys...
20:03:53.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.961674  1629 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Refusing update from remote peer 9e2fc80c8a704c8e9d4810f0c7bad3fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:53.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.963650  1756 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:53.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.943444  1780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:53.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.977653  1780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: This master's current role is: FOLLOWER
20:03:53.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.977026  1656 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: configured and running, proceeding with master startup.
20:03:53.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.983680  1773 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd: Generated new TSK 0
20:03:53.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:53.984781  1773 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:03:54.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.002641  1498 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:54.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:54.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal
20:03:54.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/logs
20:03:54.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data/info.pb
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.129:0
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.118.129
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.129
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:54.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:54.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:54.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:54.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:54.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.014573  1783 mvcc.cc:204] Tried to move back new op lower bound from 7287335460130234368 to 7287335459924074496. Current Snapshot: MvccSnapshot[applied={T|T < 7287335460130234368}]
20:03:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.034617  1771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.034650  1780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.035403  1780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: This master's current role is: FOLLOWER
20:03:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.034760  1781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e2fc80c8a704c8e9d4810f0c7bad3fd. Latest consensus state: current_term: 1 leader_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:03:54.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.035392  1771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e2fc80c8a704c8e9d4810f0c7bad3fd [sys.catalog]: This master's current role is: LEADER
20:03:54.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.035993  1781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: This master's current role is: FOLLOWER
20:03:54.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.096865  1798 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:03:54.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.307021  1752 catalog_manager.cc:1294] Loaded cluster ID: 1dcfb37ad35344ef8bef0c6c966983a1
20:03:54.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.308266  1752 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: loading cluster ID for follower catalog manager: success
20:03:54.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.315817  1752 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: acquiring CA information for follower catalog manager: success
20:03:54.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.322067  1752 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.507369  1786 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.508392  1786 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:54.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.509043  1786 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:54.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.545315  1786 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:54.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.546300  1786 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.118.129
20:03:54.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.586491  1786 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:54.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:54.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:54.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:54.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.129:0
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data/info.pb
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.129
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.118.129
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/logs
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:54.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:54.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:54.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.588343  1786 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:54.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:54.590885  1786 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:54.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.612926  1804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:55.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.114727  1798 catalog_manager.cc:1294] Loaded cluster ID: 1dcfb37ad35344ef8bef0c6c966983a1
20:03:55.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.115063  1798 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: loading cluster ID for follower catalog manager: success
20:03:55.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.122670  1798 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: acquiring CA information for follower catalog manager: success
20:03:55.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:55.158766  1798 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:57.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:54.624306  1805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:57.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:56.008811  1803 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 1786
20:03:57.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:57.591620  1803 kernel_stack_watchdog.cc:198] Thread 1786 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 381ms:
20:03:57.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:03:57.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:03:57.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:03:57.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:03:57.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:57.591912  1786 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.968s	user 0.776s	sys 1.393s
20:03:57.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:57.594949  1786 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.971s	user 0.777s	sys 1.394s
20:03:57.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:57.595175  1808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:57.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:57.596733  1807 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2968 milliseconds
20:03:57.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.596808  1786 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:57.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.598516  1786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:57.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.601116  1786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:57.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.602763  1786 hybrid_clock.cc:648] HybridClock initialized: now 1779134637602693 us; error 79 us; skew 500 ppm
20:03:57.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.603786  1786 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:57.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.610777  1786 webserver.cc:533] Webserver started at http://127.1.118.129:32833/ using document root <none> and password file <none>
20:03:57.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.611781  1786 fs_manager.cc:362] Metadata directory not provided
20:03:57.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.611961  1786 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:57.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.612332  1786 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:57.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.616871  1786 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data/instance:
20:03:57.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3f84409352ef4399a4890610c0867c92"
20:03:57.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:57 on dist-test-slave-nsdw"
20:03:57.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.617920  1786 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal/instance:
20:03:57.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3f84409352ef4399a4890610c0867c92"
20:03:57.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:57 on dist-test-slave-nsdw"
20:03:57.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.626165  1786 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
20:03:57.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.632071  1819 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:57.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.633486  1786 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
20:03:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.633869  1786 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal
20:03:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3f84409352ef4399a4890610c0867c92"
20:03:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:57 on dist-test-slave-nsdw"
20:03:57.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.634289  1786 fs_report.cc:389] FS layout report
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data/data
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:57.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:57.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.692523  1786 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:57.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.694160  1786 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:57.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.694768  1786 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:57.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.698550  1786 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.703076  1786 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.703306  1786 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:03:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.703631  1786 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.703858  1786 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:57.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.893463  1786 rpc_server.cc:307] RPC server started. Bound to: 127.1.118.129:43415
20:03:57.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.893589  1931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.118.129:43415 every 8 connection(s)
20:03:57.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.896282  1786 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/data/info.pb
20:03:57.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.898963  1498 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 1786
20:03:57.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.899583  1498 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-0/wal/instance
20:03:57.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.925326  1498 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:57.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/logs
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data/info.pb
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.130:0
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.118.130
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.130
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:57.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:57.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:57.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:57.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:57.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:57.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.938155  1932 heartbeater.cc:344] Connected to a master server at 127.1.118.188:34999
20:03:57.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.938635  1932 heartbeater.cc:461] Registering TS with master...
20:03:57.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.940881  1932 heartbeater.cc:507] Master 127.1.118.188:34999 requested a full tablet report, sending...
20:03:57.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.944643  1697 ts_manager.cc:194] Registered new tserver with Master: 3f84409352ef4399a4890610c0867c92 (127.1.118.129:43415)
20:03:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.953372  1933 heartbeater.cc:344] Connected to a master server at 127.1.118.189:35039
20:03:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.953851  1933 heartbeater.cc:461] Registering TS with master...
20:03:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.955032  1933 heartbeater.cc:507] Master 127.1.118.189:35039 requested a full tablet report, sending...
20:03:57.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.958323  1621 ts_manager.cc:194] Registered new tserver with Master: 3f84409352ef4399a4890610c0867c92 (127.1.118.129:43415)
20:03:57.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.968669  1934 heartbeater.cc:344] Connected to a master server at 127.1.118.190:34817
20:03:57.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.969106  1934 heartbeater.cc:461] Registering TS with master...
20:03:57.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.970137  1934 heartbeater.cc:507] Master 127.1.118.190:34817 requested a full tablet report, sending...
20:03:57.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.973510  1544 ts_manager.cc:194] Registered new tserver with Master: 3f84409352ef4399a4890610c0867c92 (127.1.118.129:43415)
20:03:57.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:57.976447  1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.118.129:54541
20:03:58.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.279858  1939 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:58.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.280422  1939 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:58.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.280982  1939 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.317022  1939 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:58.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.318032  1939 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.118.130
20:03:58.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.361135  1939 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:58.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.130:0
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:58.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data/info.pb
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.130
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.118.130
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/logs
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.362913  1939 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:58.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.365211  1939 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:03:58.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.381292  1947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:58.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.980657  1934 heartbeater.cc:499] Master 127.1.118.190:34817 was elected leader, sending a full tablet report...
20:03:59.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.387001  1950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:59.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:58.388099  1939 server_base.cc:1061] running on GCE node
20:03:59.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:03:58.387888  1948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:59.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.591239  1939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:59.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.594027  1939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:59.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.595461  1939 hybrid_clock.cc:648] HybridClock initialized: now 1779134639595419 us; error 61 us; skew 500 ppm
20:03:59.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.596251  1939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:59.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.603153  1939 webserver.cc:533] Webserver started at http://127.1.118.130:36837/ using document root <none> and password file <none>
20:03:59.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.604192  1939 fs_manager.cc:362] Metadata directory not provided
20:03:59.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.604437  1939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:59.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.604998  1939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:59.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.609611  1939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data/instance:
20:03:59.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffe35555a7ad418aa292ca3561bd848d"
20:03:59.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:59 on dist-test-slave-nsdw"
20:03:59.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.610927  1939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal/instance:
20:03:59.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffe35555a7ad418aa292ca3561bd848d"
20:03:59.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:59 on dist-test-slave-nsdw"
20:03:59.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.618362  1939 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
20:03:59.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.624164  1958 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:59.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.625341  1939 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
20:03:59.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.625726  1939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal
20:03:59.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ffe35555a7ad418aa292ca3561bd848d"
20:03:59.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:03:59 on dist-test-slave-nsdw"
20:03:59.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.626160  1939 fs_report.cc:389] FS layout report
20:03:59.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:59.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data/data
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:59.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:59.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:59.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:59.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.680233  1939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:59.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.681818  1939 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:59.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.682349  1939 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:59.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.685086  1939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:59.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.689615  1939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:59.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.689854  1939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:03:59.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.690196  1939 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:59.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.690400  1939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:59.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.846372  1939 rpc_server.cc:307] RPC server started. Bound to: 127.1.118.130:44161
20:03:59.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.846535  2070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.118.130:44161 every 8 connection(s)
20:03:59.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.849228  1939 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/data/info.pb
20:03:59.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.859220  1498 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 1939
20:03:59.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.859798  1498 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-1/wal/instance
20:03:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.877193  1498 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:03:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/logs
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data/info.pb
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.131:0
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.118.131
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.131
20:03:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:03:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:03:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.912375  2072 heartbeater.cc:344] Connected to a master server at 127.1.118.189:35039
20:03:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.912806  2073 heartbeater.cc:344] Connected to a master server at 127.1.118.190:34817
20:03:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.912923  2072 heartbeater.cc:461] Registering TS with master...
20:03:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.913165  2073 heartbeater.cc:461] Registering TS with master...
20:03:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.914103  2072 heartbeater.cc:507] Master 127.1.118.189:35039 requested a full tablet report, sending...
20:03:59.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.914225  2073 heartbeater.cc:507] Master 127.1.118.190:34817 requested a full tablet report, sending...
20:03:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.917387  1544 ts_manager.cc:194] Registered new tserver with Master: ffe35555a7ad418aa292ca3561bd848d (127.1.118.130:44161)
20:03:59.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.917407  1621 ts_manager.cc:194] Registered new tserver with Master: ffe35555a7ad418aa292ca3561bd848d (127.1.118.130:44161)
20:03:59.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.918242  2071 heartbeater.cc:344] Connected to a master server at 127.1.118.188:34999
20:03:59.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.918582  2071 heartbeater.cc:461] Registering TS with master...
20:03:59.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.919068  1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.118.130:41581
20:03:59.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.919358  2071 heartbeater.cc:507] Master 127.1.118.188:34999 requested a full tablet report, sending...
20:03:59.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:03:59.923436  1697 ts_manager.cc:194] Registered new tserver with Master: ffe35555a7ad418aa292ca3561bd848d (127.1.118.130:44161)
20:04:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.227048  2081 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:00.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.227514  2081 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:00.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.228040  2081 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:00.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.262566  2081 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.263437  2081 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.118.131
20:04:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:00.305018  2081 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.118.148:41077
20:04:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.118.131:0
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data/info.pb
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.118.131
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.118.190:34817,127.1.118.189:35039,127.1.118.188:34999
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.118.131
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/logs
20:04:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:00.306598  2081 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:00.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:00.308858  2081 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:00.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.324695  2088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:00.922303  2073 heartbeater.cc:499] Master 127.1.118.190:34817 was elected leader, sending a full tablet report...
20:04:01.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.325469  2087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:01.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:00.328997  2090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:01.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:01.597452  2089 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1267 milliseconds
20:04:01.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.597572  2081 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:01.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.599043  2081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:01.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.601814  2081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:01.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.603284  2081 hybrid_clock.cc:648] HybridClock initialized: now 1779134641603215 us; error 62 us; skew 500 ppm
20:04:01.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.604437  2081 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:01.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.614355  2081 webserver.cc:533] Webserver started at http://127.1.118.131:38071/ using document root <none> and password file <none>
20:04:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.616164  2081 fs_manager.cc:362] Metadata directory not provided
20:04:01.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.616441  2081 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:01.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.617035  2081 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:01.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.621950  2081 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data/instance:
20:04:01.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d8073f8e35d243d2845843089ef299cd"
20:04:01.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:01 on dist-test-slave-nsdw"
20:04:01.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.623297  2081 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal/instance:
20:04:01.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d8073f8e35d243d2845843089ef299cd"
20:04:01.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:01 on dist-test-slave-nsdw"
20:04:01.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.630594  2081 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
20:04:01.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.636229  2099 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:01.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.637308  2081 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.637670  2081 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d8073f8e35d243d2845843089ef299cd"
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:01 on dist-test-slave-nsdw"
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.638072  2081 fs_report.cc:389] FS layout report
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data/data
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:01.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:01.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:01.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.689440  2081 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:01.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.691138  2081 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:01.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.691687  2081 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:01.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.694382  2081 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:01.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.698663  2081 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:01.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.698935  2081 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
20:04:01.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.699286  2081 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:01.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.699512  2081 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.859867  2081 rpc_server.cc:307] RPC server started. Bound to: 127.1.118.131:33413
20:04:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.859966  2211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.118.131:33413 every 8 connection(s)
20:04:01.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.862699  2081 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/data/info.pb
20:04:01.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.870822  1498 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2081
20:04:01.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.871317  1498 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15613629255141523101/ts-2/wal/instance
20:04:01.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.914072  2213 heartbeater.cc:344] Connected to a master server at 127.1.118.189:35039
20:04:01.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.914639  2213 heartbeater.cc:461] Registering TS with master...
20:04:01.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.916474  2213 heartbeater.cc:507] Master 127.1.118.189:35039 requested a full tablet report, sending...
20:04:01.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.917397  2212 heartbeater.cc:344] Connected to a master server at 127.1.118.188:34999
20:04:01.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.917750  2212 heartbeater.cc:461] Registering TS with master...
20:04:01.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.918485  2214 heartbeater.cc:344] Connected to a master server at 127.1.118.190:34817
20:04:01.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.918704  2212 heartbeater.cc:507] Master 127.1.118.188:34999 requested a full tablet report, sending...
20:04:01.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.918871  2214 heartbeater.cc:461] Registering TS with master...
20:04:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.919719  2214 heartbeater.cc:507] Master 127.1.118.190:34817 requested a full tablet report, sending...
20:04:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.919795  1620 ts_manager.cc:194] Registered new tserver with Master: d8073f8e35d243d2845843089ef299cd (127.1.118.131:33413)
20:04:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.921869  1544 ts_manager.cc:194] Registered new tserver with Master: d8073f8e35d243d2845843089ef299cd (127.1.118.131:33413)
20:04:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.922003  1697 ts_manager.cc:194] Registered new tserver with Master: d8073f8e35d243d2845843089ef299cd (127.1.118.131:33413)
20:04:01.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.923344  1544 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.118.131:47795
20:04:01.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:01.940903  1498 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
20:04:01.954 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:01.955 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:04:01.966 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.118.190"
      port: 34817
    }
    bound_http_address {
      host: "127.1.118.190"
      port: 38493
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.118.189"
      port: 35039
    }
    bound_http_address {
      host: "127.1.118.189"
      port: 45765
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.118.188"
      port: 34999
    }
    bound_http_address {
      host: "127.1.118.188"
      port: 37449
    }
  }
}

20:04:01.969 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:04:01.972 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.118.129"
      port: 43415
    }
    bound_http_address {
      host: "127.1.118.129"
      port: 32833
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.118.130"
      port: 44161
    }
    bound_http_address {
      host: "127.1.118.130"
      port: 36837
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.118.131"
      port: 33413
    }
    bound_http_address {
      host: "127.1.118.131"
      port: 38071
    }
  }
}

20:04:01.972 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:04:02.141 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
20:04:02.200 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:02.312 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:02.383 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.1.118.189:35039(127.1.118.189:35039)] connecting to peer
20:04:02.432 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.1.118.188:34999(127.1.118.188:34999)] connecting to peer
20:04:02.434 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:02.450 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.118.190:34817(127.1.118.190:34817)] Successfully connected to peer
20:04:02.454 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.118.189:35039(127.1.118.189:35039)] Successfully connected to peer
20:04:02.454 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.118.188:34999(127.1.118.188:34999)] Successfully connected to peer
20:04:02.554 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.118.188
20:04:02.554 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.118.189
20:04:02.554 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.118.190
20:04:02.787 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7db27985, L:/127.0.0.1:48144 - R:/127.1.118.190:34817] using SASL/PLAIN
20:04:02.787 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x12552c89, L:/127.0.0.1:52430 - R:/127.1.118.189:35039] using SASL/PLAIN
20:04:02.787 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x8565d14e, L:/127.0.0.1:47562 - R:/127.1.118.188:34999] using SASL/PLAIN
20:04:02.830 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:02.832 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=486), Traces: [0ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [454ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [454ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [455ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: OK, deferred=null) after lookup
20:04:02.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:02.889010  1544 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48144:
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=OPEN_TABLE"
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:02.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:04:02.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:02.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:02.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:02.894129  1544 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=OPEN_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:04:02.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:02.926359  2214 heartbeater.cc:499] Master 127.1.118.190:34817 was elected leader, sending a full tablet report...
20:04:02.974 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 37951f6c6c674453b6b46d87613817a5
20:04:03.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.015578  1867 tablet_service.cc:1511] Processing CreateTablet for tablet c3fc718ddfe04ad29ae7e79c205172ff (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=37951f6c6c674453b6b46d87613817a5]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.018093  1867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3fc718ddfe04ad29ae7e79c205172ff. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:03.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.039462  2006 tablet_service.cc:1511] Processing CreateTablet for tablet c3fc718ddfe04ad29ae7e79c205172ff (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=37951f6c6c674453b6b46d87613817a5]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:03.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.040617  2147 tablet_service.cc:1511] Processing CreateTablet for tablet c3fc718ddfe04ad29ae7e79c205172ff (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=37951f6c6c674453b6b46d87613817a5]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:03.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.041893  2006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3fc718ddfe04ad29ae7e79c205172ff. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:03.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.043118  2147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3fc718ddfe04ad29ae7e79c205172ff. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:03.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.058192  2248 tablet_bootstrap.cc:492] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: Bootstrap starting.
20:04:03.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.069381  2248 tablet_bootstrap.cc:654] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: Neither blocks nor log segments found. Creating new log.
20:04:03.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.072703  2248 log.cc:826] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: Log is configured to *not* fsync() on all Append() calls
20:04:03.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.088289  2251 tablet_bootstrap.cc:492] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: Bootstrap starting.
20:04:03.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.091622  2248 tablet_bootstrap.cc:492] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: No bootstrap required, opened a new log
20:04:03.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.092607  2248 ts_tablet_manager.cc:1403] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.015s
20:04:03.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.097185  2250 tablet_bootstrap.cc:492] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: Bootstrap starting.
20:04:03.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.099539  2251 tablet_bootstrap.cc:654] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: Neither blocks nor log segments found. Creating new log.
20:04:03.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.102754  2251 log.cc:826] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: Log is configured to *not* fsync() on all Append() calls
20:04:03.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.106138  2250 tablet_bootstrap.cc:654] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: Neither blocks nor log segments found. Creating new log.
20:04:03.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.108855  2250 log.cc:826] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: Log is configured to *not* fsync() on all Append() calls
20:04:03.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.118149  2251 tablet_bootstrap.cc:492] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: No bootstrap required, opened a new log
20:04:03.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.119098  2251 ts_tablet_manager.cc:1403] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.004s
20:04:03.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.127684  2248 raft_consensus.cc:359] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.129401  2248 raft_consensus.cc:385] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.129941  2248 raft_consensus.cc:740] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f84409352ef4399a4890610c0867c92, State: Initialized, Role: FOLLOWER
20:04:03.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.130815  2250 tablet_bootstrap.cc:492] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: No bootstrap required, opened a new log
20:04:03.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.131562  2250 ts_tablet_manager.cc:1403] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.013s
20:04:03.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.131214  2248 consensus_queue.cc:260] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.162986  2250 raft_consensus.cc:359] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.164238  2250 raft_consensus.cc:385] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:03.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.164709  2250 raft_consensus.cc:740] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe35555a7ad418aa292ca3561bd848d, State: Initialized, Role: FOLLOWER
20:04:03.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.166390  2250 consensus_queue.cc:260] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.169920  2248 ts_tablet_manager.cc:1434] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: Time spent starting tablet: real 0.077s	user 0.052s	sys 0.020s
20:04:03.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.185278  2250 ts_tablet_manager.cc:1434] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: Time spent starting tablet: real 0.053s	user 0.030s	sys 0.010s
20:04:03.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.196708  2251 raft_consensus.cc:359] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.197992  2251 raft_consensus.cc:385] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:03.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.198576  2251 raft_consensus.cc:740] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8073f8e35d243d2845843089ef299cd, State: Initialized, Role: FOLLOWER
20:04:03.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.200397  2251 consensus_queue.cc:260] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.209291  2251 ts_tablet_manager.cc:1434] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: Time spent starting tablet: real 0.089s	user 0.037s	sys 0.003s
20:04:03.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.212657  1940 tablet.cc:2404] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:03.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.333029  2255 raft_consensus.cc:493] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:03.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.333660  2255 raft_consensus.cc:515] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.336724  2255 leader_election.cc:290] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f84409352ef4399a4890610c0867c92 (127.1.118.129:43415), d8073f8e35d243d2845843089ef299cd (127.1.118.131:33413)
20:04:03.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.350456  1887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3fc718ddfe04ad29ae7e79c205172ff" candidate_uuid: "ffe35555a7ad418aa292ca3561bd848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f84409352ef4399a4890610c0867c92" is_pre_election: true
20:04:03.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.351416  1887 raft_consensus.cc:2468] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe35555a7ad418aa292ca3561bd848d in term 0.
20:04:03.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.351532  2167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3fc718ddfe04ad29ae7e79c205172ff" candidate_uuid: "ffe35555a7ad418aa292ca3561bd848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8073f8e35d243d2845843089ef299cd" is_pre_election: true
20:04:03.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.352780  2167 raft_consensus.cc:2468] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe35555a7ad418aa292ca3561bd848d in term 0.
20:04:03.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.353355  1961 leader_election.cc:304] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f84409352ef4399a4890610c0867c92, ffe35555a7ad418aa292ca3561bd848d; no voters: 
20:04:03.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.354280  2255 raft_consensus.cc:2804] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:03.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.354614  2255 raft_consensus.cc:493] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:03.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.354885  2255 raft_consensus.cc:3060] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 0 FOLLOWER]: Advancing to term 1
20:04:03.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.360612  2255 raft_consensus.cc:515] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.362241  2255 leader_election.cc:290] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [CANDIDATE]: Term 1 election: Requested vote from peers 3f84409352ef4399a4890610c0867c92 (127.1.118.129:43415), d8073f8e35d243d2845843089ef299cd (127.1.118.131:33413)
20:04:03.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.363356  1887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3fc718ddfe04ad29ae7e79c205172ff" candidate_uuid: "ffe35555a7ad418aa292ca3561bd848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f84409352ef4399a4890610c0867c92"
20:04:03.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.363675  2167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3fc718ddfe04ad29ae7e79c205172ff" candidate_uuid: "ffe35555a7ad418aa292ca3561bd848d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8073f8e35d243d2845843089ef299cd"
20:04:03.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.363852  1887 raft_consensus.cc:3060] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [term 0 FOLLOWER]: Advancing to term 1
20:04:03.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.364182  2167 raft_consensus.cc:3060] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [term 0 FOLLOWER]: Advancing to term 1
20:04:03.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.369206  1887 raft_consensus.cc:2468] T c3fc718ddfe04ad29ae7e79c205172ff P 3f84409352ef4399a4890610c0867c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe35555a7ad418aa292ca3561bd848d in term 1.
20:04:03.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.370283  1961 leader_election.cc:304] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f84409352ef4399a4890610c0867c92, ffe35555a7ad418aa292ca3561bd848d; no voters: 
20:04:03.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.370980  2255 raft_consensus.cc:2804] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 1 FOLLOWER]: Leader election won for term 1
20:04:03.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.371745  2167 raft_consensus.cc:2468] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe35555a7ad418aa292ca3561bd848d in term 1.
20:04:03.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.373775  2255 raft_consensus.cc:697] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [term 1 LEADER]: Becoming Leader. State: Replica: ffe35555a7ad418aa292ca3561bd848d, State: Running, Role: LEADER
20:04:03.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.375525  2255 consensus_queue.cc:237] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } }
20:04:03.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.385468  1542 catalog_manager.cc:5696] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d reported cstate change: term changed from 0 to 1, leader changed from <none> to ffe35555a7ad418aa292ca3561bd848d (127.1.118.130). New cstate: current_term: 1 leader_uuid: "ffe35555a7ad418aa292ca3561bd848d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe35555a7ad418aa292ca3561bd848d" member_type: VOTER last_known_addr { host: "127.1.118.130" port: 44161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 } health_report { overall_health: UNKNOWN } } }
20:04:03.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.393479  2078 tablet.cc:2404] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:03.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.394780  2219 tablet.cc:2404] T c3fc718ddfe04ad29ae7e79c205172ff P d8073f8e35d243d2845843089ef299cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:03.431 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.1.118.190:34817
20:04:03.433 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

20:04:03.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.433539  1498 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 1511
20:04:03.464 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:03.469 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.118.190:34817(127.1.118.190:34817)] handling channelInactive
20:04:03.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state READY due to: connection closed
20:04:03.471 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location master-127.1.118.190:34817(127.1.118.190:34817) for tablet Kudu Master: connection closed
20:04:03.488 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.494 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.494 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.494 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.497 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.507 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.509 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.510 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.510 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.510 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.528 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.530 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.530 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.531 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.568 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.572 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.572 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.572 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.574 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.607 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.610 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.611 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.611 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.611 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.668 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.669 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.670 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.671 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.768 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.769 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.769 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.770 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.771 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.867764  2255 consensus_queue.cc:1048] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8073f8e35d243d2845843089ef299cd" member_type: VOTER last_known_addr { host: "127.1.118.131" port: 33413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:03.888 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.889 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.889 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.906 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:03.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.914202  2214 heartbeater.cc:646] Failed to heartbeat to 127.1.118.190:34817 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:03.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.928231  2073 heartbeater.cc:646] Failed to heartbeat to 127.1.118.190:34817 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:03.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:03.927613  2268 consensus_queue.cc:1048] T c3fc718ddfe04ad29ae7e79c205172ff P ffe35555a7ad418aa292ca3561bd848d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f84409352ef4399a4890610c0867c92" member_type: VOTER last_known_addr { host: "127.1.118.129" port: 43415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:04:03.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:03.959928  1934 heartbeater.cc:646] Failed to heartbeat to 127.1.118.190:34817 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:03.987 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:03.989 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.989 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.989 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:03.991 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:04.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.903258  2280 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e2fc80c8a704c8e9d4810f0c7bad3fd)
20:04:04.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.903775  2280 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:04.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.905017  2281 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e2fc80c8a704c8e9d4810f0c7bad3fd)
20:04:04.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.905609  2281 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:04.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.906456  2280 leader_election.cc:290] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817), 6a01a9d8291f42cbadd70e09ffc146f0 (127.1.118.189:35039)
20:04:04.908 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:04.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.908361  2281 leader_election.cc:290] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817), 2f5b9905d793497a849e36d6d1030a61 (127.1.118.188:34999)
20:04:04.910 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:04.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:04.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.909623  1683 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.911019  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f5b9905d793497a849e36d6d1030a61" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" is_pre_election: true
20:04:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.911773  1629 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f5b9905d793497a849e36d6d1030a61 in term 1.
20:04:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.913341  1605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:04:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.913816  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "2f5b9905d793497a849e36d6d1030a61" is_pre_election: true
20:04:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.914196  1682 leader_election.cc:304] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61, 6a01a9d8291f42cbadd70e09ffc146f0; no voters: 
20:04:04.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.914538  1706 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a01a9d8291f42cbadd70e09ffc146f0 in term 1.
20:04:04.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.916913  2280 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:04.921 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:04.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.922688  2280 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e2fc80c8a704c8e9d4810f0c7bad3fd)
20:04:04.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.923454  2280 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 1 FOLLOWER]: Advancing to term 2
20:04:04.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.935465  2280 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:04.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.937645  1605 leader_election.cc:304] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61, 6a01a9d8291f42cbadd70e09ffc146f0; no voters: 
20:04:04.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.935987  1683 leader_election.cc:336] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:04.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.938917  2281 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:04.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.939447  2281 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e2fc80c8a704c8e9d4810f0c7bad3fd)
20:04:04.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.939728  1605 leader_election.cc:336] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:04.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.940209  2281 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 1 FOLLOWER]: Advancing to term 2
20:04:04.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.941701  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f5b9905d793497a849e36d6d1030a61" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6a01a9d8291f42cbadd70e09ffc146f0"
20:04:04.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.942306  2280 leader_election.cc:290] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817), 6a01a9d8291f42cbadd70e09ffc146f0 (127.1.118.189:35039)
20:04:04.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.944734  1683 leader_election.cc:336] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:04.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.947894  2281 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:04.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.948823  1629 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f5b9905d793497a849e36d6d1030a61 in current term 2: Already voted for candidate 6a01a9d8291f42cbadd70e09ffc146f0 in this term.
20:04:04.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.949654  2281 leader_election.cc:290] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [CANDIDATE]: Term 2 election: Requested vote from peers 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817), 2f5b9905d793497a849e36d6d1030a61 (127.1.118.188:34999)
20:04:04.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.951128  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "2f5b9905d793497a849e36d6d1030a61"
20:04:04.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.951886  1706 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a01a9d8291f42cbadd70e09ffc146f0 in current term 2: Already voted for candidate 2f5b9905d793497a849e36d6d1030a61 in this term.
20:04:04.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.952605  1682 leader_election.cc:304] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61; no voters: 6a01a9d8291f42cbadd70e09ffc146f0, 9e2fc80c8a704c8e9d4810f0c7bad3fd
20:04:04.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.953384  2280 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:04:04.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:04.954259  1605 leader_election.cc:336] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:04.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.954530  1605 leader_election.cc:304] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a01a9d8291f42cbadd70e09ffc146f0; no voters: 2f5b9905d793497a849e36d6d1030a61, 9e2fc80c8a704c8e9d4810f0c7bad3fd
20:04:04.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:04.955116  2281 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:04:05.867 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:05.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:05.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:05.870 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:05.871 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817; will retry
20:04:06.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.748992  2292 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:06.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.749343  2292 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:06.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.750681  2292 leader_election.cc:290] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817), 6a01a9d8291f42cbadd70e09ffc146f0 (127.1.118.189:35039)
20:04:06.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.751965  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f5b9905d793497a849e36d6d1030a61" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" is_pre_election: true
20:04:06.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.752492  1629 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f5b9905d793497a849e36d6d1030a61 in term 2.
20:04:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.753561  1682 leader_election.cc:304] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61, 6a01a9d8291f42cbadd70e09ffc146f0; no voters: 
20:04:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.754356  2292 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Leader pre-election won for term 3
20:04:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.754684  2292 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.755030  2292 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 2 FOLLOWER]: Advancing to term 3
20:04:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.755927  1683 leader_election.cc:336] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:06.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.761955  2292 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:06.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.763440  2292 leader_election.cc:290] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 3 election: Requested vote from peers 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817), 6a01a9d8291f42cbadd70e09ffc146f0 (127.1.118.189:35039)
20:04:06.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.764452  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f5b9905d793497a849e36d6d1030a61" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6a01a9d8291f42cbadd70e09ffc146f0"
20:04:06.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.764953  1629 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 2 FOLLOWER]: Advancing to term 3
20:04:06.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:06.766525  1683 leader_election.cc:336] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111)
20:04:06.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.769716  1629 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f5b9905d793497a849e36d6d1030a61 in term 3.
20:04:06.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.770499  1682 leader_election.cc:304] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f5b9905d793497a849e36d6d1030a61, 6a01a9d8291f42cbadd70e09ffc146f0; no voters: 9e2fc80c8a704c8e9d4810f0c7bad3fd
20:04:06.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.771286  2292 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 3 FOLLOWER]: Leader election won for term 3
20:04:06.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.772099  2292 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [term 3 LEADER]: Becoming Leader. State: Replica: 2f5b9905d793497a849e36d6d1030a61, State: Running, Role: LEADER
20:04:06.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.772857  2292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } }
20:04:06.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.777377  2295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5b9905d793497a849e36d6d1030a61. Latest consensus state: current_term: 3 leader_uuid: "2f5b9905d793497a849e36d6d1030a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:04:06.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.778144  2295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: This master's current role is: LEADER
20:04:06.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.780325  2297 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.786154  2297 catalog_manager.cc:679] Loaded metadata for table TestMasterFailover-killBefore=OPEN_TABLE [id=37951f6c6c674453b6b46d87613817a5]
20:04:06.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.790656  2297 tablet_loader.cc:96] loaded metadata for tablet c3fc718ddfe04ad29ae7e79c205172ff (table TestMasterFailover-killBefore=OPEN_TABLE [id=37951f6c6c674453b6b46d87613817a5])
20:04:06.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.791605  2297 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:06.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.794101  2297 catalog_manager.cc:1294] Loaded cluster ID: 1dcfb37ad35344ef8bef0c6c966983a1
20:04:06.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.794271  2297 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:06.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.797165  2297 catalog_manager.cc:1539] Loading token signing keys...
20:04:06.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.799683  2297 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61: Loaded TSK: 0
20:04:06.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:06.800586  2297 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:07.225229  1683 consensus_peers.cc:597] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 -> Peer 9e2fc80c8a704c8e9d4810f0c7bad3fd (127.1.118.190:34817): Couldn't send request to peer 9e2fc80c8a704c8e9d4810f0c7bad3fd. Status: Network error: Client connection negotiation failed: client connection to 127.1.118.190:34817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:04:07.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.267431  1629 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [term 3 FOLLOWER]: Refusing update from remote peer 2f5b9905d793497a849e36d6d1030a61: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
20:04:07.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.268795  2295 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
20:04:07.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.273974  2301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5b9905d793497a849e36d6d1030a61. Latest consensus state: current_term: 3 leader_uuid: "2f5b9905d793497a849e36d6d1030a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:04:07.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.274724  2301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: This master's current role is: FOLLOWER
20:04:07.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.278075  2295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2f5b9905d793497a849e36d6d1030a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:04:07.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.278806  2295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5b9905d793497a849e36d6d1030a61 [sys.catalog]: This master's current role is: LEADER
20:04:07.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.279608  2301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "2f5b9905d793497a849e36d6d1030a61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2fc80c8a704c8e9d4810f0c7bad3fd" member_type: VOTER last_known_addr { host: "127.1.118.190" port: 34817 } } peers { permanent_uuid: "6a01a9d8291f42cbadd70e09ffc146f0" member_type: VOTER last_known_addr { host: "127.1.118.189" port: 35039 } } peers { permanent_uuid: "2f5b9905d793497a849e36d6d1030a61" member_type: VOTER last_known_addr { host: "127.1.118.188" port: 34999 } } }
20:04:07.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.280246  2301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a01a9d8291f42cbadd70e09ffc146f0 [sys.catalog]: This master's current role is: FOLLOWER
20:04:07.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.945886  2212 heartbeater.cc:499] Master 127.1.118.188:34999 was elected leader, sending a full tablet report...
20:04:07.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:07.976828  1932 heartbeater.cc:499] Master 127.1.118.188:34999 was elected leader, sending a full tablet report...
20:04:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:08.440585  2071 heartbeater.cc:499] Master 127.1.118.188:34999 was elected leader, sending a full tablet report...
20:04:09.267 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.1.118.190:34817(127.1.118.190:34817)] connecting to peer
20:04:09.269 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:09.269 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.1.118.190:34817(127.1.118.190:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:09.269 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.1.118.190:34817: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817
20:04:09.273 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:09.276 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=13, TimeoutTracker(timeout=50000, elapsed=5808), Traces: [0ms] sending RPC to server master-127.1.118.190:34817, [6ms] received response from server master-127.1.118.190:34817: Network error: connection closed, [6ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [29ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [33ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [45ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [45ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [45ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [61ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [66ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [66ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [66ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [106ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [108ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [109ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [145ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [146ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [146ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [201ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [205ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [206ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [206ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [206ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [301ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [304ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [305ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [306ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [306ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [425ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [426ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [441ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [442ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [521ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [524ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [526ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [526ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [526ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [1441ms] refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [1445ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [1449ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [1456ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [1457ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [2405ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [2406ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [2406ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, [2406ms] delaying RPC due to: Service unavailable: Master config (127.1.118.189:35039,127.1.118.188:34999,127.1.118.190:34817) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [5801ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.189:35039, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.188:34999, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.118.190:34817, [5804ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.190:34817: Network error: Failed to connect to peer master-127.1.118.190:34817(127.1.118.190:34817): Connection refused: /127.1.118.190:34817, [5807ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.189:35039: OK, [5807ms] Sub RPC ConnectToMaster: received response from server master-127.1.118.188:34999: OK, deferred=Deferred@835399361(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$236/0x00007f8c3c32b6e8@315f89dd -> wakeup thread Time-limited test -> (continuation of Deferred@1204734802 after retry RPC after error@576463792) -> (continuation of Deferred@1250540572 after retry RPC after error@131450353) -> (continuation of Deferred@913312258 after retry RPC after error@1978855135) -> (continuation of Deferred@1922876705 after retry RPC after error@1540320462) -> (continuation of Deferred@1834573231 after retry RPC after error@264229581) -> (continuation of Deferred@454998998 after retry RPC after error@999759207) -> (continuation of Deferred@470064031 after retry RPC after error@1834752872) -> (continuation of Deferred@66243870 after retry RPC after error@9274402) -> (continuation of Deferred@955068367 after retry RPC after error@896005345) -> (continuation of Deferred@552097134 after retry RPC after error@1286105541) -> (continuation of Deferred@493532360 after retry RPC after error@396401528), errback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1204734802 after retry RPC after error@576463792) -> (continuation of Deferred@1250540572 after retry RPC after error@131450353) -> (continuation of Deferred@913312258 after retry RPC after error@1978855135) -> (continuation of Deferred@1922876705 after retry RPC after error@1540320462) -> (continuation of Deferred@1834573231 after retry RPC after error@264229581) -> (continuation of Deferred@454998998 after retry RPC after error@999759207) -> (continuation of Deferred@470064031 after retry RPC after error@1834752872) -> (continuation of Deferred@66243870 after retry RPC after error@9274402) -> (continuation of Deferred@955068367 after retry RPC after error@896005345) -> (continuation of Deferred@552097134 after retry RPC after error@1286105541) -> (continuation of Deferred@493532360 after retry RPC after error@396401528))) after lookup
20:04:09.282 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 37951f6c6c674453b6b46d87613817a5
20:04:09.306 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet c3fc718ddfe04ad29ae7e79c205172ff for table 'TestMasterFailover-killBefore=OPEN_TABLE' with partition [<start>, <end>)
20:04:09.312 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=c3fc718ddfe04ad29ae7e79c205172ff@[3f84409352ef4399a4890610c0867c92(127.1.118.129:43415),d8073f8e35d243d2845843089ef299cd(127.1.118.131:33413),ffe35555a7ad418aa292ca3561bd848d(127.1.118.130:44161)[L]]}]
20:04:09.319 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=17), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.118.188:34999, [9ms] Sub RPC GetTableLocations: received response from server master-127.1.118.188:34999: OK, deferred=null)) after lookup
20:04:09.329 [DEBUG - kudu-nio-1] (Connection.java:748) [peer ffe35555a7ad418aa292ca3561bd848d(127.1.118.130:44161)] connecting to peer
20:04:09.331 [DEBUG - kudu-nio-7] (Connection.java:757) [peer ffe35555a7ad418aa292ca3561bd848d(127.1.118.130:44161)] Successfully connected to peer
20:04:09.399 [DEBUG - kudu-nio-7] (Negotiator.java:919) Authenticated connection [id: 0x27632cd8, L:/127.0.0.1:59350 - R:/127.1.118.130:44161] using TOKEN/null
20:04:09.429 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=OPEN_TABLE, tablet=c3fc718ddfe04ad29ae7e79c205172ff, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:09.439 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:09.457 [DEBUG - main] (Connection.java:575) [peer ffe35555a7ad418aa292ca3561bd848d(127.1.118.130:44161)] disconnecting while in state READY
20:04:09.459 [DEBUG - main] (Connection.java:575) [peer master-127.1.118.188:34999(127.1.118.188:34999)] disconnecting while in state READY
20:04:09.459 [DEBUG - main] (Connection.java:575) [peer master-127.1.118.189:35039(127.1.118.189:35039)] disconnecting while in state READY
20:04:09.459 [DEBUG - main] (Connection.java:575) [peer master-127.1.118.190:34817(127.1.118.190:34817)] disconnecting while in state TERMINATED
20:04:09.469 [DEBUG - kudu-nio-7] (Connection.java:239) [peer ffe35555a7ad418aa292ca3561bd848d(127.1.118.130:44161)] handling channelInactive
20:04:09.469 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.118.188:34999(127.1.118.188:34999)] handling channelInactive
20:04:09.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.118.188:34999(127.1.118.188:34999)] cleaning up while in state READY due to: connection closed
20:04:09.470 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:09.470 [DEBUG - kudu-nio-7] (Connection.java:709) [peer ffe35555a7ad418aa292ca3561bd848d(127.1.118.130:44161)] cleaning up while in state READY due to: connection closed
20:04:09.471 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.118.189:35039(127.1.118.189:35039)] handling channelInactive
20:04:09.471 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.118.189:35039(127.1.118.189:35039)] cleaning up while in state READY due to: connection closed
20:04:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:09.473963  1498 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 1786
20:04:09.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:09.503695  1498 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 1939
20:04:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:09.526271  1498 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2081
20:04:09.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:09.555002  1498 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 1581
20:04:09.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:09.582218  1682 connection.cc:582] client connection to 127.1.118.189:35039 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:04:09.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:09.583523  1498 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 1658
20:04:10.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:10Z chronyd exiting
.20:04:11.991 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779134651991
20:04:11.995 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:04:11.996 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:04:11.996 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskP4R3uz/test-tmp
20:04:11.996 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:04:11.996 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskP4R3uz/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:04:11.999 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:04:12.326 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:12.327 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:04:12.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.330070  2329 mini_oidc.cc:150] Starting JWKS server
20:04:12.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.333150  2329 webserver.cc:533] Webserver started at http://127.0.0.1:36779/ using document root <none> and password file <none>
20:04:12.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.333545  2329 mini_oidc.cc:186] Starting OIDC Discovery server
20:04:12.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.335227  2329 webserver.cc:533] Webserver started at http://127.0.0.1:42141/ using document root <none> and password file <none>
20:04:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:12Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:04:12.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:12Z Disabled control of system clock
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.398934  2329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/logs
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data/info.pb
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.126:40271
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.126
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:12.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36779/jwks.json with env {}
20:04:12.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.701654  2341 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:12.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.702226  2341 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:12.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.702682  2341 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:12.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.735910  2341 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:12.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.736287  2341 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:12.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.736491  2341 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:12.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.736692  2341 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:12.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.736925  2341 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:12.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.737107  2341 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36779/jwks.json
20:04:12.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.774470  2341 master_runner.cc:387] Master server non-default flags:
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.126:40271
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36779/jwks.json
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data/info.pb
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.126
20:04:12.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/logs
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:12.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.775904  2341 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:12.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:12.777554  2341 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:12.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.788707  2347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:13.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.790943  2348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:13.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:12.794005  2350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:13.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:13.987329  2349 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
20:04:13.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.987433  2341 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:13.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.991508  2341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:13.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.994308  2341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:13.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.995723  2341 hybrid_clock.cc:648] HybridClock initialized: now 1779134653995698 us; error 61 us; skew 500 ppm
20:04:13.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:13.996541  2341 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:14.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.003014  2341 webserver.cc:533] Webserver started at http://127.2.70.126:45283/ using document root <none> and password file <none>
20:04:14.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.004180  2341 fs_manager.cc:362] Metadata directory not provided
20:04:14.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.004467  2341 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:14.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.005062  2341 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:14.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.011669  2341 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data/instance:
20:04:14.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b5aeb61d2c044cd4add3d9be4cecb7db"
20:04:14.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:14 on dist-test-slave-nsdw"
20:04:14.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.013170  2341 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal/instance:
20:04:14.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b5aeb61d2c044cd4add3d9be4cecb7db"
20:04:14.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:14 on dist-test-slave-nsdw"
20:04:14.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.022456  2341 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.004s
20:04:14.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.028326  2357 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:14.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.029546  2341 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.029874  2341 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b5aeb61d2c044cd4add3d9be4cecb7db"
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:14 on dist-test-slave-nsdw"
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.030169  2341 fs_report.cc:389] FS layout report
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data/data
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:14.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:14.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:14.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:14.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.098451  2341 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:14.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.100013  2341 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:14.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.100477  2341 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:14.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.173280  2341 rpc_server.cc:307] RPC server started. Bound to: 127.2.70.126:40271
20:04:14.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.173355  2408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.70.126:40271 every 8 connection(s)
20:04:14.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.175927  2341 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/data/info.pb
20:04:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.182057  2409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.186798  2329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2341
20:04:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.187235  2329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-0/wal/instance
20:04:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.192364  2329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/logs
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data/info.pb
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.125:40343
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.125
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:14.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:14.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:14.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:14.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:14.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:14.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36779/jwks.json with env {}
20:04:14.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.192829  2409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } has no permanent_uuid. Determining permanent_uuid...
20:04:14.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.226382  2409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } has no permanent_uuid. Determining permanent_uuid...
20:04:14.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.229038  2360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:14.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.233846  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:14.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.283476  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 1
20:04:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.287771  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:14.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.356164  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 2
20:04:14.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.360131  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:14.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.451547  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 3
20:04:14.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.455588  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.508965  2411 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.509527  2411 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:14.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.509979  2411 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.543028  2411 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.543323  2411 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.543524  2411 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:14.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.543720  2411 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:14.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.543929  2411 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:14.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.544080  2411 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36779/jwks.json
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.580829  2411 master_runner.cc:387] Master server non-default flags:
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:14.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.125:40343
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36779/jwks.json
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data/info.pb
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.125
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/logs
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:14.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.582456  2411 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:14.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.584107  2411 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:14.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.595718  2420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:14.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.598941  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 4
20:04:14.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.604949  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:14.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:14.904443  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 5
20:04:14.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.912878  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.460543  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 6
20:04:15.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.492462  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.125:40343: Network error: Client connection negotiation failed: client connection to 127.2.70.125:40343: connect: Connection refused (error 111)
20:04:15.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:14.596328  2421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:15.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.844547  2422 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1245 milliseconds
20:04:15.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.846123  2423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:15.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.849536  2411 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.254s	user 0.434s	sys 0.801s
20:04:15.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:15.849881  2411 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.254s	user 0.434s	sys 0.801s
20:04:15.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.850164  2411 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:15.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.851401  2411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:15.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.865458  2411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:15.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.867277  2411 hybrid_clock.cc:648] HybridClock initialized: now 1779134655867217 us; error 71 us; skew 500 ppm
20:04:15.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.868326  2411 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:15.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.877112  2411 webserver.cc:533] Webserver started at http://127.2.70.125:45291/ using document root <none> and password file <none>
20:04:15.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.878151  2411 fs_manager.cc:362] Metadata directory not provided
20:04:15.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.878485  2411 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:15.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.879071  2411 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:15.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.883970  2411 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data/instance:
20:04:15.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9afb93e6c8d043d2b6516fff9860d176"
20:04:15.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:15 on dist-test-slave-nsdw"
20:04:15.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.885200  2411 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal/instance:
20:04:15.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9afb93e6c8d043d2b6516fff9860d176"
20:04:15.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:15 on dist-test-slave-nsdw"
20:04:15.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.893354  2411 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.006s
20:04:15.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.900023  2432 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:15.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.901330  2411 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
20:04:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.901719  2411 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal
20:04:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9afb93e6c8d043d2b6516fff9860d176"
20:04:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:15 on dist-test-slave-nsdw"
20:04:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.902172  2411 fs_report.cc:389] FS layout report
20:04:15.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data/data
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:15.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.975515  2411 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:15.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.977121  2411 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:15.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:15.977648  2411 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:16.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.049240  2411 rpc_server.cc:307] RPC server started. Bound to: 127.2.70.125:40343
20:04:16.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.049329  2483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.70.125:40343 every 8 connection(s)
20:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.052175  2411 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/data/info.pb
20:04:16.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.058578  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:16.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.062556  2329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2411
20:04:16.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.063063  2329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-1/wal/instance
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.066205  2329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/logs
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data/info.pb
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.124:41591
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.124
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:16.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36779/jwks.json with env {}
20:04:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.073980  2484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.099956  2484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.114857  2484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.117357  2436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.121379  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.170841  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 1
20:04:16.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.174906  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.243314  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 2
20:04:16.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.247682  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.339105  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 3
20:04:16.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.343200  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.403600  2486 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:16.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.404161  2486 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:16.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.404603  2486 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:16.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.438099  2486 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:16.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.438380  2486 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:16.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.438570  2486 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:16.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.438755  2486 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:16.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.438973  2486 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:16.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.439123  2486 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36779/jwks.json
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.475925  2486 master_runner.cc:387] Master server non-default flags:
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.124:41591
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:16.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36779/jwks.json
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data/info.pb
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.124
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/logs
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:16.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.477216  2486 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:16.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.478803  2486 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:16.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.486656  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 4
20:04:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.489912  2496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:16.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.493229  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.552971  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } attempt: 7
20:04:16.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.567168  2409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } has no permanent_uuid. Determining permanent_uuid...
20:04:16.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.574069  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.632499  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 1
20:04:16.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.637720  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.719172  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 2
20:04:16.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.724377  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.792747  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 5
20:04:16.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.797168  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.809767  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 3
20:04:16.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.814862  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:16.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.955253  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 4
20:04:16.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.960220  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:17.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.243671  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 5
20:04:17.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.248437  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.344846  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 6
20:04:17.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.352210  2484 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:17.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.494771  2497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:16.495651  2486 server_base.cc:1061] running on GCE node
20:04:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:16.494947  2499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:17.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.748299  2486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:17.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.750984  2486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:17.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.752373  2486 hybrid_clock.cc:648] HybridClock initialized: now 1779134657752343 us; error 38 us; skew 500 ppm
20:04:17.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.753289  2486 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.760967  2486 webserver.cc:533] Webserver started at http://127.2.70.124:34687/ using document root <none> and password file <none>
20:04:17.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.761986  2486 fs_manager.cc:362] Metadata directory not provided
20:04:17.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.762228  2486 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:17.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.762758  2486 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:17.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.767300  2486 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data/instance:
20:04:17.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21b59a479e024d14bcbf010c5935838e"
20:04:17.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-nsdw"
20:04:17.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.768456  2486 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal/instance:
20:04:17.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21b59a479e024d14bcbf010c5935838e"
20:04:17.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-nsdw"
20:04:17.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.775621  2486 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
20:04:17.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.781237  2510 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:17.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.782328  2486 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.782708  2486 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21b59a479e024d14bcbf010c5935838e"
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:17 on dist-test-slave-nsdw"
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.783108  2486 fs_report.cc:389] FS layout report
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal
20:04:17.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data/data
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:17.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:17.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.800832  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 6
20:04:17.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:17.807765  2409 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.2.70.124:41591: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:17.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.833297  2486 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.834942  2486 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.835351  2486 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.908679  2486 rpc_server.cc:307] RPC server started. Bound to: 127.2.70.124:41591
20:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.908761  2563 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.70.124:41591 every 8 connection(s)
20:04:17.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.911515  2486 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/data/info.pb
20:04:17.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.915551  2329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2486
20:04:17.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.916024  2329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/master-2/wal/instance
20:04:17.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.918455  2564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:17.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.936120  2564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } has no permanent_uuid. Determining permanent_uuid...
20:04:17.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.960602  2564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } has no permanent_uuid. Determining permanent_uuid...
20:04:17.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.969664  2564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } has no permanent_uuid. Determining permanent_uuid...
20:04:17.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.985313  2564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: Bootstrap starting.
20:04:17.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.991425  2564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: Neither blocks nor log segments found. Creating new log.
20:04:17.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.993376  2564 log.cc:826] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: Log is configured to *not* fsync() on all Append() calls
20:04:17.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:17.997586  2564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: No bootstrap required, opened a new log
20:04:18.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.017964  2564 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.018623  2564 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:18.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.018821  2564 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b59a479e024d14bcbf010c5935838e, State: Initialized, Role: FOLLOWER
20:04:18.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.019659  2564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.022282  2573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.023154  2573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.023965  2564 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: configured and running, proceeding with master startup.
20:04:18.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.049427  2584 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:04:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.050166  2584 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:04:18.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.045094  2486 master_runner.cc:187] Error getting master registration for 127.2.70.126:40271: OK, instance_id { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" instance_seqno: 1779134654154679 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:04:18.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.069967  2486 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:04:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:18.090459  2518 tablet.cc:2404] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:18.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.257936  2573 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:18.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.258387  2573 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.260489  2573 leader_election.cc:290] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5aeb61d2c044cd4add3d9be4cecb7db (127.2.70.126:40271), 9afb93e6c8d043d2b6516fff9860d176 (127.2.70.125:40343)
20:04:18.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.412833  2484 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 7
20:04:18.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.433132  2484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: Bootstrap starting.
20:04:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.440634  2484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: Neither blocks nor log segments found. Creating new log.
20:04:18.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.442945  2484 log.cc:826] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: Log is configured to *not* fsync() on all Append() calls
20:04:18.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.453312  2484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: No bootstrap required, opened a new log
20:04:18.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.481586  2484 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.482483  2484 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.482771  2484 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9afb93e6c8d043d2b6516fff9860d176, State: Initialized, Role: FOLLOWER
20:04:18.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.483740  2484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.486464  2588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.487227  2588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.488536  2484 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: configured and running, proceeding with master startup.
20:04:18.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.488679  2459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21b59a479e024d14bcbf010c5935838e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9afb93e6c8d043d2b6516fff9860d176" is_pre_election: true
20:04:18.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.489537  2459 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b59a479e024d14bcbf010c5935838e in term 0.
20:04:18.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.491043  2515 leader_election.cc:304] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b59a479e024d14bcbf010c5935838e, 9afb93e6c8d043d2b6516fff9860d176; no voters: 
20:04:18.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.492157  2573 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:18.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.492635  2573 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:18.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.493067  2573 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 0 FOLLOWER]: Advancing to term 1
20:04:18.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.504832  2573 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.509919  2573 leader_election.cc:290] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [CANDIDATE]: Term 1 election: Requested vote from peers b5aeb61d2c044cd4add3d9be4cecb7db (127.2.70.126:40271), 9afb93e6c8d043d2b6516fff9860d176 (127.2.70.125:40343)
20:04:18.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.510608  2459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21b59a479e024d14bcbf010c5935838e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9afb93e6c8d043d2b6516fff9860d176"
20:04:18.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.511209  2459 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 0 FOLLOWER]: Advancing to term 1
20:04:18.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.523360  2459 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b59a479e024d14bcbf010c5935838e in term 1.
20:04:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.524951  2515 leader_election.cc:304] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b59a479e024d14bcbf010c5935838e, 9afb93e6c8d043d2b6516fff9860d176; no voters: 
20:04:18.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.526503  2573 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 1 FOLLOWER]: Leader election won for term 1
20:04:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.528584  2573 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [term 1 LEADER]: Becoming Leader. State: Replica: 21b59a479e024d14bcbf010c5935838e, State: Running, Role: LEADER
20:04:18.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.529568  2573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.542527  2594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21b59a479e024d14bcbf010c5935838e. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.545890  2594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: This master's current role is: LEADER
20:04:18.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.556878  2600 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:18.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.564780  2600 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:18.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.566587  2602 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:04:18.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.589762  2459 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Refusing update from remote peer 21b59a479e024d14bcbf010c5935838e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.591567  2594 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:18.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.570408  2411 master_runner.cc:187] Error getting master registration for 127.2.70.126:40271: OK, instance_id { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" instance_seqno: 1779134654154679 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:04:18.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.614355  2411 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:04:18.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.627624  2588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21b59a479e024d14bcbf010c5935838e. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.628925  2588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.631283  2603 mvcc.cc:204] Tried to move back new op lower bound from 7287335561554456576 to 7287335561349070848. Current Snapshot: MvccSnapshot[applied={T|T < 7287335561554456576}]
20:04:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.643455  2573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.644274  2573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: This master's current role is: LEADER
20:04:18.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.645733  2600 catalog_manager.cc:1382] Generated new cluster ID: cdd9242d737b4c8299e8bfcedb94a043
20:04:18.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.646014  2600 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:18.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.655606  2588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.656347  2588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: This master's current role is: FOLLOWER
20:04:18.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.678205  2600 catalog_manager.cc:1405] Generated new certificate authority record
20:04:18.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.681690  2600 catalog_manager.cc:1539] Loading token signing keys...
20:04:18.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.717290  2600 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e: Generated new TSK 0
20:04:18.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.718497  2600 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.752995  2329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/logs
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data/info.pb
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.65:0
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.70.65
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.65
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:18.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:18.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:18.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.841212  2409 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } attempt: 7
20:04:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.864776  2409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: Bootstrap starting.
20:04:18.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.872257  2409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: Neither blocks nor log segments found. Creating new log.
20:04:18.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.875108  2409 log.cc:826] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: Log is configured to *not* fsync() on all Append() calls
20:04:18.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.884956  2409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: No bootstrap required, opened a new log
20:04:18.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.921265  2409 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.922461  2409 raft_consensus.cc:385] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:18.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.923059  2409 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5aeb61d2c044cd4add3d9be4cecb7db, State: Initialized, Role: FOLLOWER
20:04:18.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.924371  2409 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:18.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.936213  2409 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: configured and running, proceeding with master startup.
20:04:18.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.936376  2383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21b59a479e024d14bcbf010c5935838e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db"
20:04:18.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.937191  2383 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 0 FOLLOWER]: Advancing to term 1
20:04:18.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.943078  2384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21b59a479e024d14bcbf010c5935838e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" is_pre_election: true
20:04:18.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.948870  2383 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b59a479e024d14bcbf010c5935838e in term 1.
20:04:18.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.952411  2382 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Refusing update from remote peer 21b59a479e024d14bcbf010c5935838e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:18.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.959283  2594 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:18.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.961951  2611 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:18.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:18.962788  2611 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: This master's current role is: FOLLOWER
20:04:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.038722  2619 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.039568  2619 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: This master's current role is: FOLLOWER
20:04:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.040640  2611 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21b59a479e024d14bcbf010c5935838e. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.041301  2611 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: This master's current role is: FOLLOWER
20:04:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.122820  2627 catalog_manager.cc:1294] Loaded cluster ID: cdd9242d737b4c8299e8bfcedb94a043
20:04:19.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.123162  2627 catalog_manager.cc:1587] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: loading cluster ID for follower catalog manager: success
20:04:19.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.131024  2627 catalog_manager.cc:1609] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: acquiring CA information for follower catalog manager: success
20:04:19.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.136631  2627 catalog_manager.cc:1637] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:19.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.230420  2608 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:19.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.231392  2608 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:19.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.232263  2608 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:19.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.274013  2608 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:19.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.275043  2608 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.70.65
20:04:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.315727  2608 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.65:0
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data/info.pb
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.65
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.70.65
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/logs
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.317528  2608 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:19.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.320024  2608 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:19.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.334959  2634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:19.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.541090  2594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21b59a479e024d14bcbf010c5935838e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:19.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.542266  2594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21b59a479e024d14bcbf010c5935838e [sys.catalog]: This master's current role is: LEADER
20:04:19.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.595286  2602 catalog_manager.cc:1294] Loaded cluster ID: cdd9242d737b4c8299e8bfcedb94a043
20:04:19.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.608278  2602 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: loading cluster ID for follower catalog manager: success
20:04:19.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.643419  2602 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: acquiring CA information for follower catalog manager: success
20:04:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:19.649863  2602 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:20.734690  2633 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 2608
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:20.837096  2633 kernel_stack_watchdog.cc:198] Thread 2608 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 385ms:
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:19.345525  2635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:20.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:20.842758  2608 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.495s	user 0.000s	sys 0.006s
20:04:20.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:20.843698  2608 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.496s	user 0.000s	sys 0.006s
20:04:20.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:20.844879  2637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:20.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.852348  2608 server_base.cc:1061] running on GCE node
20:04:20.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.854194  2608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:20.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.863914  2608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:20.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.871847  2608 hybrid_clock.cc:648] HybridClock initialized: now 1779134660871762 us; error 89 us; skew 500 ppm
20:04:20.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.873210  2608 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:20.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.903290  2608 webserver.cc:533] Webserver started at http://127.2.70.65:41385/ using document root <none> and password file <none>
20:04:20.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.904948  2608 fs_manager.cc:362] Metadata directory not provided
20:04:20.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.905417  2608 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:20.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.906150  2608 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:20.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.912930  2608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data/instance:
20:04:20.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c949e8bfb8b24981bfb9d773693eca1a"
20:04:20.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:20 on dist-test-slave-nsdw"
20:04:20.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.914625  2608 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal/instance:
20:04:20.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c949e8bfb8b24981bfb9d773693eca1a"
20:04:20.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:20 on dist-test-slave-nsdw"
20:04:20.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.937330  2608 fs_manager.cc:696] Time spent creating directory manager: real 0.022s	user 0.005s	sys 0.015s
20:04:20.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.950815  2648 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:20.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.952598  2608 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.006s	sys 0.005s
20:04:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.953270  2608 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal
20:04:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c949e8bfb8b24981bfb9d773693eca1a"
20:04:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:20 on dist-test-slave-nsdw"
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:20.953936  2608 fs_report.cc:389] FS layout report
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data/data
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:20.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.074402  2608 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:21.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.076385  2608 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:21.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.077013  2608 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:21.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.090823  2608 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:21.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.109567  2608 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:21.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.110184  2608 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
20:04:21.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.110677  2608 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:21.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.111063  2608 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:21.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.583053  2608 rpc_server.cc:307] RPC server started. Bound to: 127.2.70.65:38649
20:04:21.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.583194  2760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.70.65:38649 every 8 connection(s)
20:04:21.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.587281  2608 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/data/info.pb
20:04:21.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.591003  2329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2608
20:04:21.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.591593  2329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-0/wal/instance
20:04:21.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.607324  2329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/logs
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data/info.pb
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.66:0
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.70.66
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.66
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:21.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:21.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.637633  2761 heartbeater.cc:344] Connected to a master server at 127.2.70.124:41591
20:04:21.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.638165  2761 heartbeater.cc:461] Registering TS with master...
20:04:21.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.639580  2761 heartbeater.cc:507] Master 127.2.70.124:41591 requested a full tablet report, sending...
20:04:21.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.642817  2529 ts_manager.cc:194] Registered new tserver with Master: c949e8bfb8b24981bfb9d773693eca1a (127.2.70.65:38649)
20:04:21.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.645524  2529 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.70.65:34731
20:04:21.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.653450  2762 heartbeater.cc:344] Connected to a master server at 127.2.70.125:40343
20:04:21.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.653842  2762 heartbeater.cc:461] Registering TS with master...
20:04:21.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.654547  2762 heartbeater.cc:507] Master 127.2.70.125:40343 requested a full tablet report, sending...
20:04:21.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.657791  2449 ts_manager.cc:194] Registered new tserver with Master: c949e8bfb8b24981bfb9d773693eca1a (127.2.70.65:38649)
20:04:21.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.663154  2767 heartbeater.cc:344] Connected to a master server at 127.2.70.126:40271
20:04:21.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.663520  2767 heartbeater.cc:461] Registering TS with master...
20:04:21.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.664198  2767 heartbeater.cc:507] Master 127.2.70.126:40271 requested a full tablet report, sending...
20:04:21.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:21.667327  2374 ts_manager.cc:194] Registered new tserver with Master: c949e8bfb8b24981bfb9d773693eca1a (127.2.70.65:38649)
20:04:22.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.055804  2768 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:22.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.056833  2768 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:22.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.057770  2768 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:22.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.120048  2768 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:22.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.121745  2768 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.70.66
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.189888  2768 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:22.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.66:0
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data/info.pb
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.66
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.70.66
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/logs
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:22.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.194590  2768 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:22.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.197234  2768 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:22.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.228778  2779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:22.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:22.650108  2761 heartbeater.cc:499] Master 127.2.70.124:41591 was elected leader, sending a full tablet report...
20:04:23.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:22.232575  2780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.631688  2778 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 2768
20:04:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.816510  2768 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.586s	user 0.446s	sys 0.806s
20:04:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.817641  2781 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1585 milliseconds
20:04:23.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.818183  2768 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.588s	user 0.446s	sys 0.806s
20:04:23.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:23.818943  2782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:23.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.818902  2768 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:23.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.822714  2768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:23.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.825002  2768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:23.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.826372  2768 hybrid_clock.cc:648] HybridClock initialized: now 1779134663826305 us; error 76 us; skew 500 ppm
20:04:23.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.827306  2768 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:23.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.834273  2768 webserver.cc:533] Webserver started at http://127.2.70.66:46483/ using document root <none> and password file <none>
20:04:23.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.835325  2768 fs_manager.cc:362] Metadata directory not provided
20:04:23.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.835566  2768 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:23.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.836136  2768 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:23.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.840775  2768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data/instance:
20:04:23.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "eba5aaaaf4044618ab033fe0f4588508"
20:04:23.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:23 on dist-test-slave-nsdw"
20:04:23.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.841946  2768 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal/instance:
20:04:23.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "eba5aaaaf4044618ab033fe0f4588508"
20:04:23.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:23 on dist-test-slave-nsdw"
20:04:23.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.849033  2768 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.001s
20:04:23.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.854691  2791 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.855818  2768 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
20:04:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.856135  2768 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal
20:04:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "eba5aaaaf4044618ab033fe0f4588508"
20:04:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:23 on dist-test-slave-nsdw"
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.856563  2768 fs_report.cc:389] FS layout report
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data/data
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:23.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.919021  2768 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.920765  2768 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.921274  2768 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:23.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.924135  2768 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:23.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.928680  2768 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:23.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.928978  2768 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:23.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.929250  2768 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:23.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:23.929389  2768 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:24.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.066349  2768 rpc_server.cc:307] RPC server started. Bound to: 127.2.70.66:37675
20:04:24.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.066427  2903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.70.66:37675 every 8 connection(s)
20:04:24.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.069931  2768 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/data/info.pb
20:04:24.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.075536  2329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2768
20:04:24.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.076246  2329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-1/wal/instance
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.097846  2329 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:24.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/logs
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data/info.pb
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.67:0
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.70.67
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.67
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:24.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:24.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:24.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:24.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:24.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:24.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.127526  2905 heartbeater.cc:344] Connected to a master server at 127.2.70.125:40343
20:04:24.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.127624  2906 heartbeater.cc:344] Connected to a master server at 127.2.70.126:40271
20:04:24.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.128088  2905 heartbeater.cc:461] Registering TS with master...
20:04:24.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.128454  2906 heartbeater.cc:461] Registering TS with master...
20:04:24.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.129243  2904 heartbeater.cc:344] Connected to a master server at 127.2.70.124:41591
20:04:24.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.129588  2904 heartbeater.cc:461] Registering TS with master...
20:04:24.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.129710  2906 heartbeater.cc:507] Master 127.2.70.126:40271 requested a full tablet report, sending...
20:04:24.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.130468  2904 heartbeater.cc:507] Master 127.2.70.124:41591 requested a full tablet report, sending...
20:04:24.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.129607  2905 heartbeater.cc:507] Master 127.2.70.125:40343 requested a full tablet report, sending...
20:04:24.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.132709  2529 ts_manager.cc:194] Registered new tserver with Master: eba5aaaaf4044618ab033fe0f4588508 (127.2.70.66:37675)
20:04:24.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.133073  2374 ts_manager.cc:194] Registered new tserver with Master: eba5aaaaf4044618ab033fe0f4588508 (127.2.70.66:37675)
20:04:24.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.133481  2449 ts_manager.cc:194] Registered new tserver with Master: eba5aaaaf4044618ab033fe0f4588508 (127.2.70.66:37675)
20:04:24.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.134457  2529 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.70.66:53461
20:04:24.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.419571  2914 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:24.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.420104  2914 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:24.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.420499  2914 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:24.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.453989  2914 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:24.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.454747  2914 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.70.67
20:04:24.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.491434  2914 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.2.70.84:44167
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.2.70.67:0
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data/info.pb
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.2.70.67
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.2.70.126:40271,127.2.70.125:40343,127.2.70.124:41591
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.2.70.67
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/logs
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:24.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.492838  2914 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:24.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:24.494395  2914 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:24.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.508890  2921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:25.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.137440  2904 heartbeater.cc:499] Master 127.2.70.124:41591 was elected leader, sending a full tablet report...
20:04:25.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:24.509447  2922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:25.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.764123  2914 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.257s	user 0.450s	sys 0.800s
20:04:25.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.764500  2914 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.257s	user 0.450s	sys 0.800s
20:04:25.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.766055  2914 server_base.cc:1061] running on GCE node
20:04:25.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:25.768057  2926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:25.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.769471  2914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:25.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.771821  2914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:25.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.773222  2914 hybrid_clock.cc:648] HybridClock initialized: now 1779134665773178 us; error 49 us; skew 500 ppm
20:04:25.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.774125  2914 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:25.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.781967  2914 webserver.cc:533] Webserver started at http://127.2.70.67:33417/ using document root <none> and password file <none>
20:04:25.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.783066  2914 fs_manager.cc:362] Metadata directory not provided
20:04:25.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.783324  2914 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:25.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.783867  2914 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.788328  2914 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data/instance:
20:04:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9f55de686a284a1ba984def2e418df17"
20:04:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:25 on dist-test-slave-nsdw"
20:04:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.789547  2914 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal/instance:
20:04:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9f55de686a284a1ba984def2e418df17"
20:04:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:25 on dist-test-slave-nsdw"
20:04:25.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.798925  2914 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.005s
20:04:25.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.805028  2931 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:25.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.806257  2914 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.806653  2914 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9f55de686a284a1ba984def2e418df17"
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:25 on dist-test-slave-nsdw"
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.807137  2914 fs_report.cc:389] FS layout report
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data/data
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:25.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.876346  2914 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:25.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.877938  2914 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:25.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.878456  2914 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:25.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.881172  2914 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:25.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.885326  2914 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:25.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.885567  2914 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:25.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.885910  2914 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:25.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:25.886104  2914 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:26.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.026423  2914 rpc_server.cc:307] RPC server started. Bound to: 127.2.70.67:40489
20:04:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.026567  3043 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.70.67:40489 every 8 connection(s)
20:04:26.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.029392  2914 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/data/info.pb
20:04:26.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.034093  2329 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 2914
20:04:26.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.034657  2329 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster3036285502164440083/ts-2/wal/instance
20:04:26.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.090281  3045 heartbeater.cc:344] Connected to a master server at 127.2.70.125:40343
20:04:26.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.090791  3045 heartbeater.cc:461] Registering TS with master...
20:04:26.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.091745  3044 heartbeater.cc:344] Connected to a master server at 127.2.70.124:41591
20:04:26.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.092144  3044 heartbeater.cc:461] Registering TS with master...
20:04:26.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.092245  3045 heartbeater.cc:507] Master 127.2.70.125:40343 requested a full tablet report, sending...
20:04:26.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.093142  3044 heartbeater.cc:507] Master 127.2.70.124:41591 requested a full tablet report, sending...
20:04:26.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.095290  2449 ts_manager.cc:194] Registered new tserver with Master: 9f55de686a284a1ba984def2e418df17 (127.2.70.67:40489)
20:04:26.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.096644  2529 ts_manager.cc:194] Registered new tserver with Master: 9f55de686a284a1ba984def2e418df17 (127.2.70.67:40489)
20:04:26.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.096997  3046 heartbeater.cc:344] Connected to a master server at 127.2.70.126:40271
20:04:26.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.097309  3046 heartbeater.cc:461] Registering TS with master...
20:04:26.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.098068  3046 heartbeater.cc:507] Master 127.2.70.126:40271 requested a full tablet report, sending...
20:04:26.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.098280  2529 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.2.70.67:34231
20:04:26.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.100574  2374 ts_manager.cc:194] Registered new tserver with Master: 9f55de686a284a1ba984def2e418df17 (127.2.70.67:40489)
20:04:26.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.110888  2329 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
20:04:26.122 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:26.123 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:04:26.126 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.70.126"
      port: 40271
    }
    bound_http_address {
      host: "127.2.70.126"
      port: 45283
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.70.125"
      port: 40343
    }
    bound_http_address {
      host: "127.2.70.125"
      port: 45291
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.70.124"
      port: 41591
    }
    bound_http_address {
      host: "127.2.70.124"
      port: 34687
    }
  }
}

20:04:26.126 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:04:26.128 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.2.70.65"
      port: 38649
    }
    bound_http_address {
      host: "127.2.70.65"
      port: 41385
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.2.70.66"
      port: 37675
    }
    bound_http_address {
      host: "127.2.70.66"
      port: 46483
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.2.70.67"
      port: 40489
    }
    bound_http_address {
      host: "127.2.70.67"
      port: 33417
    }
  }
}

20:04:26.128 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:04:26.130 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:26.132 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.2.70.125:40343(127.2.70.125:40343)] connecting to peer
20:04:26.133 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.134 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.2.70.125:40343(127.2.70.125:40343)] Successfully connected to peer
20:04:26.137 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.70.125
20:04:26.138 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.2.70.126:40271(127.2.70.126:40271)] connecting to peer
20:04:26.139 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.2.70.124:41591(127.2.70.124:41591)] Successfully connected to peer
20:04:26.146 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.70.124
20:04:26.154 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.2.70.126:40271(127.2.70.126:40271)] Successfully connected to peer
20:04:26.159 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x11d8b6d3, L:/127.0.0.1:45400 - R:/127.2.70.125:40343] using SASL/PLAIN
20:04:26.168 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.2.70.126
20:04:26.174 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x18f31705, L:/127.0.0.1:60896 - R:/127.2.70.124:41591] using SASL/PLAIN
20:04:26.190 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:26.191 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=59), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [32ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [58ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: OK, deferred=null) after lookup
20:04:26.210 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb070155a, L:/127.0.0.1:36608 - R:/127.2.70.126:40271] using SASL/PLAIN
20:04:26.212 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.2.70.124:41591
20:04:26.212 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:04:26.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:26.212857  2329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2486
20:04:26.248 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.2.70.124:41591(127.2.70.124:41591)] handling channelInactive
20:04:26.248 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state READY due to: connection closed
20:04:26.250 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:26.253 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:26.254 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.256 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.256 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.2.70.124:41591(127.2.70.124:41591) for tablet Kudu Master: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.273 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.277 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.277 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.277 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.279 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.293 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.296 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.298 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.313 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.315 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.315 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.317 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.332 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.337 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.373 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.377 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.432 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.434 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.435 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.435 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.437 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.492 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.495 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.495 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.497 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.501 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.592 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.597 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:26.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:26.675947  2761 heartbeater.cc:646] Failed to heartbeat to 127.2.70.124:41591 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:26.693 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:26.694 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.694 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:26.697 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:27.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.102211  3044 heartbeater.cc:499] Master 127.2.70.124:41591 was elected leader, sending a full tablet report...
20:04:27.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.106094  3044 heartbeater.cc:646] Failed to heartbeat to 127.2.70.124:41591 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:27.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.152288  2904 heartbeater.cc:646] Failed to heartbeat to 127.2.70.124:41591 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.315810  3068 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21b59a479e024d14bcbf010c5935838e)
20:04:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.316326  3068 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.318364  3068 leader_election.cc:290] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5aeb61d2c044cd4add3d9be4cecb7db (127.2.70.126:40271), 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591)
20:04:27.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.319416  2382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9afb93e6c8d043d2b6516fff9860d176" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" is_pre_election: true
20:04:27.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.320955  2436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:04:27.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.323729  2436 leader_election.cc:336] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591): Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:27.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.324090  2436 leader_election.cc:304] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9afb93e6c8d043d2b6516fff9860d176; no voters: 21b59a479e024d14bcbf010c5935838e, b5aeb61d2c044cd4add3d9be4cecb7db
20:04:27.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.324782  3068 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:04:27.392 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:27.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:27.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:27.394 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:27.396 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271; will retry
20:04:27.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.691835  3072 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21b59a479e024d14bcbf010c5935838e)
20:04:27.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.692229  3072 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:27.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.693971  3072 leader_election.cc:290] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9afb93e6c8d043d2b6516fff9860d176 (127.2.70.125:40343), 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591)
20:04:27.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.694903  2459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9afb93e6c8d043d2b6516fff9860d176" is_pre_election: true
20:04:27.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.695513  2459 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5aeb61d2c044cd4add3d9be4cecb7db in term 1.
20:04:27.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.696266  2361 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111) [suppressed 13 similar messages]
20:04:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.696593  2360 leader_election.cc:304] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9afb93e6c8d043d2b6516fff9860d176, b5aeb61d2c044cd4add3d9be4cecb7db; no voters: 
20:04:27.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.697407  3072 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:27.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.697717  3072 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21b59a479e024d14bcbf010c5935838e)
20:04:27.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.698087  3072 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 1 FOLLOWER]: Advancing to term 2
20:04:27.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.699605  2361 leader_election.cc:336] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591): Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:27.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.704074  3072 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:27.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.705559  3072 leader_election.cc:290] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [CANDIDATE]: Term 2 election: Requested vote from peers 9afb93e6c8d043d2b6516fff9860d176 (127.2.70.125:40343), 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591)
20:04:27.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.706233  2459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9afb93e6c8d043d2b6516fff9860d176"
20:04:27.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.706684  2459 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 1 FOLLOWER]: Advancing to term 2
20:04:27.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:27.708645  2361 leader_election.cc:336] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591): Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111)
20:04:27.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.712702  2459 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5aeb61d2c044cd4add3d9be4cecb7db in term 2.
20:04:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.713804  2360 leader_election.cc:304] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9afb93e6c8d043d2b6516fff9860d176, b5aeb61d2c044cd4add3d9be4cecb7db; no voters: 21b59a479e024d14bcbf010c5935838e
20:04:27.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.714461  3072 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 2 FOLLOWER]: Leader election won for term 2
20:04:27.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.715415  3072 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [term 2 LEADER]: Becoming Leader. State: Replica: b5aeb61d2c044cd4add3d9be4cecb7db, State: Running, Role: LEADER
20:04:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.716230  3072 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } }
20:04:27.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.720463  3075 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5aeb61d2c044cd4add3d9be4cecb7db. Latest consensus state: current_term: 2 leader_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:27.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.721273  3075 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: This master's current role is: LEADER
20:04:27.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.723145  3077 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:27.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.728487  3077 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:27.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.731153  3077 catalog_manager.cc:1294] Loaded cluster ID: cdd9242d737b4c8299e8bfcedb94a043
20:04:27.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.731367  3077 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.734436  3077 catalog_manager.cc:1539] Loading token signing keys...
20:04:27.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.736896  3077 catalog_manager.cc:6080] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db: Loaded TSK: 0
20:04:27.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:27.737960  3077 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.301183  2361 consensus_peers.cc:597] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db -> Peer 21b59a479e024d14bcbf010c5935838e (127.2.70.124:41591): Couldn't send request to peer 21b59a479e024d14bcbf010c5935838e. Status: Network error: Client connection negotiation failed: client connection to 127.2.70.124:41591: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:04:28.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.323390  2459 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [term 2 FOLLOWER]: Refusing update from remote peer b5aeb61d2c044cd4add3d9be4cecb7db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
20:04:28.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.324885  3080 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
20:04:28.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.329820  3083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5aeb61d2c044cd4add3d9be4cecb7db. Latest consensus state: current_term: 2 leader_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:28.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.330571  3083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: This master's current role is: FOLLOWER
20:04:28.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.334373  3085 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:28.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.334923  3085 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5aeb61d2c044cd4add3d9be4cecb7db [sys.catalog]: This master's current role is: LEADER
20:04:28.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.335945  3083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5aeb61d2c044cd4add3d9be4cecb7db" member_type: VOTER last_known_addr { host: "127.2.70.126" port: 40271 } } peers { permanent_uuid: "9afb93e6c8d043d2b6516fff9860d176" member_type: VOTER last_known_addr { host: "127.2.70.125" port: 40343 } } peers { permanent_uuid: "21b59a479e024d14bcbf010c5935838e" member_type: VOTER last_known_addr { host: "127.2.70.124" port: 41591 } } }
20:04:28.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.336863  3083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9afb93e6c8d043d2b6516fff9860d176 [sys.catalog]: This master's current role is: FOLLOWER
20:04:28.873 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.2.70.124:41591(127.2.70.124:41591)] connecting to peer
20:04:28.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:28.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.2.70.124:41591(127.2.70.124:41591)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:28.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.2.70.124:41591: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591
20:04:28.879 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:28.880 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=50000, elapsed=2625), Traces: [0ms] sending RPC to server master-127.2.70.124:41591, [2ms] received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [18ms] refreshing cache from master, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [22ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [25ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [25ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [37ms] refreshing cache from master, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [43ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [44ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [58ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [61ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [62ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [63ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [77ms] refreshing cache from master, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [81ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [81ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [83ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [118ms] refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [121ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [122ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [123ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [124ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [178ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [181ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [182ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [183ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [183ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [237ms] refreshing cache from master, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [243ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [243ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [246ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [247ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [337ms] refreshing cache from master, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [339ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [340ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [342ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [342ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [343ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [438ms] refreshing cache from master, [438ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [441ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [442ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [443ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [443ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [1137ms] refreshing cache from master, [1138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [1138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [1139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [1140ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, [1143ms] delaying RPC due to: Service unavailable: Master config (127.2.70.125:40343,127.2.70.124:41591,127.2.70.126:40271) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [2618ms] refreshing cache from master, [2618ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.125:40343, [2619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.124:41591, [2619ms] Sub RPC ConnectToMaster: sending RPC to server master-127.2.70.126:40271, [2620ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.124:41591: Network error: Failed to connect to peer master-127.2.70.124:41591(127.2.70.124:41591): Connection refused: /127.2.70.124:41591, [2623ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.125:40343: OK, [2624ms] Sub RPC ConnectToMaster: received response from server master-127.2.70.126:40271: OK, deferred=Deferred@44784461(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$197/0x00007f8c3c2867e8@6b2e235d -> org.apache.kudu.client.AsyncKuduClient$$Lambda$198/0x00007f8c3c286d90@5919e64a -> wakeup thread Time-limited test -> (continuation of Deferred@1582103800 after retry RPC after error@115713359) -> (continuation of Deferred@474700293 after retry RPC after error@183948400) -> (continuation of Deferred@870597354 after retry RPC after error@402671108) -> (continuation of Deferred@1583201395 after retry RPC after error@1656010396) -> (continuation of Deferred@1943423794 after retry RPC after error@1769739050) -> (continuation of Deferred@1517392978 after retry RPC after error@490129878) -> (continuation of Deferred@1551408793 after retry RPC after error@1435771775) -> (continuation of Deferred@59895451 after retry RPC after error@675475270) -> (continuation of Deferred@819339393 after retry RPC after error@1143824959) -> (continuation of Deferred@1212459287 after retry RPC after error@2009286534), errback=passthrough -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1582103800 after retry RPC after error@115713359) -> (continuation of Deferred@474700293 after retry RPC after error@183948400) -> (continuation of Deferred@870597354 after retry RPC after error@402671108) -> (continuation of Deferred@1583201395 after retry RPC after error@1656010396) -> (continuation of Deferred@1943423794 after retry RPC after error@1769739050) -> (continuation of Deferred@1517392978 after retry RPC after error@490129878) -> (continuation of Deferred@1551408793 after retry RPC after error@1435771775) -> (continuation of Deferred@59895451 after retry RPC after error@675475270) -> (continuation of Deferred@819339393 after retry RPC after error@1143824959) -> (continuation of Deferred@1212459287 after retry RPC after error@2009286534))) after lookup
20:04:28.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.883858  2374 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36608:
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=CREATE_CLIENT"
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:28.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:04:28.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:28.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:28.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:28.907891  2374 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=CREATE_CLIENT in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:04:28.935 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table c9db7c007975407182101dc8f13ec638
20:04:28.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.965303  2979 tablet_service.cc:1511] Processing CreateTablet for tablet d024108c9d8f4a0a86b960763d55da30 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=c9db7c007975407182101dc8f13ec638]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:28.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.967281  2979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d024108c9d8f4a0a86b960763d55da30. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:28.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.979353  2696 tablet_service.cc:1511] Processing CreateTablet for tablet d024108c9d8f4a0a86b960763d55da30 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=c9db7c007975407182101dc8f13ec638]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:28.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.980037  2839 tablet_service.cc:1511] Processing CreateTablet for tablet d024108c9d8f4a0a86b960763d55da30 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=c9db7c007975407182101dc8f13ec638]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:28.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.981267  2696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d024108c9d8f4a0a86b960763d55da30. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:28.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.981742  2839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d024108c9d8f4a0a86b960763d55da30. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:28.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.989899  3101 tablet_bootstrap.cc:492] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: Bootstrap starting.
20:04:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:28.998144  3101 tablet_bootstrap.cc:654] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: Neither blocks nor log segments found. Creating new log.
20:04:29.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.000073  3101 log.cc:826] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: Log is configured to *not* fsync() on all Append() calls
20:04:29.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.005384  3101 tablet_bootstrap.cc:492] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: No bootstrap required, opened a new log
20:04:29.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.005875  3101 ts_tablet_manager.cc:1403] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
20:04:29.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.008885  3103 tablet_bootstrap.cc:492] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: Bootstrap starting.
20:04:29.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.012379  3104 tablet_bootstrap.cc:492] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: Bootstrap starting.
20:04:29.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.017447  3103 tablet_bootstrap.cc:654] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: Neither blocks nor log segments found. Creating new log.
20:04:29.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.019805  3103 log.cc:826] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: Log is configured to *not* fsync() on all Append() calls
20:04:29.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.020295  3104 tablet_bootstrap.cc:654] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: Neither blocks nor log segments found. Creating new log.
20:04:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.022589  3104 log.cc:826] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: Log is configured to *not* fsync() on all Append() calls
20:04:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.025648  3103 tablet_bootstrap.cc:492] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: No bootstrap required, opened a new log
20:04:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.026362  3103 ts_tablet_manager.cc:1403] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
20:04:29.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.036329  3101 raft_consensus.cc:359] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.037247  3101 raft_consensus.cc:385] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:29.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.037539  3101 raft_consensus.cc:740] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f55de686a284a1ba984def2e418df17, State: Initialized, Role: FOLLOWER
20:04:29.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.038498  3101 consensus_queue.cc:260] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.039776  3104 tablet_bootstrap.cc:492] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: No bootstrap required, opened a new log
20:04:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.040347  3104 ts_tablet_manager.cc:1403] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.013s
20:04:29.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.049185  3101 ts_tablet_manager.cc:1434] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: Time spent starting tablet: real 0.043s	user 0.031s	sys 0.009s
20:04:29.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.060495  3046 heartbeater.cc:499] Master 127.2.70.126:40271 was elected leader, sending a full tablet report...
20:04:29.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.063958  3103 raft_consensus.cc:359] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.065287  3103 raft_consensus.cc:385] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:29.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.065768  3103 raft_consensus.cc:740] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c949e8bfb8b24981bfb9d773693eca1a, State: Initialized, Role: FOLLOWER
20:04:29.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.066964  3103 consensus_queue.cc:260] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.068817  3050 tablet.cc:2404] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:29.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.079493  3103 ts_tablet_manager.cc:1434] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: Time spent starting tablet: real 0.053s	user 0.028s	sys 0.013s
20:04:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.093788  2767 heartbeater.cc:499] Master 127.2.70.126:40271 was elected leader, sending a full tablet report...
20:04:29.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.097813  3104 raft_consensus.cc:359] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.098676  3104 raft_consensus.cc:385] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.104185  3104 raft_consensus.cc:740] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eba5aaaaf4044618ab033fe0f4588508, State: Initialized, Role: FOLLOWER
20:04:29.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.105499  3104 consensus_queue.cc:260] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.115012  3104 ts_tablet_manager.cc:1434] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: Time spent starting tablet: real 0.074s	user 0.031s	sys 0.009s
20:04:29.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.116439  2906 heartbeater.cc:499] Master 127.2.70.126:40271 was elected leader, sending a full tablet report...
20:04:29.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.143395  2770 tablet.cc:2404] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:29.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.210992  3107 raft_consensus.cc:493] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:29.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.211583  3107 raft_consensus.cc:515] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.214628  3107 leader_election.cc:290] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eba5aaaaf4044618ab033fe0f4588508 (127.2.70.66:37675), c949e8bfb8b24981bfb9d773693eca1a (127.2.70.65:38649)
20:04:29.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.225854  2859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d024108c9d8f4a0a86b960763d55da30" candidate_uuid: "9f55de686a284a1ba984def2e418df17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eba5aaaaf4044618ab033fe0f4588508" is_pre_election: true
20:04:29.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.226317  2716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d024108c9d8f4a0a86b960763d55da30" candidate_uuid: "9f55de686a284a1ba984def2e418df17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c949e8bfb8b24981bfb9d773693eca1a" is_pre_election: true
20:04:29.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.226652  2859 raft_consensus.cc:2468] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f55de686a284a1ba984def2e418df17 in term 0.
20:04:29.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.227301  2716 raft_consensus.cc:2468] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f55de686a284a1ba984def2e418df17 in term 0.
20:04:29.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.228041  2934 leader_election.cc:304] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f55de686a284a1ba984def2e418df17, eba5aaaaf4044618ab033fe0f4588508; no voters: 
20:04:29.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.228955  3107 raft_consensus.cc:2804] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:29.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.229298  3107 raft_consensus.cc:493] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:29.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.229516  3107 raft_consensus.cc:3060] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 0 FOLLOWER]: Advancing to term 1
20:04:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.234119  3107 raft_consensus.cc:515] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.235625  3107 leader_election.cc:290] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [CANDIDATE]: Term 1 election: Requested vote from peers eba5aaaaf4044618ab033fe0f4588508 (127.2.70.66:37675), c949e8bfb8b24981bfb9d773693eca1a (127.2.70.65:38649)
20:04:29.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.236375  2859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d024108c9d8f4a0a86b960763d55da30" candidate_uuid: "9f55de686a284a1ba984def2e418df17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eba5aaaaf4044618ab033fe0f4588508"
20:04:29.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.236647  2716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d024108c9d8f4a0a86b960763d55da30" candidate_uuid: "9f55de686a284a1ba984def2e418df17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c949e8bfb8b24981bfb9d773693eca1a"
20:04:29.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.236833  2859 raft_consensus.cc:3060] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [term 0 FOLLOWER]: Advancing to term 1
20:04:29.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.237035  2716 raft_consensus.cc:3060] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [term 0 FOLLOWER]: Advancing to term 1
20:04:29.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.241580  2859 raft_consensus.cc:2468] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f55de686a284a1ba984def2e418df17 in term 1.
20:04:29.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.241737  2716 raft_consensus.cc:2468] T d024108c9d8f4a0a86b960763d55da30 P c949e8bfb8b24981bfb9d773693eca1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f55de686a284a1ba984def2e418df17 in term 1.
20:04:29.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.242782  2934 leader_election.cc:304] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9f55de686a284a1ba984def2e418df17, c949e8bfb8b24981bfb9d773693eca1a, eba5aaaaf4044618ab033fe0f4588508; no voters: 
20:04:29.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.243624  3107 raft_consensus.cc:2804] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 1 FOLLOWER]: Leader election won for term 1
20:04:29.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.245440  3107 raft_consensus.cc:697] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [term 1 LEADER]: Becoming Leader. State: Replica: 9f55de686a284a1ba984def2e418df17, State: Running, Role: LEADER
20:04:29.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.246346  3107 consensus_queue.cc:237] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } }
20:04:29.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.257455  2374 catalog_manager.cc:5696] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f55de686a284a1ba984def2e418df17 (127.2.70.67). New cstate: current_term: 1 leader_uuid: "9f55de686a284a1ba984def2e418df17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f55de686a284a1ba984def2e418df17" member_type: VOTER last_known_addr { host: "127.2.70.67" port: 40489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 } health_report { overall_health: UNKNOWN } } }
20:04:29.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.355623  2909 tablet.cc:2404] T d024108c9d8f4a0a86b960763d55da30 P eba5aaaaf4044618ab033fe0f4588508: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:29.579 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table c9db7c007975407182101dc8f13ec638
20:04:29.584 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d024108c9d8f4a0a86b960763d55da30 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
20:04:29.584 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d024108c9d8f4a0a86b960763d55da30@[9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)[L],c949e8bfb8b24981bfb9d773693eca1a(127.2.70.65:38649),eba5aaaaf4044618ab033fe0f4588508(127.2.70.66:37675)]}]
20:04:29.584 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.70.126:40271, [5ms] Sub RPC GetTableLocations: received response from server master-127.2.70.126:40271: OK, deferred=null)) after lookup
20:04:29.585 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)] connecting to peer
20:04:29.586 [DEBUG - kudu-nio-7] (Connection.java:757) [peer 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)] Successfully connected to peer
20:04:29.612 [DEBUG - kudu-nio-7] (Negotiator.java:919) Authenticated connection [id: 0xf81cddcc, L:/127.0.0.1:49184 - R:/127.2.70.67:40489] using TOKEN/null
20:04:29.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.616662  2959 tablet_service.cc:3018] Rejecting scan request for tablet d024108c9d8f4a0a86b960763d55da30: Uninitialized: clean time has not yet been initialized
20:04:29.626 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489) for tablet d024108c9d8f4a0a86b960763d55da30: clean time has not yet been initialized
20:04:29.636 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d024108c9d8f4a0a86b960763d55da30 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
20:04:29.637 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d024108c9d8f4a0a86b960763d55da30@[9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)[L],c949e8bfb8b24981bfb9d773693eca1a(127.2.70.65:38649),eba5aaaaf4044618ab033fe0f4588508(127.2.70.66:37675)]}]
20:04:29.638 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d024108c9d8f4a0a86b960763d55da30, attempt=3, KuduRpc(method=Scan, tablet=d024108c9d8f4a0a86b960763d55da30, attempt=3, TimeoutTracker(timeout=30000, elapsed=58), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.70.126:40271, [5ms] Sub RPC GetTableLocations: received response from server master-127.2.70.126:40271: OK, [6ms] sending RPC to server 9f55de686a284a1ba984def2e418df17, [47ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [47ms] received response from server 9f55de686a284a1ba984def2e418df17: Uninitialized: clean time has not yet been initialized (error 0), [53ms] refreshing cache from master, [53ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.70.126:40271, [57ms] Sub RPC GetTableLocations: received response from server master-127.2.70.126:40271: OK, deferred=Deferred@1508934635(state=PENDING, result=null, callback=(continuation of Deferred@713919769 after retry RPC@1804754275), errback=(continuation of Deferred@713919769 after retry RPC@1804754275)))) after lookup
20:04:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:29.641417  2959 tablet_service.cc:3018] Rejecting scan request for tablet d024108c9d8f4a0a86b960763d55da30: Uninitialized: clean time has not yet been initialized
20:04:29.643 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489) for tablet d024108c9d8f4a0a86b960763d55da30: clean time has not yet been initialized
20:04:29.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.645177  3107 consensus_queue.cc:1048] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c949e8bfb8b24981bfb9d773693eca1a" member_type: VOTER last_known_addr { host: "127.2.70.65" port: 38649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:29.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.668125  3107 consensus_queue.cc:1048] T d024108c9d8f4a0a86b960763d55da30 P 9f55de686a284a1ba984def2e418df17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eba5aaaaf4044618ab033fe0f4588508" member_type: VOTER last_known_addr { host: "127.2.70.66" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:29.679 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d024108c9d8f4a0a86b960763d55da30 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
20:04:29.679 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d024108c9d8f4a0a86b960763d55da30@[9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)[L],c949e8bfb8b24981bfb9d773693eca1a(127.2.70.65:38649),eba5aaaaf4044618ab033fe0f4588508(127.2.70.66:37675)]}]
20:04:29.680 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d024108c9d8f4a0a86b960763d55da30, attempt=5, KuduRpc(method=Scan, tablet=d024108c9d8f4a0a86b960763d55da30, attempt=5, TimeoutTracker(timeout=30000, elapsed=100), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.70.126:40271, [5ms] Sub RPC GetTableLocations: received response from server master-127.2.70.126:40271: OK, [6ms] sending RPC to server 9f55de686a284a1ba984def2e418df17, [47ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [47ms] received response from server 9f55de686a284a1ba984def2e418df17: Uninitialized: clean time has not yet been initialized (error 0), [53ms] refreshing cache from master, [53ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.70.126:40271, [57ms] Sub RPC GetTableLocations: received response from server master-127.2.70.126:40271: OK, [59ms] sending RPC to server 9f55de686a284a1ba984def2e418df17, [65ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [65ms] received response from server 9f55de686a284a1ba984def2e418df17: Uninitialized: clean time has not yet been initialized (error 0), [93ms] refreshing cache from master, [93ms] Sub RPC GetTableLocations: sending RPC to server master-127.2.70.126:40271, [98ms] Sub RPC GetTableLocations: received response from server master-127.2.70.126:40271: OK, deferred=Deferred@1508934635(state=PENDING, result=null, callback=(continuation of Deferred@713919769 after retry RPC@1804754275) -> (continuation of Deferred@311090813 after retry RPC@1420389488), errback=(continuation of Deferred@713919769 after retry RPC@1804754275) -> (continuation of Deferred@311090813 after retry RPC@1420389488)))) after lookup
20:04:29.695 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=CREATE_CLIENT, tablet=d024108c9d8f4a0a86b960763d55da30, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:29.698 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:29.706 [DEBUG - main] (Connection.java:575) [peer master-127.2.70.124:41591(127.2.70.124:41591)] disconnecting while in state TERMINATED
20:04:29.706 [DEBUG - main] (Connection.java:575) [peer master-127.2.70.125:40343(127.2.70.125:40343)] disconnecting while in state READY
20:04:29.706 [DEBUG - main] (Connection.java:575) [peer 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)] disconnecting while in state READY
20:04:29.706 [DEBUG - main] (Connection.java:575) [peer master-127.2.70.126:40271(127.2.70.126:40271)] disconnecting while in state READY
20:04:29.707 [DEBUG - kudu-nio-7] (Connection.java:239) [peer 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)] handling channelInactive
20:04:29.707 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.2.70.126:40271(127.2.70.126:40271)] handling channelInactive
20:04:29.707 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.2.70.125:40343(127.2.70.125:40343)] handling channelInactive
20:04:29.707 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 9f55de686a284a1ba984def2e418df17(127.2.70.67:40489)] cleaning up while in state READY due to: connection closed
20:04:29.707 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.2.70.125:40343(127.2.70.125:40343)] cleaning up while in state READY due to: connection closed
20:04:29.708 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:29.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.2.70.126:40271(127.2.70.126:40271)] cleaning up while in state READY due to: connection closed
20:04:29.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.710310  2329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2608
20:04:29.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.741349  2329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2768
20:04:29.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.770175  2329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2914
20:04:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.794812  2329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2341
20:04:29.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:29.824138  2329 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 2411
20:04:31.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:30Z chronyd exiting
.20:04:32.075 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779134672075
20:04:32.078 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:04:32.079 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:04:32.079 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskP4R3uz/test-tmp
20:04:32.079 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:04:32.079 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskP4R3uz/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:04:32.082 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:04:32.406 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:32.406 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:04:32.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.409577  3138 mini_oidc.cc:150] Starting JWKS server
20:04:32.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.412744  3138 webserver.cc:533] Webserver started at http://127.0.0.1:42905/ using document root <none> and password file <none>
20:04:32.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.413166  3138 mini_oidc.cc:186] Starting OIDC Discovery server
20:04:32.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.415462  3138 webserver.cc:533] Webserver started at http://127.0.0.1:36041/ using document root <none> and password file <none>
20:04:32.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:32Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:04:32.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:32Z Disabled control of system clock
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.477685  3138 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/logs
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data/info.pb
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.190:38391
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.190
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:32.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:32.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:32.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:32.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:32.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:32.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42905/jwks.json with env {}
20:04:32.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.782241  3150 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:32.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.782894  3150 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:32.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.783557  3150 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:32.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.818019  3150 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:32.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.818315  3150 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:32.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.818508  3150 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:32.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.818771  3150 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:32.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.818993  3150 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:32.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.819144  3150 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42905/jwks.json
20:04:32.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.857427  3150 master_runner.cc:387] Master server non-default flags:
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.190:38391
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42905/jwks.json
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data/info.pb
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.190
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/logs
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:32.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:32.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.858722  3150 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:32.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:32.860405  3150 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:32.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.872953  3157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:32.873247  3156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.181504  3158 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1308 milliseconds
20:04:34.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.183092  3159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:34.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.186002  3150 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.314s	user 0.386s	sys 0.916s
20:04:34.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.186301  3150 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.315s	user 0.386s	sys 0.916s
20:04:34.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.186582  3150 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:34.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.187891  3150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:34.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.190629  3150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:34.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.192040  3150 hybrid_clock.cc:648] HybridClock initialized: now 1779134674192002 us; error 48 us; skew 500 ppm
20:04:34.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.192909  3150 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:34.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.201007  3150 webserver.cc:533] Webserver started at http://127.3.16.190:44733/ using document root <none> and password file <none>
20:04:34.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.202026  3150 fs_manager.cc:362] Metadata directory not provided
20:04:34.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.202283  3150 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:34.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.202822  3150 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:34.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.207345  3150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data/instance:
20:04:34.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "550bf95676c14d04b3ec4adb5b856552"
20:04:34.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:34 on dist-test-slave-nsdw"
20:04:34.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.208540  3150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal/instance:
20:04:34.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "550bf95676c14d04b3ec4adb5b856552"
20:04:34.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:34 on dist-test-slave-nsdw"
20:04:34.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.216956  3150 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
20:04:34.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.223094  3166 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:34.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.224330  3150 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.224694  3150 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "550bf95676c14d04b3ec4adb5b856552"
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:34 on dist-test-slave-nsdw"
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.225085  3150 fs_report.cc:389] FS layout report
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal
20:04:34.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data/data
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:34.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:34.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.325078  3150 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:34.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.326571  3150 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:34.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.327060  3150 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:34.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.418049  3150 rpc_server.cc:307] RPC server started. Bound to: 127.3.16.190:38391
20:04:34.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.418125  3217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.16.190:38391 every 8 connection(s)
20:04:34.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.420966  3150 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/data/info.pb
20:04:34.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.423450  3138 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3150
20:04:34.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.424017  3138 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-0/wal/instance
20:04:34.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.428087  3218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.432101  3138 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal
20:04:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data
20:04:34.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/logs
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data/info.pb
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.189:33115
20:04:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.189
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:34.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42905/jwks.json with env {}
20:04:34.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.443637  3218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } has no permanent_uuid. Determining permanent_uuid...
20:04:34.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.492909  3218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } has no permanent_uuid. Determining permanent_uuid...
20:04:34.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.495697  3170 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:34.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.500420  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:34.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.550004  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 1
20:04:34.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.555187  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:34.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.623696  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 2
20:04:34.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.628955  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:34.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.720387  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 3
20:04:34.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.724478  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:34.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.783913  3220 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:34.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.784482  3220 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:34.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.784932  3220 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:34.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.819440  3220 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:34.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.819751  3220 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:34.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.819947  3220 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:34.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.820147  3220 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:34.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.820338  3220 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:34.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.820539  3220 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42905/jwks.json
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.858515  3220 master_runner.cc:387] Master server non-default flags:
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.189:33115
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42905/jwks.json
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data/info.pb
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.189
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:34.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/logs
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:34.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.859891  3220 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:34.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.861451  3220 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:34.867961  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 4
20:04:34.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.873139  3229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:34.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.874022  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:35.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:35.173549  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 5
20:04:35.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:35.180369  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:35.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:35.728053  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 6
20:04:35.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:35.739310  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.189:33115: Network error: Client connection negotiation failed: client connection to 127.3.16.189:33115: connect: Connection refused (error 111)
20:04:36.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:34.874583  3230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:36.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.106703  3232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:36.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.109193  3231 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1232 milliseconds
20:04:36.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.109282  3220 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:36.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.110759  3220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.114006  3220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.115468  3220 hybrid_clock.cc:648] HybridClock initialized: now 1779134676115402 us; error 70 us; skew 500 ppm
20:04:36.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.116413  3220 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:36.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.122529  3220 webserver.cc:533] Webserver started at http://127.3.16.189:39153/ using document root <none> and password file <none>
20:04:36.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.123590  3220 fs_manager.cc:362] Metadata directory not provided
20:04:36.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.123874  3220 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:36.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.124423  3220 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.129082  3220 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data/instance:
20:04:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8224f0085fc4c7b90046c4e597a0806"
20:04:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:36 on dist-test-slave-nsdw"
20:04:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.130287  3220 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal/instance:
20:04:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8224f0085fc4c7b90046c4e597a0806"
20:04:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:36 on dist-test-slave-nsdw"
20:04:36.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.137609  3220 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
20:04:36.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.143646  3241 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:36.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.144773  3220 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
20:04:36.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.145174  3220 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal
20:04:36.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8224f0085fc4c7b90046c4e597a0806"
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:36 on dist-test-slave-nsdw"
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.145534  3220 fs_report.cc:389] FS layout report
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data/data
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:36.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.205778  3220 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:36.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.207388  3220 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:36.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.207930  3220 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:36.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.280567  3220 rpc_server.cc:307] RPC server started. Bound to: 127.3.16.189:33115
20:04:36.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.280857  3293 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.16.189:33115 every 8 connection(s)
20:04:36.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.283396  3220 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/data/info.pb
20:04:36.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.289384  3294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:36.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.289495  3138 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3220
20:04:36.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.289948  3138 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-1/wal/instance
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.292987  3138 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/logs
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data/info.pb
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:36.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.188:35877
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.188
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:36.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42905/jwks.json with env {}
20:04:36.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.306936  3294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } has no permanent_uuid. Determining permanent_uuid...
20:04:36.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.333284  3294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } has no permanent_uuid. Determining permanent_uuid...
20:04:36.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.347831  3294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } has no permanent_uuid. Determining permanent_uuid...
20:04:36.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.350274  3243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.354753  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.404350  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 1
20:04:36.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.408427  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.476928  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 2
20:04:36.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.481125  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.572575  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 3
20:04:36.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.576531  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.621280  3296 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:36.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.621842  3296 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:36.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.622284  3296 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:36.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.655917  3296 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:36.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.656196  3296 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:36.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.656386  3296 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:36.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.656584  3296 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:36.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.656785  3296 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:36.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.656930  3296 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42905/jwks.json
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.695021  3296 master_runner.cc:387] Master server non-default flags:
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.188:35877
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42905/jwks.json
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data/info.pb
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.188
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:36.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/logs
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.696281  3296 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:36.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.697818  3296 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:36.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.708942  3306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:36.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.719939  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 4
20:04:36.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.726408  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.799911  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } attempt: 7
20:04:36.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.837980  3218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } has no permanent_uuid. Determining permanent_uuid...
20:04:36.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.865020  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:36.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:36.923607  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 1
20:04:36.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.930895  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:37.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:37.012480  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 2
20:04:37.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:37.019748  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:37.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:37.025889  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 5
20:04:37.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:37.033241  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:37.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:37.105301  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 3
20:04:37.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:37.116267  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:37.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:37.256822  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 4
20:04:37.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:37.284309  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:37.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:37.567876  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 5
20:04:37.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:37.576372  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:37.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:37.580787  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 6
20:04:37.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:37.608811  3294 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:38.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.112273  3305 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 3296
20:04:38.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:36.709529  3307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:38.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.115747  3296 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.406s	user 0.511s	sys 0.888s
20:04:38.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.117033  3296 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.408s	user 0.511s	sys 0.888s
20:04:38.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.118427  3309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:38.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.121126  3308 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1407 milliseconds
20:04:38.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.121142  3296 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:38.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.122529  3296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:38.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.125100  3296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:38.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.126466  3296 hybrid_clock.cc:648] HybridClock initialized: now 1779134678126435 us; error 47 us; skew 500 ppm
20:04:38.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.127327  3296 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:38.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.128945  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 6
20:04:38.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.134902  3296 webserver.cc:533] Webserver started at http://127.3.16.188:45389/ using document root <none> and password file <none>
20:04:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.136173  3296 fs_manager.cc:362] Metadata directory not provided
20:04:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.136111  3218 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.16.188:35877: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.136404  3296 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:38.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.136818  3296 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:38.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.141178  3296 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data/instance:
20:04:38.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6264231708b34cbfb313f4cb083d8104"
20:04:38.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:38 on dist-test-slave-nsdw"
20:04:38.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.142225  3296 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal/instance:
20:04:38.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6264231708b34cbfb313f4cb083d8104"
20:04:38.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:38 on dist-test-slave-nsdw"
20:04:38.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.149537  3296 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
20:04:38.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.155128  3323 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:38.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.156265  3296 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
20:04:38.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.156533  3296 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal
20:04:38.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6264231708b34cbfb313f4cb083d8104"
20:04:38.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:38 on dist-test-slave-nsdw"
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.156831  3296 fs_report.cc:389] FS layout report
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data/data
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:38.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:38.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.208655  3296 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:38.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.210085  3296 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:38.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.210485  3296 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:38.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.281831  3296 rpc_server.cc:307] RPC server started. Bound to: 127.3.16.188:35877
20:04:38.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.281967  3374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.16.188:35877 every 8 connection(s)
20:04:38.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.286163  3296 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/data/info.pb
20:04:38.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.290084  3138 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3296
20:04:38.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.290591  3138 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/master-2/wal/instance
20:04:38.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.295045  3375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:38.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.313598  3375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } has no permanent_uuid. Determining permanent_uuid...
20:04:38.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.338565  3375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } has no permanent_uuid. Determining permanent_uuid...
20:04:38.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.348315  3375 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } has no permanent_uuid. Determining permanent_uuid...
20:04:38.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.364356  3375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: Bootstrap starting.
20:04:38.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.370409  3375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: Neither blocks nor log segments found. Creating new log.
20:04:38.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.372092  3375 log.cc:826] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: Log is configured to *not* fsync() on all Append() calls
20:04:38.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.376667  3375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: No bootstrap required, opened a new log
20:04:38.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.399230  3375 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.399899  3375 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:38.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.400095  3375 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6264231708b34cbfb313f4cb083d8104, State: Initialized, Role: FOLLOWER
20:04:38.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.401207  3375 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.403610  3384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:38.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.404273  3384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: This master's current role is: FOLLOWER
20:04:38.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.404991  3375 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: configured and running, proceeding with master startup.
20:04:38.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.430370  3395 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:04:38.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.431025  3395 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:04:38.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.426986  3296 master_runner.cc:187] Error getting master registration for 127.3.16.190:38391: OK, instance_id { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" instance_seqno: 1779134674392687 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:04:38.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.453511  3296 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:04:38.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.465672  3329 tablet.cc:2404] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:38.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.669544  3294 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 7
20:04:38.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.694540  3294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: Bootstrap starting.
20:04:38.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.701927  3294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: Neither blocks nor log segments found. Creating new log.
20:04:38.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.703832  3294 log.cc:826] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: Log is configured to *not* fsync() on all Append() calls
20:04:38.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.708529  3294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: No bootstrap required, opened a new log
20:04:38.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.729385  3294 raft_consensus.cc:359] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.730069  3294 raft_consensus.cc:385] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:38.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.730413  3294 raft_consensus.cc:740] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8224f0085fc4c7b90046c4e597a0806, State: Initialized, Role: FOLLOWER
20:04:38.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.731243  3294 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.733961  3399 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:38.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.734979  3399 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: This master's current role is: FOLLOWER
20:04:38.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.735898  3294 sys_catalog.cc:565] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: configured and running, proceeding with master startup.
20:04:38.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.766765  3410 catalog_manager.cc:1593] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:04:38.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.767458  3410 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:04:38.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.761759  3220 master_runner.cc:187] Error getting master registration for 127.3.16.190:38391: OK, instance_id { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" instance_seqno: 1779134674392687 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:04:38.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.793012  3220 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:04:38.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.880409  3384 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:38.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.881014  3384 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.883637  3384 leader_election.cc:290] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 550bf95676c14d04b3ec4adb5b856552 (127.3.16.190:38391), f8224f0085fc4c7b90046c4e597a0806 (127.3.16.189:33115)
20:04:38.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.885076  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6264231708b34cbfb313f4cb083d8104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8224f0085fc4c7b90046c4e597a0806" is_pre_election: true
20:04:38.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.886000  3268 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6264231708b34cbfb313f4cb083d8104 in term 0.
20:04:38.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.887406  3327 leader_election.cc:304] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6264231708b34cbfb313f4cb083d8104, f8224f0085fc4c7b90046c4e597a0806; no voters: 
20:04:38.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.888432  3384 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:38.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.889358  3384 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:38.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.890146  3384 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 0 FOLLOWER]: Advancing to term 1
20:04:38.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.905953  3384 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.910647  3384 leader_election.cc:290] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [CANDIDATE]: Term 1 election: Requested vote from peers 550bf95676c14d04b3ec4adb5b856552 (127.3.16.190:38391), f8224f0085fc4c7b90046c4e597a0806 (127.3.16.189:33115)
20:04:38.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.913250  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6264231708b34cbfb313f4cb083d8104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8224f0085fc4c7b90046c4e597a0806"
20:04:38.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.913854  3268 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 0 FOLLOWER]: Advancing to term 1
20:04:38.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.926582  3268 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6264231708b34cbfb313f4cb083d8104 in term 1.
20:04:38.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.927882  3327 leader_election.cc:304] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6264231708b34cbfb313f4cb083d8104, f8224f0085fc4c7b90046c4e597a0806; no voters: 
20:04:38.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.928902  3384 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 1 FOLLOWER]: Leader election won for term 1
20:04:38.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.932238  3384 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [term 1 LEADER]: Becoming Leader. State: Replica: 6264231708b34cbfb313f4cb083d8104, State: Running, Role: LEADER
20:04:38.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.936517  3384 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:38.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.949030  3412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6264231708b34cbfb313f4cb083d8104. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:38.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.949873  3412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: This master's current role is: LEADER
20:04:38.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.956444  3414 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:38.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.963579  3414 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:38.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:38.966099  3247 tablet.cc:2404] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:38.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.990272  3268 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Refusing update from remote peer 6264231708b34cbfb313f4cb083d8104: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:38.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:38.992998  3412 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:39.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.027388  3399 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6264231708b34cbfb313f4cb083d8104. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:39.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.028453  3399 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: This master's current role is: FOLLOWER
20:04:39.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.034104  3415 mvcc.cc:204] Tried to move back new op lower bound from 7287335645119967232 to 7287335644946726912. Current Snapshot: MvccSnapshot[applied={T|T < 7287335645119967232}]
20:04:39.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.035909  3384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:39.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.036636  3384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: This master's current role is: LEADER
20:04:39.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.045122  3414 catalog_manager.cc:1382] Generated new cluster ID: 71e9a189ae1846e9aa58c372bfa7c22d
20:04:39.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.045447  3414 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:39.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.049813  3399 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:39.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.050542  3399 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [sys.catalog]: This master's current role is: FOLLOWER
20:04:39.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.115578  3414 catalog_manager.cc:1405] Generated new certificate authority record
20:04:39.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.117911  3414 catalog_manager.cc:1539] Loading token signing keys...
20:04:39.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.149155  3414 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104: Generated new TSK 0
20:04:39.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.151549  3414 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:39.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.169556  3218 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } attempt: 7
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.193563  3138 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/logs
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data/info.pb
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:39.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.129:0
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.16.129
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.129
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:39.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:39.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.208899  3218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: Bootstrap starting.
20:04:39.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.224502  3218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: Neither blocks nor log segments found. Creating new log.
20:04:39.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.226794  3218 log.cc:826] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: Log is configured to *not* fsync() on all Append() calls
20:04:39.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.245723  3218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: No bootstrap required, opened a new log
20:04:39.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.305806  3218 raft_consensus.cc:359] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:39.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.306787  3218 raft_consensus.cc:385] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:39.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.319252  3218 raft_consensus.cc:740] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 550bf95676c14d04b3ec4adb5b856552, State: Initialized, Role: FOLLOWER
20:04:39.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.320322  3218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:39.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.354182  3218 sys_catalog.cc:565] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: configured and running, proceeding with master startup.
20:04:39.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.354329  3192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6264231708b34cbfb313f4cb083d8104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550bf95676c14d04b3ec4adb5b856552"
20:04:39.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.355914  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6264231708b34cbfb313f4cb083d8104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550bf95676c14d04b3ec4adb5b856552" is_pre_election: true
20:04:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.358354  3192 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 0 FOLLOWER]: Advancing to term 1
20:04:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.358301  3423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.362659  3423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: This master's current role is: FOLLOWER
20:04:39.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.366587  3192 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6264231708b34cbfb313f4cb083d8104 in term 1.
20:04:39.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.384621  3191 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Refusing update from remote peer 6264231708b34cbfb313f4cb083d8104: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:04:39.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.389793  3412 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:04:39.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.526260  3423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6264231708b34cbfb313f4cb083d8104. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:39.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.527046  3423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: This master's current role is: FOLLOWER
20:04:39.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.528411  3436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:39.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.529474  3436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: This master's current role is: FOLLOWER
20:04:39.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.543946  3440 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:04:39.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.752875  3421 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:39.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.753523  3421 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:39.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.754205  3421 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:39.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.773269  3410 catalog_manager.cc:1294] Loaded cluster ID: 71e9a189ae1846e9aa58c372bfa7c22d
20:04:39.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.773839  3410 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: loading cluster ID for follower catalog manager: success
20:04:39.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.781719  3410 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: acquiring CA information for follower catalog manager: success
20:04:39.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.787309  3410 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:39.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.818786  3421 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:39.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.820149  3421 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.16.129
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.887030  3421 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:39.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.129:0
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data/info.pb
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.129
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.16.129
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/logs
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:39.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:39.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.888801  3421 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:39.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:39.891029  3421 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:39.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.908243  3446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:40.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:40.018569  3452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6264231708b34cbfb313f4cb083d8104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:40.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:40.024266  3452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6264231708b34cbfb313f4cb083d8104 [sys.catalog]: This master's current role is: LEADER
20:04:40.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:40.578908  3440 catalog_manager.cc:1294] Loaded cluster ID: 71e9a189ae1846e9aa58c372bfa7c22d
20:04:40.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:40.579527  3440 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: loading cluster ID for follower catalog manager: success
20:04:40.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:40.612783  3440 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: acquiring CA information for follower catalog manager: success
20:04:40.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:40.635702  3440 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:04:41.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:41.836978  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800087920 after lost signal to thread 3151
20:04:41.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:41.837723  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800080020 after lost signal to thread 3217
20:04:42.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:41.308661  3445 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 3421
20:04:42.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:42.858358  3445 kernel_stack_watchdog.cc:198] Thread 3421 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 394ms:
20:04:42.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:42.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:42.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:42.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:42.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:39.910880  3447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:42.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:42.859431  3421 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.948s	user 0.000s	sys 0.003s
20:04:42.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:42.859822  3421 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.948s	user 0.000s	sys 0.003s
20:04:42.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:42.863201  3448 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2952 milliseconds
20:04:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:42.864801  3450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:42.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.864825  3421 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:42.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.866462  3421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:42.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.871733  3421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:42.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.873415  3421 hybrid_clock.cc:648] HybridClock initialized: now 1779134682873362 us; error 55 us; skew 500 ppm
20:04:42.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.874711  3421 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:42.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.883589  3421 webserver.cc:533] Webserver started at http://127.3.16.129:32817/ using document root <none> and password file <none>
20:04:42.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.885021  3421 fs_manager.cc:362] Metadata directory not provided
20:04:42.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.885321  3421 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:42.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.885931  3421 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.893437  3421 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data/instance:
20:04:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0ee4555f5dea40a796a311dc574e1774"
20:04:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:42 on dist-test-slave-nsdw"
20:04:42.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.895184  3421 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal/instance:
20:04:42.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0ee4555f5dea40a796a311dc574e1774"
20:04:42.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:42 on dist-test-slave-nsdw"
20:04:42.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.905908  3421 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.004s
20:04:42.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.914451  3462 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:42.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.915872  3421 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
20:04:42.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.916253  3421 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal
20:04:42.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0ee4555f5dea40a796a311dc574e1774"
20:04:42.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:42 on dist-test-slave-nsdw"
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.916704  3421 fs_report.cc:389] FS layout report
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data/data
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:42.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:42.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.980582  3421 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:42.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.982290  3421 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:42.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.982865  3421 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:42.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.986079  3421 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:42.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.991482  3421 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:42.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.991732  3421 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:42.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.992081  3421 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:42.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:42.992274  3421 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:43.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.226455  3421 rpc_server.cc:307] RPC server started. Bound to: 127.3.16.129:40153
20:04:43.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.231381  3421 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/data/info.pb
20:04:43.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.238041  3138 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3421
20:04:43.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.238881  3138 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-0/wal/instance
20:04:43.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.226562  3574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.16.129:40153 every 8 connection(s)
20:04:43.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.268247  3138 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:43.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:43.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal
20:04:43.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/logs
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data/info.pb
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.130:0
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.16.130
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.130
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:43.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:43.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:43.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.320812  3575 heartbeater.cc:344] Connected to a master server at 127.3.16.188:35877
20:04:43.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.321353  3575 heartbeater.cc:461] Registering TS with master...
20:04:43.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.322888  3575 heartbeater.cc:507] Master 127.3.16.188:35877 requested a full tablet report, sending...
20:04:43.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.326318  3340 ts_manager.cc:194] Registered new tserver with Master: 0ee4555f5dea40a796a311dc574e1774 (127.3.16.129:40153)
20:04:43.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.330240  3340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.16.129:51439
20:04:43.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.368386  3576 heartbeater.cc:344] Connected to a master server at 127.3.16.189:33115
20:04:43.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.368808  3576 heartbeater.cc:461] Registering TS with master...
20:04:43.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.369467  3576 heartbeater.cc:507] Master 127.3.16.189:33115 requested a full tablet report, sending...
20:04:43.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.373162  3258 ts_manager.cc:194] Registered new tserver with Master: 0ee4555f5dea40a796a311dc574e1774 (127.3.16.129:40153)
20:04:43.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.385373  3580 heartbeater.cc:344] Connected to a master server at 127.3.16.190:38391
20:04:43.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.385793  3580 heartbeater.cc:461] Registering TS with master...
20:04:43.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.386447  3580 heartbeater.cc:507] Master 127.3.16.190:38391 requested a full tablet report, sending...
20:04:43.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.391538  3183 ts_manager.cc:194] Registered new tserver with Master: 0ee4555f5dea40a796a311dc574e1774 (127.3.16.129:40153)
20:04:43.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.692906  3579 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:43.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.693456  3579 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:43.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.694025  3579 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:43.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.734521  3579 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:43.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.735527  3579 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.16.130
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.775664  3579 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.130:0
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data/info.pb
20:04:43.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.130
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.16.130
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/logs
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:43.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.777562  3579 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:43.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:43.779937  3579 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:43.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.797891  3590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:44.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:44.335273  3575 heartbeater.cc:499] Master 127.3.16.188:35877 was elected leader, sending a full tablet report...
20:04:45.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:45.200035  3589 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 3579
20:04:45.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:45.295051  3589 kernel_stack_watchdog.cc:198] Thread 3579 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
20:04:45.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:45.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:45.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:45.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:45.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:45.299054  3579 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.502s	user 0.505s	sys 0.918s
20:04:45.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:45.299398  3579 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.502s	user 0.505s	sys 0.918s
20:04:45.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:43.808806  3591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:45.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.311523  3579 server_base.cc:1061] running on GCE node
20:04:45.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:45.313345  3596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:45.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.315009  3579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:45.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.322958  3579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:45.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.324488  3579 hybrid_clock.cc:648] HybridClock initialized: now 1779134685324156 us; error 336 us; skew 500 ppm
20:04:45.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.325668  3579 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:45.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.345486  3579 webserver.cc:533] Webserver started at http://127.3.16.130:36993/ using document root <none> and password file <none>
20:04:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.346792  3579 fs_manager.cc:362] Metadata directory not provided
20:04:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.347090  3579 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.347697  3579 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.354977  3579 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data/instance:
20:04:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0e1bc70aee884f049c8f339a233a6edb"
20:04:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:45 on dist-test-slave-nsdw"
20:04:45.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.356638  3579 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal/instance:
20:04:45.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0e1bc70aee884f049c8f339a233a6edb"
20:04:45.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:45 on dist-test-slave-nsdw"
20:04:45.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.366704  3579 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.005s
20:04:45.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.372597  3601 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:45.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.373867  3579 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
20:04:45.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.374243  3579 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal
20:04:45.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0e1bc70aee884f049c8f339a233a6edb"
20:04:45.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:45 on dist-test-slave-nsdw"
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.374616  3579 fs_report.cc:389] FS layout report
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data/data
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:45.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:45.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.433740  3579 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:45.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.435285  3579 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:45.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.435787  3579 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.438584  3579 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:45.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.442876  3579 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:45.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.443099  3579 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
20:04:45.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.443436  3579 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:45.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.443634  3579 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:45.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.619103  3579 rpc_server.cc:307] RPC server started. Bound to: 127.3.16.130:37421
20:04:45.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.619194  3713 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.16.130:37421 every 8 connection(s)
20:04:45.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.621857  3579 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/data/info.pb
20:04:45.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.630141  3138 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3579
20:04:45.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.630720  3138 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-1/wal/instance
20:04:45.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.648325  3138 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/logs
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data/info.pb
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:45.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.131:0
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.16.131
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.131
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:45.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:04:45.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.701728  3714 heartbeater.cc:344] Connected to a master server at 127.3.16.188:35877
20:04:45.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.702253  3714 heartbeater.cc:461] Registering TS with master...
20:04:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.703014  3715 heartbeater.cc:344] Connected to a master server at 127.3.16.189:33115
20:04:45.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.703321  3715 heartbeater.cc:461] Registering TS with master...
20:04:45.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.703716  3714 heartbeater.cc:507] Master 127.3.16.188:35877 requested a full tablet report, sending...
20:04:45.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.704397  3715 heartbeater.cc:507] Master 127.3.16.189:33115 requested a full tablet report, sending...
20:04:45.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.706848  3340 ts_manager.cc:194] Registered new tserver with Master: 0e1bc70aee884f049c8f339a233a6edb (127.3.16.130:37421)
20:04:45.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.707378  3258 ts_manager.cc:194] Registered new tserver with Master: 0e1bc70aee884f049c8f339a233a6edb (127.3.16.130:37421)
20:04:45.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.708534  3340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.16.130:56717
20:04:45.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.709980  3716 heartbeater.cc:344] Connected to a master server at 127.3.16.190:38391
20:04:45.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.710332  3716 heartbeater.cc:461] Registering TS with master...
20:04:45.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.711351  3716 heartbeater.cc:507] Master 127.3.16.190:38391 requested a full tablet report, sending...
20:04:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:45.713797  3183 ts_manager.cc:194] Registered new tserver with Master: 0e1bc70aee884f049c8f339a233a6edb (127.3.16.130:37421)
20:04:46.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.005720  3721 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:46.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.006425  3721 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:46.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.007192  3721 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:46.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.041509  3721 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:46.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.042369  3721 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.16.131
20:04:46.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:46.080381  3721 tablet_server_runner.cc:78] Tablet server non-default flags:
20:04:46.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:46.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.16.148:42857
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.16.131:0
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data/info.pb
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.16.131
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.16.190:38391,127.3.16.189:33115,127.3.16.188:35877
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.16.131
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/logs
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:46.081812  3721 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:46.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:46.083451  3721 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:46.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.096099  3730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:46.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.697021  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800091fa0 after lost signal to thread 3151
20:04:46.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.697959  3214 debug-util.cc:398] Leaking SignalData structure 0x7b0800080100 after lost signal to thread 3217
20:04:46.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:46.713775  3714 heartbeater.cc:499] Master 127.3.16.188:35877 was elected leader, sending a full tablet report...
20:04:47.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:46.097792  3731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:47.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:47.411653  3733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:47.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:47.413749  3732 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1311 milliseconds
20:04:47.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.413827  3721 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:47.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.415179  3721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:47.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.417305  3721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:47.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.418648  3721 hybrid_clock.cc:648] HybridClock initialized: now 1779134687418596 us; error 71 us; skew 500 ppm
20:04:47.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.419473  3721 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.425606  3721 webserver.cc:533] Webserver started at http://127.3.16.131:39895/ using document root <none> and password file <none>
20:04:47.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.426487  3721 fs_manager.cc:362] Metadata directory not provided
20:04:47.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.426666  3721 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:47.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.427127  3721 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:47.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.431452  3721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data/instance:
20:04:47.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ba55f5678004296be8e58360e7eebbc"
20:04:47.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:47 on dist-test-slave-nsdw"
20:04:47.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.432521  3721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal/instance:
20:04:47.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ba55f5678004296be8e58360e7eebbc"
20:04:47.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:47 on dist-test-slave-nsdw"
20:04:47.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.439791  3721 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
20:04:47.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.445369  3741 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:47.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.446535  3721 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.446878  3721 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9ba55f5678004296be8e58360e7eebbc"
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:47 on dist-test-slave-nsdw"
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.447337  3721 fs_report.cc:389] FS layout report
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal
20:04:47.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data/data
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:47.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.500881  3721 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:47.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.502344  3721 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:47.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.502740  3721 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:47.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.505393  3721 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:04:47.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.510615  3721 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:04:47.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.510869  3721 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:04:47.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.511092  3721 ts_tablet_manager.cc:616] Registered 0 tablets
20:04:47.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.511226  3721 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:04:47.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.651340  3721 rpc_server.cc:307] RPC server started. Bound to: 127.3.16.131:34891
20:04:47.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.651502  3853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.16.131:34891 every 8 connection(s)
20:04:47.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.653954  3721 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/data/info.pb
20:04:47.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.661125  3138 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3721
20:04:47.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.661685  3138 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster15264098784361710210/ts-2/wal/instance
20:04:47.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.698499  3854 heartbeater.cc:344] Connected to a master server at 127.3.16.188:35877
20:04:47.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.699471  3854 heartbeater.cc:461] Registering TS with master...
20:04:47.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.700843  3854 heartbeater.cc:507] Master 127.3.16.188:35877 requested a full tablet report, sending...
20:04:47.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.702195  3855 heartbeater.cc:344] Connected to a master server at 127.3.16.189:33115
20:04:47.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.702550  3855 heartbeater.cc:461] Registering TS with master...
20:04:47.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.702562  3856 heartbeater.cc:344] Connected to a master server at 127.3.16.190:38391
20:04:47.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.703024  3856 heartbeater.cc:461] Registering TS with master...
20:04:47.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.703495  3855 heartbeater.cc:507] Master 127.3.16.189:33115 requested a full tablet report, sending...
20:04:47.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.703905  3856 heartbeater.cc:507] Master 127.3.16.190:38391 requested a full tablet report, sending...
20:04:47.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.703840  3340 ts_manager.cc:194] Registered new tserver with Master: 9ba55f5678004296be8e58360e7eebbc (127.3.16.131:34891)
20:04:47.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.705580  3340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.16.131:41753
20:04:47.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.706522  3183 ts_manager.cc:194] Registered new tserver with Master: 9ba55f5678004296be8e58360e7eebbc (127.3.16.131:34891)
20:04:47.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.706899  3258 ts_manager.cc:194] Registered new tserver with Master: 9ba55f5678004296be8e58360e7eebbc (127.3.16.131:34891)
20:04:47.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.720077  3138 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
20:04:47.733 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:47.733 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:04:47.737 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.16.190"
      port: 38391
    }
    bound_http_address {
      host: "127.3.16.190"
      port: 44733
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.16.189"
      port: 33115
    }
    bound_http_address {
      host: "127.3.16.189"
      port: 39153
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.16.188"
      port: 35877
    }
    bound_http_address {
      host: "127.3.16.188"
      port: 45389
    }
  }
}

20:04:47.737 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:04:47.740 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.16.129"
      port: 40153
    }
    bound_http_address {
      host: "127.3.16.129"
      port: 32817
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.16.130"
      port: 37421
    }
    bound_http_address {
      host: "127.3.16.130"
      port: 36993
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.16.131"
      port: 34891
    }
    bound_http_address {
      host: "127.3.16.131"
      port: 39895
    }
  }
}

20:04:47.741 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:04:47.743 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:47.746 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:04:47.752 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.16.189:33115(127.3.16.189:33115)] connecting to peer
20:04:47.753 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:47.754 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.16.190:38391(127.3.16.190:38391)] connecting to peer
20:04:47.755 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.16.188:35877(127.3.16.188:35877)] Successfully connected to peer
20:04:47.755 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.16.189:33115(127.3.16.189:33115)] Successfully connected to peer
20:04:47.757 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.16.190:38391(127.3.16.190:38391)] Successfully connected to peer
20:04:47.761 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.16.190
20:04:47.761 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.16.189
20:04:47.771 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.16.188
20:04:47.785 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb09d5c9d, L:/127.0.0.1:43710 - R:/127.3.16.189:33115] using SASL/PLAIN
20:04:47.788 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9f54e68b, L:/127.0.0.1:47638 - R:/127.3.16.190:38391] using SASL/PLAIN
20:04:47.800 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xac962da3, L:/127.0.0.1:52594 - R:/127.3.16.188:35877] using SASL/PLAIN
20:04:47.804 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:47.804 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=52), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [38ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [40ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [52ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: OK, deferred=null) after lookup
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.806890  3340 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52594:
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=SCAN_TABLE"
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:47.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:04:47.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:04:47.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:04:47.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:04:47.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:04:47.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:47.813704  3340 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=SCAN_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:04:47.867 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table daf58bf8b17e4d15ade87fc76de90e12
20:04:47.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.899739  3510 tablet_service.cc:1511] Processing CreateTablet for tablet fac8e1cbdd0f4cf987c286612b22b3e8 (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=daf58bf8b17e4d15ade87fc76de90e12]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:47.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.901249  3510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac8e1cbdd0f4cf987c286612b22b3e8. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:47.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.926684  3886 tablet_bootstrap.cc:492] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: Bootstrap starting.
20:04:47.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.928289  3789 tablet_service.cc:1511] Processing CreateTablet for tablet fac8e1cbdd0f4cf987c286612b22b3e8 (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=daf58bf8b17e4d15ade87fc76de90e12]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:47.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.929790  3789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac8e1cbdd0f4cf987c286612b22b3e8. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:47.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.929925  3649 tablet_service.cc:1511] Processing CreateTablet for tablet fac8e1cbdd0f4cf987c286612b22b3e8 (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=daf58bf8b17e4d15ade87fc76de90e12]), partition=RANGE (key) PARTITION UNBOUNDED
20:04:47.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.932246  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac8e1cbdd0f4cf987c286612b22b3e8. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:47.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.935182  3886 tablet_bootstrap.cc:654] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: Neither blocks nor log segments found. Creating new log.
20:04:47.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.938021  3886 log.cc:826] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: Log is configured to *not* fsync() on all Append() calls
20:04:47.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.944135  3886 tablet_bootstrap.cc:492] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: No bootstrap required, opened a new log
20:04:47.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.944690  3886 ts_tablet_manager.cc:1403] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
20:04:47.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.956121  3888 tablet_bootstrap.cc:492] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: Bootstrap starting.
20:04:47.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.965018  3889 tablet_bootstrap.cc:492] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: Bootstrap starting.
20:04:47.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.965850  3888 tablet_bootstrap.cc:654] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: Neither blocks nor log segments found. Creating new log.
20:04:47.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.968199  3888 log.cc:826] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: Log is configured to *not* fsync() on all Append() calls
20:04:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.972747  3889 tablet_bootstrap.cc:654] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: Neither blocks nor log segments found. Creating new log.
20:04:47.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.975695  3888 tablet_bootstrap.cc:492] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: No bootstrap required, opened a new log
20:04:47.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.975778  3889 log.cc:826] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: Log is configured to *not* fsync() on all Append() calls
20:04:47.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.976245  3888 ts_tablet_manager.cc:1403] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
20:04:47.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.976403  3886 raft_consensus.cc:359] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:47.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.977355  3886 raft_consensus.cc:385] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:47.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.977658  3886 raft_consensus.cc:740] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee4555f5dea40a796a311dc574e1774, State: Initialized, Role: FOLLOWER
20:04:47.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.978965  3886 consensus_queue.cc:260] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:47.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.982770  3889 tablet_bootstrap.cc:492] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: No bootstrap required, opened a new log
20:04:47.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.983289  3889 ts_tablet_manager.cc:1403] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
20:04:47.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:47.983341  3886 ts_tablet_manager.cc:1434] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: Time spent starting tablet: real 0.038s	user 0.030s	sys 0.009s
20:04:48.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.005014  3888 raft_consensus.cc:359] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.005750  3888 raft_consensus.cc:385] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:48.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.005951  3888 raft_consensus.cc:740] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba55f5678004296be8e58360e7eebbc, State: Initialized, Role: FOLLOWER
20:04:48.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.006740  3888 consensus_queue.cc:260] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.010609  3854 heartbeater.cc:499] Master 127.3.16.188:35877 was elected leader, sending a full tablet report...
20:04:48.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.011853  3888 ts_tablet_manager.cc:1434] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: Time spent starting tablet: real 0.035s	user 0.026s	sys 0.009s
20:04:48.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.012208  3889 raft_consensus.cc:359] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.013057  3889 raft_consensus.cc:385] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:04:48.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.013371  3889 raft_consensus.cc:740] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1bc70aee884f049c8f339a233a6edb, State: Initialized, Role: FOLLOWER
20:04:48.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.014338  3889 consensus_queue.cc:260] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.027717  3889 ts_tablet_manager.cc:1434] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: Time spent starting tablet: real 0.044s	user 0.031s	sys 0.007s
20:04:48.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:48.121404  3584 tablet.cc:2404] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:48.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.180773  3893 raft_consensus.cc:493] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:48.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.181306  3893 raft_consensus.cc:515] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.183925  3893 leader_election.cc:290] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ee4555f5dea40a796a311dc574e1774 (127.3.16.129:40153), 0e1bc70aee884f049c8f339a233a6edb (127.3.16.130:37421)
20:04:48.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:48.189731  3861 tablet.cc:2404] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:48.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:48.193913  3722 tablet.cc:2404] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:04:48.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.193909  3530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac8e1cbdd0f4cf987c286612b22b3e8" candidate_uuid: "9ba55f5678004296be8e58360e7eebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ee4555f5dea40a796a311dc574e1774" is_pre_election: true
20:04:48.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.194283  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac8e1cbdd0f4cf987c286612b22b3e8" candidate_uuid: "9ba55f5678004296be8e58360e7eebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1bc70aee884f049c8f339a233a6edb" is_pre_election: true
20:04:48.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.194799  3530 raft_consensus.cc:2468] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba55f5678004296be8e58360e7eebbc in term 0.
20:04:48.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.195087  3669 raft_consensus.cc:2468] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba55f5678004296be8e58360e7eebbc in term 0.
20:04:48.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.196295  3744 leader_election.cc:304] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ee4555f5dea40a796a311dc574e1774, 9ba55f5678004296be8e58360e7eebbc; no voters: 
20:04:48.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.197072  3893 raft_consensus.cc:2804] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Leader pre-election won for term 1
20:04:48.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.197405  3893 raft_consensus.cc:493] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:48.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.197621  3893 raft_consensus.cc:3060] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 0 FOLLOWER]: Advancing to term 1
20:04:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.202068  3893 raft_consensus.cc:515] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.203594  3893 leader_election.cc:290] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [CANDIDATE]: Term 1 election: Requested vote from peers 0ee4555f5dea40a796a311dc574e1774 (127.3.16.129:40153), 0e1bc70aee884f049c8f339a233a6edb (127.3.16.130:37421)
20:04:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.204413  3530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac8e1cbdd0f4cf987c286612b22b3e8" candidate_uuid: "9ba55f5678004296be8e58360e7eebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ee4555f5dea40a796a311dc574e1774"
20:04:48.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.204615  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac8e1cbdd0f4cf987c286612b22b3e8" candidate_uuid: "9ba55f5678004296be8e58360e7eebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1bc70aee884f049c8f339a233a6edb"
20:04:48.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.204810  3530 raft_consensus.cc:3060] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [term 0 FOLLOWER]: Advancing to term 1
20:04:48.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.205149  3669 raft_consensus.cc:3060] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [term 0 FOLLOWER]: Advancing to term 1
20:04:48.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.209964  3669 raft_consensus.cc:2468] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0e1bc70aee884f049c8f339a233a6edb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba55f5678004296be8e58360e7eebbc in term 1.
20:04:48.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.209971  3530 raft_consensus.cc:2468] T fac8e1cbdd0f4cf987c286612b22b3e8 P 0ee4555f5dea40a796a311dc574e1774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba55f5678004296be8e58360e7eebbc in term 1.
20:04:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.210948  3744 leader_election.cc:304] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ee4555f5dea40a796a311dc574e1774, 9ba55f5678004296be8e58360e7eebbc; no voters: 
20:04:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.211560  3893 raft_consensus.cc:2804] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 1 FOLLOWER]: Leader election won for term 1
20:04:48.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.212952  3893 raft_consensus.cc:697] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [term 1 LEADER]: Becoming Leader. State: Replica: 9ba55f5678004296be8e58360e7eebbc, State: Running, Role: LEADER
20:04:48.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.214425  3893 consensus_queue.cc:237] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } }
20:04:48.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.225553  3339 catalog_manager.cc:5696] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba55f5678004296be8e58360e7eebbc (127.3.16.131). New cstate: current_term: 1 leader_uuid: "9ba55f5678004296be8e58360e7eebbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba55f5678004296be8e58360e7eebbc" member_type: VOTER last_known_addr { host: "127.3.16.131" port: 34891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 } health_report { overall_health: UNKNOWN } } }
20:04:48.380 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table daf58bf8b17e4d15ade87fc76de90e12
20:04:48.380 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.3.16.188:35877
20:04:48.381 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:04:48.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.381505  3138 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3296
20:04:48.407 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.16.188:35877(127.3.16.188:35877)] handling channelInactive
20:04:48.407 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state READY due to: connection closed
20:04:48.409 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:04:48.409 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.412 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.412 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.412 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.3.16.188:35877(127.3.16.188:35877) for tablet Kudu Master: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.433 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.435 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.438 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.453 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.458 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.473 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.476 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.477 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.493 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.496 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.496 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.496 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.497 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.513 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.517 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.553 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.555 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.557 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.617153  3893 consensus_queue.cc:1048] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ee4555f5dea40a796a311dc574e1774" member_type: VOTER last_known_addr { host: "127.3.16.129" port: 40153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:48.633 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.636 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.636 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.636 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.651 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:48.648504  3893 consensus_queue.cc:1048] T fac8e1cbdd0f4cf987c286612b22b3e8 P 9ba55f5678004296be8e58360e7eebbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1bc70aee884f049c8f339a233a6edb" member_type: VOTER last_known_addr { host: "127.3.16.130" port: 37421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:04:48.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:48.651211  3854 heartbeater.cc:646] Failed to heartbeat to 127.3.16.188:35877 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:48.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:48.659332  3575 heartbeater.cc:646] Failed to heartbeat to 127.3.16.188:35877 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:48.673 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:48.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:48.682 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:48.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:48.697566  3714 heartbeater.cc:646] Failed to heartbeat to 127.3.16.188:35877 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:49.173 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:49.174 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.174 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.174 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.177 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:49.693 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:49.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.697 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:49.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.743160  3917 raft_consensus.cc:493] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6264231708b34cbfb313f4cb083d8104)
20:04:49.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.743635  3917 raft_consensus.cc:515] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:49.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.744854  3918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6264231708b34cbfb313f4cb083d8104)
20:04:49.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.745256  3918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:49.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.746111  3917 leader_election.cc:290] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 550bf95676c14d04b3ec4adb5b856552 (127.3.16.190:38391), 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877)
20:04:49.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.747069  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8224f0085fc4c7b90046c4e597a0806" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "550bf95676c14d04b3ec4adb5b856552" is_pre_election: true
20:04:49.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.747742  3191 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8224f0085fc4c7b90046c4e597a0806 in term 1.
20:04:49.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.748623  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "550bf95676c14d04b3ec4adb5b856552" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f8224f0085fc4c7b90046c4e597a0806" is_pre_election: true
20:04:49.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.749469  3245 leader_election.cc:304] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 550bf95676c14d04b3ec4adb5b856552, f8224f0085fc4c7b90046c4e597a0806; no voters: 
20:04:49.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.749567  3268 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 550bf95676c14d04b3ec4adb5b856552 in term 1.
20:04:49.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.747464  3918 leader_election.cc:290] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8224f0085fc4c7b90046c4e597a0806 (127.3.16.189:33115), 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877)
20:04:49.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.750645  3917 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:49.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.751047  3917 raft_consensus.cc:493] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6264231708b34cbfb313f4cb083d8104)
20:04:49.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:49.751292  3243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:04:49.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.751562  3917 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 1 FOLLOWER]: Advancing to term 2
20:04:49.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.752990  3170 leader_election.cc:304] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 550bf95676c14d04b3ec4adb5b856552, f8224f0085fc4c7b90046c4e597a0806; no voters: 
20:04:49.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:49.753717  3168 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111) [suppressed 13 similar messages]
20:04:49.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.754395  3918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:04:49.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.754884  3918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6264231708b34cbfb313f4cb083d8104)
20:04:49.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.755316  3918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 1 FOLLOWER]: Advancing to term 2
20:04:49.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.762753  3917 raft_consensus.cc:515] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:49.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:49.765385  3168 leader_election.cc:336] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877): Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:49.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.765671  3191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8224f0085fc4c7b90046c4e597a0806" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "550bf95676c14d04b3ec4adb5b856552"
20:04:49.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:49.765761  3243 leader_election.cc:336] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877): Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:49.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.766803  3917 leader_election.cc:290] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [CANDIDATE]: Term 2 election: Requested vote from peers 550bf95676c14d04b3ec4adb5b856552 (127.3.16.190:38391), 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877)
20:04:49.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.766718  3918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:49.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.767949  3191 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f8224f0085fc4c7b90046c4e597a0806 in current term 2: Already voted for candidate 550bf95676c14d04b3ec4adb5b856552 in this term.
20:04:49.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.769508  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "550bf95676c14d04b3ec4adb5b856552" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f8224f0085fc4c7b90046c4e597a0806"
20:04:49.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.770287  3268 raft_consensus.cc:2393] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 550bf95676c14d04b3ec4adb5b856552 in current term 2: Already voted for candidate f8224f0085fc4c7b90046c4e597a0806 in this term.
20:04:49.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.771164  3918 leader_election.cc:290] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 2 election: Requested vote from peers f8224f0085fc4c7b90046c4e597a0806 (127.3.16.189:33115), 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877)
20:04:49.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:49.771164  3243 leader_election.cc:336] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877): Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:49.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.772440  3245 leader_election.cc:304] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8224f0085fc4c7b90046c4e597a0806; no voters: 550bf95676c14d04b3ec4adb5b856552, 6264231708b34cbfb313f4cb083d8104
20:04:49.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.773094  3917 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:04:49.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:49.773435  3168 leader_election.cc:336] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877): Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:49.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.773854  3168 leader_election.cc:304] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550bf95676c14d04b3ec4adb5b856552; no voters: 6264231708b34cbfb313f4cb083d8104, f8224f0085fc4c7b90046c4e597a0806
20:04:49.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:49.774487  3918 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:04:49.933 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:49.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.935 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:49.937 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:50.093 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:50.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:50.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:50.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:50.097 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391; will retry
20:04:51.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.711727  3929 raft_consensus.cc:493] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:04:51.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.712296  3929 raft_consensus.cc:515] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:51.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.714517  3929 leader_election.cc:290] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8224f0085fc4c7b90046c4e597a0806 (127.3.16.189:33115), 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877)
20:04:51.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.715257  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "550bf95676c14d04b3ec4adb5b856552" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f8224f0085fc4c7b90046c4e597a0806" is_pre_election: true
20:04:51.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.715950  3268 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 550bf95676c14d04b3ec4adb5b856552 in term 2.
20:04:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.717047  3170 leader_election.cc:304] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 550bf95676c14d04b3ec4adb5b856552, f8224f0085fc4c7b90046c4e597a0806; no voters: 
20:04:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.717924  3929 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Leader pre-election won for term 3
20:04:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.718143  3929 raft_consensus.cc:493] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:04:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.718397  3929 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 2 FOLLOWER]: Advancing to term 3
20:04:51.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:51.719960  3168 leader_election.cc:336] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877): Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:51.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.723313  3929 raft_consensus.cc:515] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:51.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.724647  3929 leader_election.cc:290] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 3 election: Requested vote from peers f8224f0085fc4c7b90046c4e597a0806 (127.3.16.189:33115), 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877)
20:04:51.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.725555  3268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "550bf95676c14d04b3ec4adb5b856552" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f8224f0085fc4c7b90046c4e597a0806"
20:04:51.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.726138  3268 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 2 FOLLOWER]: Advancing to term 3
20:04:51.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:51.728930  3168 leader_election.cc:336] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6264231708b34cbfb313f4cb083d8104 (127.3.16.188:35877): Network error: Client connection negotiation failed: client connection to 127.3.16.188:35877: connect: Connection refused (error 111)
20:04:51.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.733383  3268 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f8224f0085fc4c7b90046c4e597a0806 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550bf95676c14d04b3ec4adb5b856552 in term 3.
20:04:51.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.734382  3170 leader_election.cc:304] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550bf95676c14d04b3ec4adb5b856552, f8224f0085fc4c7b90046c4e597a0806; no voters: 6264231708b34cbfb313f4cb083d8104
20:04:51.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.735131  3929 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 3 FOLLOWER]: Leader election won for term 3
20:04:51.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.735975  3929 raft_consensus.cc:697] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [term 3 LEADER]: Becoming Leader. State: Replica: 550bf95676c14d04b3ec4adb5b856552, State: Running, Role: LEADER
20:04:51.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.736747  3929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } }
20:04:51.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.741468  3932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 550bf95676c14d04b3ec4adb5b856552. Latest consensus state: current_term: 3 leader_uuid: "550bf95676c14d04b3ec4adb5b856552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "550bf95676c14d04b3ec4adb5b856552" member_type: VOTER last_known_addr { host: "127.3.16.190" port: 38391 } } peers { permanent_uuid: "f8224f0085fc4c7b90046c4e597a0806" member_type: VOTER last_known_addr { host: "127.3.16.189" port: 33115 } } peers { permanent_uuid: "6264231708b34cbfb313f4cb083d8104" member_type: VOTER last_known_addr { host: "127.3.16.188" port: 35877 } } }
20:04:51.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.742072  3932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552 [sys.catalog]: This master's current role is: LEADER
20:04:51.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.743863  3934 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:04:51.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.751925  3934 catalog_manager.cc:679] Loaded metadata for table TestMasterFailover-killBefore=SCAN_TABLE [id=daf58bf8b17e4d15ade87fc76de90e12]
20:04:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.757036  3934 tablet_loader.cc:96] loaded metadata for tablet fac8e1cbdd0f4cf987c286612b22b3e8 (table TestMasterFailover-killBefore=SCAN_TABLE [id=daf58bf8b17e4d15ade87fc76de90e12])
20:04:51.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.758241  3934 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:04:51.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.760834  3934 catalog_manager.cc:1294] Loaded cluster ID: 71e9a189ae1846e9aa58c372bfa7c22d
20:04:51.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.761040  3934 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:04:51.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.763962  3934 catalog_manager.cc:1539] Loading token signing keys...
20:04:51.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.766377  3934 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 550bf95676c14d04b3ec4adb5b856552: Loaded TSK: 0
20:04:51.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:51.767379  3934 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:04:51.957 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.3.16.188:35877(127.3.16.188:35877)] connecting to peer
20:04:51.958 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:51.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.16.188:35877(127.3.16.188:35877)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:51.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.16.188:35877: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877
20:04:51.964 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:04:51.971 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=14, TimeoutTracker(timeout=30000, elapsed=3555), Traces: [0ms] sending RPC to server master-127.3.16.188:35877, [3ms] received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [23ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [28ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [29ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [29ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [43ms] refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [47ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [50ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [67ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [69ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [83ms] refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [88ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [107ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [108ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [146ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [147ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [147ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [148ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [223ms] refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [227ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [231ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [242ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [263ms] refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [266ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [271ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [273ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [273ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [763ms] refreshing cache from master, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [767ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [768ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [768ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1283ms] refreshing cache from master, [1284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [1284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [1285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [1286ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1287ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [1288ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [1288ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1523ms] refreshing cache from master, [1523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [1523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [1524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [1525ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1527ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [1527ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [1528ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1684ms] refreshing cache from master, [1684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [1684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [1685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [1686ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1687ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [1688ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [1688ms] delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [3547ms] refreshing cache from master, [3547ms] too many traces: truncated at 100 traces, deferred=Deferred@1062995009(state=PENDING, result=null, callback=get tablet locations from the master for table TestMasterFailover-killBefore=SCAN_TABLE -> release master lookup permit -> retry RPC -> scanner opened -> passthrough -> org.apache.kudu.test.ClientTestUtil$2@7d26ddd5 -> wakeup thread Time-limited test -> (continuation of Deferred@580608189 after retry RPC after error@1689461095) -> (continuation of Deferred@991059900 after retry RPC after error@1880225150) -> (continuation of Deferred@167177545 after retry RPC after error@1957907721) -> (continuation of Deferred@1567949724 after retry RPC after error@573613897) -> (continuation of Deferred@470981347 after retry RPC after error@1923569517) -> (continuation of Deferred@129745734 after retry RPC after error@538326551) -> (continuation of Deferred@685471092 after retry RPC after error@1611617085) -> (continuation of Deferred@972496265 after retry RPC after error@683680302) -> (continuation of Deferred@1531150999 after retry RPC after error@1095742585) -> (continuation of Deferred@1079374476 after retry RPC after error@1772976634) -> (continuation of Deferred@775756130 after retry RPC after error@317562016) -> (continuation of Deferred@2109988323 after retry RPC after error@2141395208), errback=passthrough -> release master lookup permit -> retry RPC after error -> passthrough -> open scanner errback -> org.apache.kudu.test.ClientTestUtil$1@3913e997 -> wakeup thread Time-limited test -> (continuation of Deferred@580608189 after retry RPC after error@1689461095) -> (continuation of Deferred@991059900 after retry RPC after error@1880225150) -> (continuation of Deferred@167177545 after retry RPC after error@1957907721) -> (continuation of Deferred@1567949724 after retry RPC after error@573613897) -> (continuation of Deferred@470981347 after retry RPC after error@1923569517) -> (continuation of Deferred@129745734 after retry RPC after error@538326551) -> (continuation of Deferred@685471092 after retry RPC after error@1611617085) -> (continuation of Deferred@972496265 after retry RPC after error@683680302) -> (continuation of Deferred@1531150999 after retry RPC after error@1095742585) -> (continuation of Deferred@1079374476 after retry RPC after error@1772976634) -> (continuation of Deferred@775756130 after retry RPC after error@317562016) -> (continuation of Deferred@2109988323 after retry RPC after error@2141395208))) after lookup
20:04:51.980 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet fac8e1cbdd0f4cf987c286612b22b3e8 for table 'TestMasterFailover-killBefore=SCAN_TABLE' with partition [<start>, <end>)
20:04:51.980 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=fac8e1cbdd0f4cf987c286612b22b3e8@[0e1bc70aee884f049c8f339a233a6edb(127.3.16.130:37421),0ee4555f5dea40a796a311dc574e1774(127.3.16.129:40153),9ba55f5678004296be8e58360e7eebbc(127.3.16.131:34891)[L]]}]
20:04:51.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3571), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.16.188:35877, [3ms] Sub RPC GetTableLocations: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [3ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [23ms] Sub RPC GetTableLocations: refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [27ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [28ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [29ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [29ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [43ms] Sub RPC GetTableLocations: refreshing cache from master, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [47ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [48ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [63ms] Sub RPC GetTableLocations: refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [67ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [68ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [69ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [83ms] Sub RPC GetTableLocations: refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [88ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [88ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [103ms] Sub RPC GetTableLocations: refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [107ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [108ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [143ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [146ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [147ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [147ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [148ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [223ms] Sub RPC GetTableLocations: refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [227ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [231ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [242ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [263ms] Sub RPC GetTableLocations: refreshing cache from master, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [264ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [266ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [271ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [273ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [273ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [763ms] Sub RPC GetTableLocations: refreshing cache from master, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [764ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [767ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [768ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [768ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1283ms] Sub RPC GetTableLocations: refreshing cache from master, [1284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [1284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [1285ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [1286ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1287ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [1288ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [1288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1523ms] Sub RPC GetTableLocations: refreshing cache from master, [1523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [1523ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [1524ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [1525ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1527ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [1527ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [1528ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1684ms] Sub RPC GetTableLocations: refreshing cache from master, [1684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.189:33115, [1684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.188:35877, [1685ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.16.190:38391, [1686ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.188:35877: Network error: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [1687ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.189:33115: OK, [1688ms] Sub RPC ConnectToMaster: received response from server master-127.3.16.190:38391: OK, [1688ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.16.189:33115,127.3.16.188:35877,127.3.16.190:38391) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.16.188:35877(127.3.16.188:35877): Connection refused: /127.3.16.188:35877, [3547ms] too many traces: truncated at 100 traces, deferred=null)) after lookup
20:04:51.985 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 9ba55f5678004296be8e58360e7eebbc(127.3.16.131:34891)] connecting to peer
20:04:51.986 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 9ba55f5678004296be8e58360e7eebbc(127.3.16.131:34891)] Successfully connected to peer
20:04:52.018 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9fc4defa, L:/127.0.0.1:44662 - R:/127.3.16.131:34891] using TOKEN/null
20:04:52.027 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=SCAN_TABLE, tablet=fac8e1cbdd0f4cf987c286612b22b3e8, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:04:52.028 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:52.038 [DEBUG - main] (Connection.java:575) [peer master-127.3.16.188:35877(127.3.16.188:35877)] disconnecting while in state TERMINATED
20:04:52.038 [DEBUG - main] (Connection.java:575) [peer master-127.3.16.190:38391(127.3.16.190:38391)] disconnecting while in state READY
20:04:52.038 [DEBUG - main] (Connection.java:575) [peer master-127.3.16.189:33115(127.3.16.189:33115)] disconnecting while in state READY
20:04:52.038 [DEBUG - main] (Connection.java:575) [peer 9ba55f5678004296be8e58360e7eebbc(127.3.16.131:34891)] disconnecting while in state READY
20:04:52.039 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 9ba55f5678004296be8e58360e7eebbc(127.3.16.131:34891)] handling channelInactive
20:04:52.039 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9ba55f5678004296be8e58360e7eebbc(127.3.16.131:34891)] cleaning up while in state READY due to: connection closed
20:04:52.039 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.16.189:33115(127.3.16.189:33115)] handling channelInactive
20:04:52.040 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:04:52.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.16.189:33115(127.3.16.189:33115)] cleaning up while in state READY due to: connection closed
20:04:52.041 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.16.190:38391(127.3.16.190:38391)] handling channelInactive
20:04:52.041 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.16.190:38391(127.3.16.190:38391)] cleaning up while in state READY due to: connection closed
20:04:52.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:52.042183  3138 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3421
20:04:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:52.068207  3138 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3579
20:04:52.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:52.097075  3742 connection.cc:582] client connection to 127.3.16.130:37421 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:04:52.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:52.097576  3742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:04:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:52.098619  3138 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3721
20:04:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:52.128000  3138 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3150
20:04:52.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:52.160352  3138 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3220
20:04:53.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:53Z chronyd exiting
.20:04:54.393 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779134694392
20:04:54.395 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:04:54.396 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:04:54.396 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskP4R3uz/test-tmp
20:04:54.396 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:04:54.396 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskP4R3uz/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:04:54.399 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:04:54.730 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:04:54.731 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:04:54.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:54.734210  3947 mini_oidc.cc:150] Starting JWKS server
20:04:54.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:54.737406  3947 webserver.cc:533] Webserver started at http://127.0.0.1:36435/ using document root <none> and password file <none>
20:04:54.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:54.737825  3947 mini_oidc.cc:186] Starting OIDC Discovery server
20:04:54.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:54.739555  3947 webserver.cc:533] Webserver started at http://127.0.0.1:46273/ using document root <none> and password file <none>
20:04:54.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:54Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:04:54.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:04:54Z Disabled control of system clock
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:54.802208  3947 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:54.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/logs
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data/info.pb
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.254:37865
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.254
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:54.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36435/jwks.json with env {}
20:04:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.109627  3959 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.110193  3959 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.110639  3959 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:55.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.144583  3959 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:55.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.144874  3959 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:55.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.145064  3959 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:55.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.145272  3959 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:55.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.145464  3959 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:55.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.145610  3959 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36435/jwks.json
20:04:55.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:55.187553  3959 master_runner.cc:387] Master server non-default flags:
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.254:37865
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36435/jwks.json
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data/info.pb
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.254
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/logs
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:55.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:55.188832  3959 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:55.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:55.190407  3959 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:55.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.200840  3965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:56.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:55.202706  3966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:56.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.407886  3968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:56.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.411193  3967 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1203 milliseconds
20:04:56.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.411279  3959 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:56.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.412552  3959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:56.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.415089  3959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:56.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.416452  3959 hybrid_clock.cc:648] HybridClock initialized: now 1779134696416420 us; error 52 us; skew 500 ppm
20:04:56.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.417240  3959 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:56.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.423346  3959 webserver.cc:533] Webserver started at http://127.3.218.254:40543/ using document root <none> and password file <none>
20:04:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.424219  3959 fs_manager.cc:362] Metadata directory not provided
20:04:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.424404  3959 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:56.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.424796  3959 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:56.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.429150  3959 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data/instance:
20:04:56.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33490c314afc4076bc8725e201d3511e"
20:04:56.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:56 on dist-test-slave-nsdw"
20:04:56.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.430174  3959 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal/instance:
20:04:56.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33490c314afc4076bc8725e201d3511e"
20:04:56.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:56 on dist-test-slave-nsdw"
20:04:56.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.437045  3959 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
20:04:56.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.442538  3975 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:56.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.443661  3959 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
20:04:56.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.444037  3959 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal
20:04:56.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33490c314afc4076bc8725e201d3511e"
20:04:56.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:56 on dist-test-slave-nsdw"
20:04:56.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.444376  3959 fs_report.cc:389] FS layout report
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data/data
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:56.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:56.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.498430  3959 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:56.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.500080  3959 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:56.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.500615  3959 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:56.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.572456  3959 rpc_server.cc:307] RPC server started. Bound to: 127.3.218.254:37865
20:04:56.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.572527  4026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.218.254:37865 every 8 connection(s)
20:04:56.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.575426  3959 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/data/info.pb
20:04:56.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.576278  3947 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 3959
20:04:56.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.576637  3947 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-0/wal/instance
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.582638  3947 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/logs
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data/info.pb
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.253:37995
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.253
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:56.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:04:56.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:56.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36435/jwks.json with env {}
20:04:56.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.583508  4027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:56.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.596405  4027 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } has no permanent_uuid. Determining permanent_uuid...
20:04:56.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.625907  4027 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } has no permanent_uuid. Determining permanent_uuid...
20:04:56.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.628613  3976 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:56.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.632710  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:56.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.682214  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 1
20:04:56.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.686321  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:56.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.754902  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 2
20:04:56.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.758795  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:56.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.850283  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 3
20:04:56.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.854194  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:56.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.898488  4029 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:56.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.899106  4029 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:56.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.899580  4029 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:56.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.932866  4029 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:56.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.933151  4029 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:56.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.933343  4029 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:56.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.933549  4029 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:56.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.933743  4029 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:56.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.933889  4029 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36435/jwks.json
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.971037  4029 master_runner.cc:387] Master server non-default flags:
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.253:37995
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36435/jwks.json
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data/info.pb
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.253
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:56.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/logs
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:56.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.972460  4029 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:56.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.974236  4029 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:56.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.985198  4038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:56.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:56.997671  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 4
20:04:57.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:57.005461  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:57.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:57.305044  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 5
20:04:57.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:57.312320  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:57.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:57.859877  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 6
20:04:57.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:57.897254  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.389286  4037 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 4029
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:56.986356  4039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.824222  4037 kernel_stack_watchdog.cc:198] Thread 4029 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:04:58.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.824618  4029 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.839s	user 0.695s	sys 1.141s
20:04:58.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.825115  4029 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.840s	user 0.696s	sys 1.141s
20:04:58.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.826642  4041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:58.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.829600  4040 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1838 milliseconds
20:04:58.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.829679  4029 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:04:58.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.831022  4029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:04:58.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.833500  4029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:04:58.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.834946  4029 hybrid_clock.cc:648] HybridClock initialized: now 1779134698834911 us; error 39 us; skew 500 ppm
20:04:58.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.835788  4029 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:04:58.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.842217  4029 webserver.cc:533] Webserver started at http://127.3.218.253:41631/ using document root <none> and password file <none>
20:04:58.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.843307  4029 fs_manager.cc:362] Metadata directory not provided
20:04:58.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.843552  4029 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:04:58.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.844102  4029 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:04:58.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.848579  4029 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data/instance:
20:04:58.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7509b2b1342744809e8c2f5c41ae91a4"
20:04:58.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:58 on dist-test-slave-nsdw"
20:04:58.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.849706  4029 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal/instance:
20:04:58.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7509b2b1342744809e8c2f5c41ae91a4"
20:04:58.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:58 on dist-test-slave-nsdw"
20:04:58.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.857100  4029 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.001s
20:04:58.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.862947  4050 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:04:58.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.864084  4029 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
20:04:58.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.864485  4029 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal
20:04:58.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7509b2b1342744809e8c2f5c41ae91a4"
20:04:58.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:04:58 on dist-test-slave-nsdw"
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.864842  4029 fs_report.cc:389] FS layout report
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data/data
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:04:58.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:04:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.926710  4029 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:04:58.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.928364  4029 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:04:58.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.928891  4029 kserver.cc:163] Server-wide thread pool size limit: 3276
20:04:58.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:58.957834  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 7
20:04:58.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:58.965574  4027 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.253:37995: Network error: Client connection negotiation failed: client connection to 127.3.218.253:37995: connect: Connection refused (error 111)
20:04:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.007072  4029 rpc_server.cc:307] RPC server started. Bound to: 127.3.218.253:37995
20:04:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.007143  4103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.218.253:37995 every 8 connection(s)
20:04:59.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.009927  4029 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/data/info.pb
20:04:59.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.011440  3947 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 4029
20:04:59.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.011916  3947 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-1/wal/instance
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.015022  3947 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/logs
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data/info.pb
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:04:59.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.252:43127
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.252
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:59.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36435/jwks.json with env {}
20:04:59.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.017750  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:04:59.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.030571  4104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } has no permanent_uuid. Determining permanent_uuid...
20:04:59.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.052201  4104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } has no permanent_uuid. Determining permanent_uuid...
20:04:59.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.067694  4104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } has no permanent_uuid. Determining permanent_uuid...
20:04:59.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.070140  4054 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:04:59.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.074442  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:04:59.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.123961  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 1
20:04:59.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.128114  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:04:59.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.196502  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 2
20:04:59.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.200584  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:04:59.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.292053  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 3
20:04:59.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.296084  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:04:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.339819  4106 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:04:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.340373  4106 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:04:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.340819  4106 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:04:59.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.373941  4106 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:04:59.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.374311  4106 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:04:59.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.374557  4106 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:04:59.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.374759  4106 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:04:59.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.374979  4106 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:04:59.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.375129  4106 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36435/jwks.json
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.412660  4106 master_runner.cc:387] Master server non-default flags:
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.252:43127
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36435/jwks.json
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data/info.pb
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.252
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/logs
20:04:59.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:04:59.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.413941  4106 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:04:59.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.415573  4106 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:04:59.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.425848  4116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:04:59.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.439492  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 4
20:04:59.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.443277  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:04:59.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:04:59.742707  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 5
20:04:59.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.749632  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:00.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.297272  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 6
20:05:00.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:00.315882  4104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.218.252:43127: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:00.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.428776  4117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:00.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:04:59.431053  4119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:00.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:00.662256  4118 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1231 milliseconds
20:05:00.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.662382  4106 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:05:00.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.663635  4106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:05:00.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.666164  4106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:05:00.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.667613  4106 hybrid_clock.cc:648] HybridClock initialized: now 1779134700667582 us; error 40 us; skew 500 ppm
20:05:00.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.668486  4106 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:05:00.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.675434  4106 webserver.cc:533] Webserver started at http://127.3.218.252:36273/ using document root <none> and password file <none>
20:05:00.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.676529  4106 fs_manager.cc:362] Metadata directory not provided
20:05:00.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.676782  4106 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:05:00.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.677337  4106 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:05:00.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.682009  4106 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data/instance:
20:05:00.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10935e66d011489faee1035528a7402e"
20:05:00.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:00 on dist-test-slave-nsdw"
20:05:00.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.683301  4106 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal/instance:
20:05:00.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10935e66d011489faee1035528a7402e"
20:05:00.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:00 on dist-test-slave-nsdw"
20:05:00.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.691051  4106 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
20:05:00.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.696916  4128 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:05:00.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.698200  4106 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.698585  4106 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10935e66d011489faee1035528a7402e"
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:00 on dist-test-slave-nsdw"
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.698997  4106 fs_report.cc:389] FS layout report
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data/data
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:05:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:05:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:05:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:05:00.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.755048  4106 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:05:00.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.756645  4106 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:05:00.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.757159  4106 kserver.cc:163] Server-wide thread pool size limit: 3276
20:05:00.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.828349  4106 rpc_server.cc:307] RPC server started. Bound to: 127.3.218.252:43127
20:05:00.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.828442  4179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.218.252:43127 every 8 connection(s)
20:05:00.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.831382  4106 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/data/info.pb
20:05:00.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.838078  4180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:05:00.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.840144  3947 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 4106
20:05:00.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.840615  3947 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/master-2/wal/instance
20:05:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.850185  4180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } has no permanent_uuid. Determining permanent_uuid...
20:05:00.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.879776  4180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } has no permanent_uuid. Determining permanent_uuid...
20:05:00.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.892318  4180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } has no permanent_uuid. Determining permanent_uuid...
20:05:00.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.908481  4180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: Bootstrap starting.
20:05:00.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.914906  4180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: Neither blocks nor log segments found. Creating new log.
20:05:00.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.917057  4180 log.cc:826] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: Log is configured to *not* fsync() on all Append() calls
20:05:00.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.921828  4180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: No bootstrap required, opened a new log
20:05:00.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.941865  4180 raft_consensus.cc:359] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:00.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.942507  4180 raft_consensus.cc:385] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:05:00.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.942709  4180 raft_consensus.cc:740] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10935e66d011489faee1035528a7402e, State: Initialized, Role: FOLLOWER
20:05:00.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.943517  4180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:00.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.946126  4190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:00.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.947037  4190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: This master's current role is: FOLLOWER
20:05:00.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.947736  4180 sys_catalog.cc:565] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: configured and running, proceeding with master startup.
20:05:00.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:00.972944  4201 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:05:00.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:00.973317  4201 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:05:00.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.968528  4106 master_runner.cc:187] Error getting master registration for 127.3.218.254:37865: OK, instance_id { permanent_uuid: "33490c314afc4076bc8725e201d3511e" instance_seqno: 1779134696552836 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:05:00.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:00.992224  4106 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:05:01.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:01.012535  4134 tablet.cc:2404] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:05:01.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.056031  4027 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } attempt: 8
20:05:01.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.072023  4027 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } has no permanent_uuid. Determining permanent_uuid...
20:05:01.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.090365  4027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: Bootstrap starting.
20:05:01.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.096282  4027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: Neither blocks nor log segments found. Creating new log.
20:05:01.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.098237  4027 log.cc:826] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: Log is configured to *not* fsync() on all Append() calls
20:05:01.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.100198  4190 raft_consensus.cc:493] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:05:01.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.100790  4190 raft_consensus.cc:515] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.104033  4027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: No bootstrap required, opened a new log
20:05:01.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.104642  4190 leader_election.cc:290] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33490c314afc4076bc8725e201d3511e (127.3.218.254:37865), 7509b2b1342744809e8c2f5c41ae91a4 (127.3.218.253:37995)
20:05:01.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.133962  4027 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.134982  4027 raft_consensus.cc:385] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:05:01.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.135315  4027 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33490c314afc4076bc8725e201d3511e, State: Initialized, Role: FOLLOWER
20:05:01.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.136298  4027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.139801  4205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.142385  4205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: This master's current role is: FOLLOWER
20:05:01.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.143682  4027 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: configured and running, proceeding with master startup.
20:05:01.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.143877  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "10935e66d011489faee1035528a7402e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33490c314afc4076bc8725e201d3511e" is_pre_election: true
20:05:01.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.144843  4002 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10935e66d011489faee1035528a7402e in term 0.
20:05:01.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.146498  4132 leader_election.cc:304] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10935e66d011489faee1035528a7402e, 33490c314afc4076bc8725e201d3511e; no voters: 
20:05:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.148126  4190 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Leader pre-election won for term 1
20:05:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.148530  4190 raft_consensus.cc:493] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:05:01.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.148918  4190 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 0 FOLLOWER]: Advancing to term 1
20:05:01.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.160106  4190 raft_consensus.cc:515] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.165970  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "10935e66d011489faee1035528a7402e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33490c314afc4076bc8725e201d3511e"
20:05:01.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.166767  4002 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 0 FOLLOWER]: Advancing to term 1
20:05:01.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.176772  4002 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10935e66d011489faee1035528a7402e in term 1.
20:05:01.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.178054  4132 leader_election.cc:304] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10935e66d011489faee1035528a7402e, 33490c314afc4076bc8725e201d3511e; no voters: 
20:05:01.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.184520  4190 leader_election.cc:290] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [CANDIDATE]: Term 1 election: Requested vote from peers 33490c314afc4076bc8725e201d3511e (127.3.218.254:37865), 7509b2b1342744809e8c2f5c41ae91a4 (127.3.218.253:37995)
20:05:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.186919  4190 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 1 FOLLOWER]: Leader election won for term 1
20:05:01.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.190306  4190 raft_consensus.cc:697] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [term 1 LEADER]: Becoming Leader. State: Replica: 10935e66d011489faee1035528a7402e, State: Running, Role: LEADER
20:05:01.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.192586  4190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.208407  4212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10935e66d011489faee1035528a7402e. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.214252  4212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: This master's current role is: LEADER
20:05:01.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.224434  4219 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:05:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.232157  4219 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:05:01.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:01.234018  4218 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:05:01.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:01.234369  4218 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:05:01.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.223731  3959 master_runner.cc:187] Error getting master registration for 127.3.218.253:37995: OK, instance_id { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" instance_seqno: 1779134698985854 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:05:01.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.257146  3959 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:05:01.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:01.261438  3981 tablet.cc:2404] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:05:01.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.268384  4002 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Refusing update from remote peer 10935e66d011489faee1035528a7402e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:05:01.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.270143  4212 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:05:01.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.312022  4205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10935e66d011489faee1035528a7402e. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.313048  4205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: This master's current role is: FOLLOWER
20:05:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.324397  4205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.325150  4205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: This master's current role is: FOLLOWER
20:05:01.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.330458  4219 catalog_manager.cc:1382] Generated new cluster ID: d40e421039ab43579a9ed7d4f2c45853
20:05:01.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.330747  4219 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:05:01.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.331701  4212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.332433  4212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: This master's current role is: LEADER
20:05:01.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.375730  4219 catalog_manager.cc:1405] Generated new certificate authority record
20:05:01.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.376415  4104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } attempt: 7
20:05:01.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.378161  4219 catalog_manager.cc:1539] Loading token signing keys...
20:05:01.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.401393  4104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: Bootstrap starting.
20:05:01.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.420737  4219 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e: Generated new TSK 0
20:05:01.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.421785  4104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: Neither blocks nor log segments found. Creating new log.
20:05:01.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.423843  4219 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:05:01.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.424787  4104 log.cc:826] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: Log is configured to *not* fsync() on all Append() calls
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.448648  3947 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/logs
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data/info.pb
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.193:0
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.218.193
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.193
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:05:01.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:05:01.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:05:01.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:05:01.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:05:01.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:05:01.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.454895  4104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: No bootstrap required, opened a new log
20:05:01.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.484805  4104 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.485723  4104 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:05:01.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.486016  4104 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7509b2b1342744809e8c2f5c41ae91a4, State: Initialized, Role: FOLLOWER
20:05:01.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.486960  4104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:01.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.499971  4230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.500885  4230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: This master's current role is: FOLLOWER
20:05:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.501850  4104 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: configured and running, proceeding with master startup.
20:05:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.502050  4079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "10935e66d011489faee1035528a7402e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7509b2b1342744809e8c2f5c41ae91a4" is_pre_election: true
20:05:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.502959  4079 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10935e66d011489faee1035528a7402e in term 0.
20:05:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.504287  4077 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 0 FOLLOWER]: Advancing to term 1
20:05:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.511165  4078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "10935e66d011489faee1035528a7402e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7509b2b1342744809e8c2f5c41ae91a4"
20:05:01.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.516450  4077 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 1 FOLLOWER]: Refusing update from remote peer 10935e66d011489faee1035528a7402e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:05:01.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.518352  4226 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:05:01.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.588421  4230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10935e66d011489faee1035528a7402e. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.588979  4230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: This master's current role is: FOLLOWER
20:05:01.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.590924  4240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:01.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.591728  4240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: This master's current role is: FOLLOWER
20:05:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.625952  4246 catalog_manager.cc:1294] Loaded cluster ID: d40e421039ab43579a9ed7d4f2c45853
20:05:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.626231  4246 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: loading cluster ID for follower catalog manager: success
20:05:01.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.648191  4246 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: acquiring CA information for follower catalog manager: success
20:05:01.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.671742  4246 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:05:01.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:01.994401  4248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "10935e66d011489faee1035528a7402e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:02.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.000252  4248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10935e66d011489faee1035528a7402e [sys.catalog]: This master's current role is: LEADER
20:05:02.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.043083  4229 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:05:02.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.043841  4229 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:05:02.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.044525  4229 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:05:02.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.108800  4229 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:05:02.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.110146  4229 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.218.193
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.179051  4229 tablet_server_runner.cc:78] Tablet server non-default flags:
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:05:02.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.193:0
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data/info.pb
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.193
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.218.193
20:05:02.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/logs
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:05:02.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.180905  4229 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:05:02.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.183316  4229 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:05:02.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.212630  4256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:02.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.239935  4218 catalog_manager.cc:1294] Loaded cluster ID: d40e421039ab43579a9ed7d4f2c45853
20:05:02.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.240537  4218 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: loading cluster ID for follower catalog manager: success
20:05:02.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.260092  4218 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: acquiring CA information for follower catalog manager: success
20:05:02.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:02.265916  4218 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:05:04.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:03.605521  4255 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 4229
20:05:04.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:02.217971  4257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:04.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:04.854344  4255 kernel_stack_watchdog.cc:198] Thread 4229 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 388ms:
20:05:04.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:05:04.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:05:04.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:05:04.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:05:04.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:04.855124  4229 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.639s	user 0.742s	sys 1.180s
20:05:04.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:04.859790  4229 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.644s	user 0.742s	sys 1.181s
20:05:04.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:04.866007  4262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:04.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.866070  4229 server_base.cc:1061] running on GCE node
20:05:04.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.867913  4229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:05:04.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.870478  4229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:05:04.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.872025  4229 hybrid_clock.cc:648] HybridClock initialized: now 1779134704871890 us; error 130 us; skew 500 ppm
20:05:04.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.873076  4229 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:05:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.880764  4229 webserver.cc:533] Webserver started at http://127.3.218.193:42063/ using document root <none> and password file <none>
20:05:04.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.882002  4229 fs_manager.cc:362] Metadata directory not provided
20:05:04.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.882269  4229 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:05:04.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.882808  4229 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:05:04.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.889757  4229 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data/instance:
20:05:04.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b0d8e132946043c59a76ba90022a7228"
20:05:04.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:04 on dist-test-slave-nsdw"
20:05:04.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.891260  4229 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal/instance:
20:05:04.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b0d8e132946043c59a76ba90022a7228"
20:05:04.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:04 on dist-test-slave-nsdw"
20:05:04.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.900872  4229 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
20:05:04.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.908448  4267 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:05:04.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.910190  4229 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
20:05:04.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.910863  4229 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal
20:05:04.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b0d8e132946043c59a76ba90022a7228"
20:05:04.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:04 on dist-test-slave-nsdw"
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.911541  4229 fs_report.cc:389] FS layout report
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data/data
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:05:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:05:04.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.978410  4229 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:05:04.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.980612  4229 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:05:04.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.981185  4229 kserver.cc:163] Server-wide thread pool size limit: 3276
20:05:04.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.984783  4229 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:05:04.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.990698  4229 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:05:04.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.991008  4229 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
20:05:04.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.991317  4229 ts_tablet_manager.cc:616] Registered 0 tablets
20:05:04.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:04.991534  4229 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:05:05.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.271119  4229 rpc_server.cc:307] RPC server started. Bound to: 127.3.218.193:37029
20:05:05.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.271588  4380 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.218.193:37029 every 8 connection(s)
20:05:05.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.273680  4229 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/data/info.pb
20:05:05.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.275784  3947 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 4229
20:05:05.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.276518  3947 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-0/wal/instance
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.290498  3947 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/logs
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data/info.pb
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:05:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.194:0
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.218.194
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.194
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:05:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:05:05.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.317102  4381 heartbeater.cc:344] Connected to a master server at 127.3.218.253:37995
20:05:05.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.317786  4381 heartbeater.cc:461] Registering TS with master...
20:05:05.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.319505  4381 heartbeater.cc:507] Master 127.3.218.253:37995 requested a full tablet report, sending...
20:05:05.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.324098  4067 ts_manager.cc:194] Registered new tserver with Master: b0d8e132946043c59a76ba90022a7228 (127.3.218.193:37029)
20:05:05.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.327841  4382 heartbeater.cc:344] Connected to a master server at 127.3.218.252:43127
20:05:05.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.328181  4382 heartbeater.cc:461] Registering TS with master...
20:05:05.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.329097  4382 heartbeater.cc:507] Master 127.3.218.252:43127 requested a full tablet report, sending...
20:05:05.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.331357  4145 ts_manager.cc:194] Registered new tserver with Master: b0d8e132946043c59a76ba90022a7228 (127.3.218.193:37029)
20:05:05.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.333928  4145 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.218.193:59433
20:05:05.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.338557  4385 heartbeater.cc:344] Connected to a master server at 127.3.218.254:37865
20:05:05.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.338898  4385 heartbeater.cc:461] Registering TS with master...
20:05:05.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.339622  4385 heartbeater.cc:507] Master 127.3.218.254:37865 requested a full tablet report, sending...
20:05:05.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.342631  3992 ts_manager.cc:194] Registered new tserver with Master: b0d8e132946043c59a76ba90022a7228 (127.3.218.193:37029)
20:05:05.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.649219  4388 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:05:05.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.649821  4388 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:05:05.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.650380  4388 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:05:05.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.685854  4388 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:05:05.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.686793  4388 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.218.194
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.724521  4388 tablet_server_runner.cc:78] Tablet server non-default flags:
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.194:0
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data/info.pb
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.194
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.218.194
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/logs
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:05:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:05:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.726258  4388 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:05:05.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:05.728304  4388 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:05:05.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.740944  4396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:06.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:06.337884  4382 heartbeater.cc:499] Master 127.3.218.252:43127 was elected leader, sending a full tablet report...
20:05:07.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:05.741019  4397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:07.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.008199  4388 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.269s	user 0.485s	sys 0.783s
20:05:07.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.008900  4388 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.270s	user 0.486s	sys 0.784s
20:05:07.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.015805  4388 server_base.cc:1061] running on GCE node
20:05:07.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.016440  4402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:07.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.017973  4388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:05:07.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.020833  4388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:05:07.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.022425  4388 hybrid_clock.cc:648] HybridClock initialized: now 1779134707022348 us; error 77 us; skew 500 ppm
20:05:07.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.023530  4388 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:05:07.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.032239  4388 webserver.cc:533] Webserver started at http://127.3.218.194:39277/ using document root <none> and password file <none>
20:05:07.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.033507  4388 fs_manager.cc:362] Metadata directory not provided
20:05:07.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.033792  4388 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:05:07.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.034394  4388 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:05:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.041846  4388 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data/instance:
20:05:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "447c889737b74d95ba54ccfc6bd35aab"
20:05:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:07 on dist-test-slave-nsdw"
20:05:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.043599  4388 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal/instance:
20:05:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "447c889737b74d95ba54ccfc6bd35aab"
20:05:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:07 on dist-test-slave-nsdw"
20:05:07.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.054117  4388 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.000s
20:05:07.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.061918  4407 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:05:07.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.063244  4388 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.063618  4388 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "447c889737b74d95ba54ccfc6bd35aab"
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:07 on dist-test-slave-nsdw"
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.064023  4388 fs_report.cc:389] FS layout report
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data/data
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:05:07.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:05:07.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:05:07.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:05:07.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:05:07.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:05:07.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.133862  4388 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:05:07.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.135560  4388 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:05:07.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.136089  4388 kserver.cc:163] Server-wide thread pool size limit: 3276
20:05:07.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.138715  4388 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:05:07.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.143177  4388 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:05:07.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.143414  4388 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:05:07.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.143759  4388 ts_tablet_manager.cc:616] Registered 0 tablets
20:05:07.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.143949  4388 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:05:07.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.281466  4388 rpc_server.cc:307] RPC server started. Bound to: 127.3.218.194:35041
20:05:07.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.281523  4519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.218.194:35041 every 8 connection(s)
20:05:07.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.285346  4388 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/data/info.pb
20:05:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.291268  3947 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 4388
20:05:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.291744  3947 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-1/wal/instance
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.307482  3947 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/logs
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data/info.pb
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:05:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.195:0
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.218.195
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.195
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:05:07.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:05:07.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.336771  4520 heartbeater.cc:344] Connected to a master server at 127.3.218.253:37995
20:05:07.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.337265  4520 heartbeater.cc:461] Registering TS with master...
20:05:07.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.338007  4522 heartbeater.cc:344] Connected to a master server at 127.3.218.254:37865
20:05:07.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.338352  4522 heartbeater.cc:461] Registering TS with master...
20:05:07.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.338478  4520 heartbeater.cc:507] Master 127.3.218.253:37995 requested a full tablet report, sending...
20:05:07.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.339534  4522 heartbeater.cc:507] Master 127.3.218.254:37865 requested a full tablet report, sending...
20:05:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.342310  4067 ts_manager.cc:194] Registered new tserver with Master: 447c889737b74d95ba54ccfc6bd35aab (127.3.218.194:35041)
20:05:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.342432  3992 ts_manager.cc:194] Registered new tserver with Master: 447c889737b74d95ba54ccfc6bd35aab (127.3.218.194:35041)
20:05:07.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.346571  4521 heartbeater.cc:344] Connected to a master server at 127.3.218.252:43127
20:05:07.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.347177  4521 heartbeater.cc:461] Registering TS with master...
20:05:07.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.348150  4521 heartbeater.cc:507] Master 127.3.218.252:43127 requested a full tablet report, sending...
20:05:07.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.350725  4144 ts_manager.cc:194] Registered new tserver with Master: 447c889737b74d95ba54ccfc6bd35aab (127.3.218.194:35041)
20:05:07.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.352521  4144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.218.194:50911
20:05:07.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.653889  4530 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:05:07.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.654366  4530 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:05:07.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.654760  4530 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:05:07.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.690001  4530 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:05:07.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.690771  4530 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.218.195
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.728796  4530 tablet_server_runner.cc:78] Tablet server non-default flags:
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.218.212:46357
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.218.195:0
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data/info.pb
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.218.195
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.218.254:37865,127.3.218.253:37995,127.3.218.252:43127
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.218.195
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/logs
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:05:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 19:43:23 UTC on e7f111948823
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11963
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:05:07.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.730149  4530 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:05:07.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:07.731812  4530 file_cache.cc:492] Constructed file cache file cache with capacity 419430
20:05:07.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.744737  4536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:08.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:08.357374  4521 heartbeater.cc:499] Master 127.3.218.252:43127 was elected leader, sending a full tablet report...
20:05:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:09.148764  4535 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 4530
20:05:09.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:09.406034  4530 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.661s	user 0.606s	sys 0.997s
20:05:09.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:09.406515  4530 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.662s	user 0.606s	sys 0.997s
20:05:09.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:07.745178  4537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:09.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:09.408568  4539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:05:09.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:09.411103  4538 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1662 milliseconds
20:05:09.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.411165  4530 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:05:09.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.412261  4530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:05:09.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.414256  4530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:05:09.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.415639  4530 hybrid_clock.cc:648] HybridClock initialized: now 1779134709415602 us; error 41 us; skew 500 ppm
20:05:09.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.416503  4530 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:05:09.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.422588  4530 webserver.cc:533] Webserver started at http://127.3.218.195:46615/ using document root <none> and password file <none>
20:05:09.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.423592  4530 fs_manager.cc:362] Metadata directory not provided
20:05:09.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.423834  4530 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:05:09.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.424343  4530 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:05:09.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.428710  4530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data/instance:
20:05:09.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1c80890445d94e318c0cf4d3eb58c3a5"
20:05:09.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:09 on dist-test-slave-nsdw"
20:05:09.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.429864  4530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal/instance:
20:05:09.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1c80890445d94e318c0cf4d3eb58c3a5"
20:05:09.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:09 on dist-test-slave-nsdw"
20:05:09.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.436947  4530 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
20:05:09.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.442567  4547 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:05:09.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.443677  4530 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
20:05:09.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.444052  4530 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data,/tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal
20:05:09.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1c80890445d94e318c0cf4d3eb58c3a5"
20:05:09.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 20:05:09 on dist-test-slave-nsdw"
20:05:09.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.444410  4530 fs_report.cc:389] FS layout report
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data/data
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:05:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:05:09.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.500774  4530 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:05:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.502326  4530 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:05:09.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.502911  4530 kserver.cc:163] Server-wide thread pool size limit: 3276
20:05:09.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.505697  4530 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:05:09.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.509984  4530 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:05:09.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.510226  4530 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:05:09.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.510557  4530 ts_tablet_manager.cc:616] Registered 0 tablets
20:05:09.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.510748  4530 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:05:09.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.659132  4530 rpc_server.cc:307] RPC server started. Bound to: 127.3.218.195:44031
20:05:09.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.659238  4659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.218.195:44031 every 8 connection(s)
20:05:09.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.661671  4530 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/data/info.pb
20:05:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.664897  3947 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu as pid 4530
20:05:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.665457  3947 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskP4R3uz/test-tmp/mini-kudu-cluster17540436524591469015/ts-2/wal/instance
20:05:09.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.697923  4661 heartbeater.cc:344] Connected to a master server at 127.3.218.252:43127
20:05:09.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.698437  4661 heartbeater.cc:461] Registering TS with master...
20:05:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.698813  4660 heartbeater.cc:344] Connected to a master server at 127.3.218.253:37995
20:05:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.699194  4660 heartbeater.cc:461] Registering TS with master...
20:05:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.699338  4662 heartbeater.cc:344] Connected to a master server at 127.3.218.254:37865
20:05:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.699738  4662 heartbeater.cc:461] Registering TS with master...
20:05:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.699918  4661 heartbeater.cc:507] Master 127.3.218.252:43127 requested a full tablet report, sending...
20:05:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.700244  4660 heartbeater.cc:507] Master 127.3.218.253:37995 requested a full tablet report, sending...
20:05:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.700647  4662 heartbeater.cc:507] Master 127.3.218.254:37865 requested a full tablet report, sending...
20:05:09.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.703236  4067 ts_manager.cc:194] Registered new tserver with Master: 1c80890445d94e318c0cf4d3eb58c3a5 (127.3.218.195:44031)
20:05:09.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.703351  4144 ts_manager.cc:194] Registered new tserver with Master: 1c80890445d94e318c0cf4d3eb58c3a5 (127.3.218.195:44031)
20:05:09.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.703516  3992 ts_manager.cc:194] Registered new tserver with Master: 1c80890445d94e318c0cf4d3eb58c3a5 (127.3.218.195:44031)
20:05:09.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.705384  4144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.218.195:51043
20:05:09.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.713354  3947 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
20:05:09.724 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:05:09.724 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:05:09.726 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.218.254"
      port: 37865
    }
    bound_http_address {
      host: "127.3.218.254"
      port: 40543
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.218.253"
      port: 37995
    }
    bound_http_address {
      host: "127.3.218.253"
      port: 41631
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.218.252"
      port: 43127
    }
    bound_http_address {
      host: "127.3.218.252"
      port: 36273
    }
  }
}

20:05:09.726 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:05:09.727 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.218.193"
      port: 37029
    }
    bound_http_address {
      host: "127.3.218.193"
      port: 42063
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.218.194"
      port: 35041
    }
    bound_http_address {
      host: "127.3.218.194"
      port: 39277
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.218.195"
      port: 44031
    }
    bound_http_address {
      host: "127.3.218.195"
      port: 46615
    }
  }
}

20:05:09.727 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:05:09.729 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:05:09.732 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:05:09.734 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.218.253:37995(127.3.218.253:37995)] connecting to peer
20:05:09.735 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.218.254:37865(127.3.218.254:37865)] connecting to peer
20:05:09.735 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.218.253:37995(127.3.218.253:37995)] Successfully connected to peer
20:05:09.736 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.738 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.218.252:43127(127.3.218.252:43127)] Successfully connected to peer
20:05:09.740 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.218.254:37865(127.3.218.254:37865)] Successfully connected to peer
20:05:09.741 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.218.252
20:05:09.742 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.218.253
20:05:09.743 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.218.254
20:05:09.758 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8a03ae00, L:/127.0.0.1:43668 - R:/127.3.218.252:43127] using SASL/PLAIN
20:05:09.762 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:05:09.762 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=29), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [28ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: OK, deferred=null) after lookup
20:05:09.762 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x10771ebf, L:/127.0.0.1:45142 - R:/127.3.218.254:37865] using SASL/PLAIN
20:05:09.765 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.3.218.252:43127
20:05:09.766 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:05:09.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:09.766631  3947 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 4106
20:05:09.768 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x26b23954, L:/127.0.0.1:43744 - R:/127.3.218.253:37995] using SASL/PLAIN
20:05:09.791 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.218.252:43127(127.3.218.252:43127)] handling channelInactive
20:05:09.791 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state READY due to: connection closed
20:05:09.793 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:05:09.794 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.796 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.3.218.252:43127(127.3.218.252:43127) for tablet Kudu Master: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.815 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.817 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.817 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.818 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:09.835 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.837 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.838 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.838 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.838 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:09.855 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.857 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.857 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.857 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.858 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:09.875 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.878 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.878 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.878 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.878 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:09.895 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.898 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:09.955 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.957 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:09.994 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:09.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:09.997 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:10.215 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:10.216 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.216 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.216 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.218 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:10.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:10.372556  4382 heartbeater.cc:646] Failed to heartbeat to 127.3.218.252:43127 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:10.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:10.380651  4521 heartbeater.cc:646] Failed to heartbeat to 127.3.218.252:43127 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:10.395 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:10.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.398 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:10.475 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:10.476 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.477 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.477 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.478 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:10.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:10.708964  4661 heartbeater.cc:499] Master 127.3.218.252:43127 was elected leader, sending a full tablet report...
20:05:10.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:10.712327  4661 heartbeater.cc:646] Failed to heartbeat to 127.3.218.252:43127 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:10.955 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:10.956 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.956 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.956 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:10.957 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127; will retry
20:05:10.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:10.995890  4683 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10935e66d011489faee1035528a7402e)
20:05:10.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:10.996349  4683 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:10.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:10.998308  4683 leader_election.cc:290] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7509b2b1342744809e8c2f5c41ae91a4 (127.3.218.253:37995), 10935e66d011489faee1035528a7402e (127.3.218.252:43127)
20:05:10.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:10.999257  4078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33490c314afc4076bc8725e201d3511e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7509b2b1342744809e8c2f5c41ae91a4" is_pre_election: true
20:05:11.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.001181  3979 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111) [suppressed 7 similar messages]
20:05:11.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.004004  3979 leader_election.cc:336] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 10935e66d011489faee1035528a7402e (127.3.218.252:43127): Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:11.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.004343  3979 leader_election.cc:304] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33490c314afc4076bc8725e201d3511e; no voters: 10935e66d011489faee1035528a7402e, 7509b2b1342744809e8c2f5c41ae91a4
20:05:11.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.004949  4683 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:05:11.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.191416  4686 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 10935e66d011489faee1035528a7402e)
20:05:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.191900  4686 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.193771  4686 leader_election.cc:290] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33490c314afc4076bc8725e201d3511e (127.3.218.254:37865), 10935e66d011489faee1035528a7402e (127.3.218.252:43127)
20:05:11.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.194816  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7509b2b1342744809e8c2f5c41ae91a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33490c314afc4076bc8725e201d3511e" is_pre_election: true
20:05:11.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.195554  4001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7509b2b1342744809e8c2f5c41ae91a4 in term 1.
20:05:11.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.196727  4054 leader_election.cc:304] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33490c314afc4076bc8725e201d3511e, 7509b2b1342744809e8c2f5c41ae91a4; no voters: 
20:05:11.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.197374  4054 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:05:11.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.197391  4686 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:05:11.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.197784  4686 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 10935e66d011489faee1035528a7402e)
20:05:11.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.198099  4686 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 1 FOLLOWER]: Advancing to term 2
20:05:11.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.200965  4054 leader_election.cc:336] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 10935e66d011489faee1035528a7402e (127.3.218.252:43127): Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:11.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.205111  4686 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:11.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.206589  4686 leader_election.cc:290] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [CANDIDATE]: Term 2 election: Requested vote from peers 33490c314afc4076bc8725e201d3511e (127.3.218.254:37865), 10935e66d011489faee1035528a7402e (127.3.218.252:43127)
20:05:11.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.207468  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7509b2b1342744809e8c2f5c41ae91a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33490c314afc4076bc8725e201d3511e"
20:05:11.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.207873  4001 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 1 FOLLOWER]: Advancing to term 2
20:05:11.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.210114  4054 leader_election.cc:336] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 10935e66d011489faee1035528a7402e (127.3.218.252:43127): Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111)
20:05:11.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.213490  4001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7509b2b1342744809e8c2f5c41ae91a4 in term 2.
20:05:11.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.214332  4054 leader_election.cc:304] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33490c314afc4076bc8725e201d3511e, 7509b2b1342744809e8c2f5c41ae91a4; no voters: 10935e66d011489faee1035528a7402e
20:05:11.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.215031  4686 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 2 FOLLOWER]: Leader election won for term 2
20:05:11.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.215793  4686 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [term 2 LEADER]: Becoming Leader. State: Replica: 7509b2b1342744809e8c2f5c41ae91a4, State: Running, Role: LEADER
20:05:11.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.216477  4686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } }
20:05:11.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.220598  4689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7509b2b1342744809e8c2f5c41ae91a4. Latest consensus state: current_term: 2 leader_uuid: "7509b2b1342744809e8c2f5c41ae91a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:11.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.221467  4689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: This master's current role is: LEADER
20:05:11.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.223740  4691 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
20:05:11.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.229035  4691 catalog_manager.cc:1519] Initializing Kudu cluster ID...
20:05:11.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.231534  4691 catalog_manager.cc:1294] Loaded cluster ID: d40e421039ab43579a9ed7d4f2c45853
20:05:11.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.231714  4691 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
20:05:11.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.234624  4691 catalog_manager.cc:1539] Loading token signing keys...
20:05:11.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.237093  4691 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4: Loaded TSK: 0
20:05:11.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.238085  4691 catalog_manager.cc:1549] Initializing in-progress tserver states...
20:05:11.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.736778  4001 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [term 2 FOLLOWER]: Refusing update from remote peer 7509b2b1342744809e8c2f5c41ae91a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
20:05:11.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.737983  4695 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
20:05:11.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.742954  4696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7509b2b1342744809e8c2f5c41ae91a4. Latest consensus state: current_term: 2 leader_uuid: "7509b2b1342744809e8c2f5c41ae91a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.743753  4696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: This master's current role is: FOLLOWER
20:05:11.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.747087  4698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7509b2b1342744809e8c2f5c41ae91a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:11.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.748150  4698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 [sys.catalog]: This master's current role is: LEADER
20:05:11.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.754981  4696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7509b2b1342744809e8c2f5c41ae91a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33490c314afc4076bc8725e201d3511e" member_type: VOTER last_known_addr { host: "127.3.218.254" port: 37865 } } peers { permanent_uuid: "7509b2b1342744809e8c2f5c41ae91a4" member_type: VOTER last_known_addr { host: "127.3.218.253" port: 37995 } } peers { permanent_uuid: "10935e66d011489faee1035528a7402e" member_type: VOTER last_known_addr { host: "127.3.218.252" port: 43127 } } }
20:05:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.755692  4696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33490c314afc4076bc8725e201d3511e [sys.catalog]: This master's current role is: FOLLOWER
20:05:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.759783  4054 consensus_peers.cc:597] T 00000000000000000000000000000000 P 7509b2b1342744809e8c2f5c41ae91a4 -> Peer 10935e66d011489faee1035528a7402e (127.3.218.252:43127): Couldn't send request to peer 10935e66d011489faee1035528a7402e. Status: Network error: Client connection negotiation failed: client connection to 127.3.218.252:43127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:05:11.795 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.3.218.252:43127(127.3.218.252:43127)] connecting to peer
20:05:11.796 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:11.796 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.218.252:43127(127.3.218.252:43127)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:11.797 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.218.252:43127: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127
20:05:11.800 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:05:11.801 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=Kudu Master, attempt=13, TimeoutTracker(timeout=50000, elapsed=2006), Traces: [0ms] sending RPC to server master-127.3.218.252:43127, [3ms] received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [25ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [45ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [86ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [106ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [164ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [164ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [203ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [204ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [204ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [204ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [423ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [424ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [425ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [425ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [603ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [604ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [605ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [606ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [684ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [685ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [685ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [686ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [1165ms] delaying RPC due to: Service unavailable: Master config (127.3.218.253:37995,127.3.218.254:37865,127.3.218.252:43127) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.253:37995, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.254:37865, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.218.252:43127, [2004ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.252:43127: Network error: Failed to connect to peer master-127.3.218.252:43127(127.3.218.252:43127): Connection refused: /127.3.218.252:43127, [2005ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.254:37865: OK, [2006ms] Sub RPC ConnectToMaster: received response from server master-127.3.218.253:37995: OK, deferred=Deferred@675107527(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$197/0x00007f8c3c2867e8@14971509 -> org.apache.kudu.client.AsyncKuduClient$$Lambda$198/0x00007f8c3c286d90@6dff7e5c -> wakeup thread Time-limited test -> (continuation of Deferred@1847247397 after retry RPC after error@745737803) -> (continuation of Deferred@14711185 after retry RPC after error@385608271) -> (continuation of Deferred@776472927 after retry RPC after error@444418955) -> (continuation of Deferred@424838564 after retry RPC after error@1345498451) -> (continuation of Deferred@1054758139 after retry RPC after error@1318023608) -> (continuation of Deferred@1140699752 after retry RPC after error@107005809) -> (continuation of Deferred@1247097546 after retry RPC after error@2145552521) -> (continuation of Deferred@1369574383 after retry RPC after error@1375274469) -> (continuation of Deferred@853130866 after retry RPC after error@1502928480) -> (continuation of Deferred@413682638 after retry RPC after error@23573267) -> (continuation of Deferred@2125641571 after retry RPC after error@27922699), errback=passthrough -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1847247397 after retry RPC after error@745737803) -> (continuation of Deferred@14711185 after retry RPC after error@385608271) -> (continuation of Deferred@776472927 after retry RPC after error@444418955) -> (continuation of Deferred@424838564 after retry RPC after error@1345498451) -> (continuation of Deferred@1054758139 after retry RPC after error@1318023608) -> (continuation of Deferred@1140699752 after retry RPC after error@107005809) -> (continuation of Deferred@1247097546 after retry RPC after error@2145552521) -> (continuation of Deferred@1369574383 after retry RPC after error@1375274469) -> (continuation of Deferred@853130866 after retry RPC after error@1502928480) -> (continuation of Deferred@413682638 after retry RPC after error@23573267) -> (continuation of Deferred@2125641571 after retry RPC after error@27922699))) after lookup
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.803474  4067 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43744:
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=CREATE_TABLE"
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:05:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:05:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:05:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:05:11.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:11.826438  4067 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=CREATE_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:05:11.850 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 6a76379d64714ef680f2caa5ec807321
20:05:11.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.887125  4455 tablet_service.cc:1511] Processing CreateTablet for tablet 103f24311307443987af06decbf2e421 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=6a76379d64714ef680f2caa5ec807321]), partition=RANGE (key) PARTITION UNBOUNDED
20:05:11.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.888939  4455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103f24311307443987af06decbf2e421. 1 dirs total, 0 dirs full, 0 dirs failed
20:05:11.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.890525  4316 tablet_service.cc:1511] Processing CreateTablet for tablet 103f24311307443987af06decbf2e421 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=6a76379d64714ef680f2caa5ec807321]), partition=RANGE (key) PARTITION UNBOUNDED
20:05:11.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.892359  4316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103f24311307443987af06decbf2e421. 1 dirs total, 0 dirs full, 0 dirs failed
20:05:11.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.897272  4595 tablet_service.cc:1511] Processing CreateTablet for tablet 103f24311307443987af06decbf2e421 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=6a76379d64714ef680f2caa5ec807321]), partition=RANGE (key) PARTITION UNBOUNDED
20:05:11.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.898960  4595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103f24311307443987af06decbf2e421. 1 dirs total, 0 dirs full, 0 dirs failed
20:05:11.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.916308  4711 tablet_bootstrap.cc:492] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: Bootstrap starting.
20:05:11.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.923861  4712 tablet_bootstrap.cc:492] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: Bootstrap starting.
20:05:11.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.925777  4711 tablet_bootstrap.cc:654] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: Neither blocks nor log segments found. Creating new log.
20:05:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.928218  4711 log.cc:826] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: Log is configured to *not* fsync() on all Append() calls
20:05:11.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.929661  4712 tablet_bootstrap.cc:654] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: Neither blocks nor log segments found. Creating new log.
20:05:11.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.931931  4712 log.cc:826] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: Log is configured to *not* fsync() on all Append() calls
20:05:11.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.933796  4711 tablet_bootstrap.cc:492] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: No bootstrap required, opened a new log
20:05:11.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.934373  4711 ts_tablet_manager.cc:1403] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
20:05:11.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.938696  4712 tablet_bootstrap.cc:492] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: No bootstrap required, opened a new log
20:05:11.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.939182  4712 ts_tablet_manager.cc:1403] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
20:05:11.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.933233  4714 tablet_bootstrap.cc:492] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: Bootstrap starting.
20:05:11.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.949630  4714 tablet_bootstrap.cc:654] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: Neither blocks nor log segments found. Creating new log.
20:05:11.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.952016  4714 log.cc:826] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: Log is configured to *not* fsync() on all Append() calls
20:05:11.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.963552  4712 raft_consensus.cc:359] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:11.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.964265  4712 raft_consensus.cc:385] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:05:11.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.964582  4712 raft_consensus.cc:740] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d8e132946043c59a76ba90022a7228, State: Initialized, Role: FOLLOWER
20:05:11.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.964488  4711 raft_consensus.cc:359] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:11.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.965270  4714 tablet_bootstrap.cc:492] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: No bootstrap required, opened a new log
20:05:11.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.965349  4711 raft_consensus.cc:385] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:05:11.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.965638  4711 raft_consensus.cc:740] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447c889737b74d95ba54ccfc6bd35aab, State: Initialized, Role: FOLLOWER
20:05:11.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.965822  4714 ts_tablet_manager.cc:1403] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.011s
20:05:11.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.965487  4712 consensus_queue.cc:260] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:11.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.967021  4711 consensus_queue.cc:260] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.968948  4381 heartbeater.cc:499] Master 127.3.218.253:37995 was elected leader, sending a full tablet report...
20:05:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.969697  4712 ts_tablet_manager.cc:1434] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.013s
20:05:11.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.975935  4520 heartbeater.cc:499] Master 127.3.218.253:37995 was elected leader, sending a full tablet report...
20:05:11.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:11.976954  4711 ts_tablet_manager.cc:1434] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: Time spent starting tablet: real 0.042s	user 0.027s	sys 0.011s
20:05:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.005834  4714 raft_consensus.cc:359] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.007057  4714 raft_consensus.cc:385] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:05:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.007373  4714 raft_consensus.cc:740] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c80890445d94e318c0cf4d3eb58c3a5, State: Initialized, Role: FOLLOWER
20:05:12.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.008237  4714 consensus_queue.cc:260] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:12.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.011328  4660 heartbeater.cc:499] Master 127.3.218.253:37995 was elected leader, sending a full tablet report...
20:05:12.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.012159  4714 ts_tablet_manager.cc:1434] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: Time spent starting tablet: real 0.046s	user 0.035s	sys 0.005s
20:05:12.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.063011  4525 tablet.cc:2404] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:05:12.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.085019  4389 tablet.cc:2404] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:05:12.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.175891  4663 tablet.cc:2404] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:05:12.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.243048  4717 raft_consensus.cc:493] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:05:12.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.243702  4717 raft_consensus.cc:515] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:12.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.246577  4717 leader_election.cc:290] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 447c889737b74d95ba54ccfc6bd35aab (127.3.218.194:35041), 1c80890445d94e318c0cf4d3eb58c3a5 (127.3.218.195:44031)
20:05:12.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.257001  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103f24311307443987af06decbf2e421" candidate_uuid: "b0d8e132946043c59a76ba90022a7228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447c889737b74d95ba54ccfc6bd35aab" is_pre_election: true
20:05:12.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.257943  4475 raft_consensus.cc:2468] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d8e132946043c59a76ba90022a7228 in term 0.
20:05:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.259284  4271 leader_election.cc:304] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447c889737b74d95ba54ccfc6bd35aab, b0d8e132946043c59a76ba90022a7228; no voters: 
20:05:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.259496  4615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103f24311307443987af06decbf2e421" candidate_uuid: "b0d8e132946043c59a76ba90022a7228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" is_pre_election: true
20:05:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.260114  4717 raft_consensus.cc:2804] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:05:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.260241  4615 raft_consensus.cc:2468] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d8e132946043c59a76ba90022a7228 in term 0.
20:05:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.260483  4717 raft_consensus.cc:493] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:05:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.260810  4717 raft_consensus.cc:3060] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 0 FOLLOWER]: Advancing to term 1
20:05:12.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.265703  4717 raft_consensus.cc:515] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:12.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.267138  4717 leader_election.cc:290] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [CANDIDATE]: Term 1 election: Requested vote from peers 447c889737b74d95ba54ccfc6bd35aab (127.3.218.194:35041), 1c80890445d94e318c0cf4d3eb58c3a5 (127.3.218.195:44031)
20:05:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.268050  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103f24311307443987af06decbf2e421" candidate_uuid: "b0d8e132946043c59a76ba90022a7228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447c889737b74d95ba54ccfc6bd35aab"
20:05:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.268189  4615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103f24311307443987af06decbf2e421" candidate_uuid: "b0d8e132946043c59a76ba90022a7228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c80890445d94e318c0cf4d3eb58c3a5"
20:05:12.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.268612  4475 raft_consensus.cc:3060] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [term 0 FOLLOWER]: Advancing to term 1
20:05:12.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.268693  4615 raft_consensus.cc:3060] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [term 0 FOLLOWER]: Advancing to term 1
20:05:12.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.275255  4615 raft_consensus.cc:2468] T 103f24311307443987af06decbf2e421 P 1c80890445d94e318c0cf4d3eb58c3a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d8e132946043c59a76ba90022a7228 in term 1.
20:05:12.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.275424  4475 raft_consensus.cc:2468] T 103f24311307443987af06decbf2e421 P 447c889737b74d95ba54ccfc6bd35aab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d8e132946043c59a76ba90022a7228 in term 1.
20:05:12.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.277479  4271 leader_election.cc:304] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447c889737b74d95ba54ccfc6bd35aab, b0d8e132946043c59a76ba90022a7228; no voters: 
20:05:12.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.279218  4717 raft_consensus.cc:2804] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 1 FOLLOWER]: Leader election won for term 1
20:05:12.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.295555  4717 raft_consensus.cc:697] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [term 1 LEADER]: Becoming Leader. State: Replica: b0d8e132946043c59a76ba90022a7228, State: Running, Role: LEADER
20:05:12.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.297137  4717 consensus_queue.cc:237] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } }
20:05:12.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.324455  4066 catalog_manager.cc:5696] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0d8e132946043c59a76ba90022a7228 (127.3.218.193). New cstate: current_term: 1 leader_uuid: "b0d8e132946043c59a76ba90022a7228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0d8e132946043c59a76ba90022a7228" member_type: VOTER last_known_addr { host: "127.3.218.193" port: 37029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 } health_report { overall_health: UNKNOWN } } }
20:05:12.400 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 6a76379d64714ef680f2caa5ec807321
20:05:12.404 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 103f24311307443987af06decbf2e421 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
20:05:12.404 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=103f24311307443987af06decbf2e421@[1c80890445d94e318c0cf4d3eb58c3a5(127.3.218.195:44031),447c889737b74d95ba54ccfc6bd35aab(127.3.218.194:35041),b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)[L]]}]
20:05:12.404 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, deferred=null)) after lookup
20:05:12.405 [DEBUG - kudu-nio-0] (Connection.java:748) [peer b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)] connecting to peer
20:05:12.406 [DEBUG - kudu-nio-0] (Connection.java:757) [peer b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)] Successfully connected to peer
20:05:12.424 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x71b0e2b0, L:/127.0.0.1:60382 - R:/127.3.218.193:37029] using TOKEN/null
20:05:12.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.428102  4295 tablet_service.cc:3018] Rejecting scan request for tablet 103f24311307443987af06decbf2e421: Uninitialized: clean time has not yet been initialized
20:05:12.429 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029) for tablet 103f24311307443987af06decbf2e421: clean time has not yet been initialized
20:05:12.437 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 103f24311307443987af06decbf2e421 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
20:05:12.437 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=103f24311307443987af06decbf2e421@[1c80890445d94e318c0cf4d3eb58c3a5(127.3.218.195:44031),447c889737b74d95ba54ccfc6bd35aab(127.3.218.194:35041),b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)[L]]}]
20:05:12.437 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=103f24311307443987af06decbf2e421, attempt=3, KuduRpc(method=Scan, tablet=103f24311307443987af06decbf2e421, attempt=3, TimeoutTracker(timeout=30000, elapsed=37), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [5ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [37ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, deferred=Deferred@899715504(state=PENDING, result=null, callback=(continuation of Deferred@1290057372 after retry RPC@1215030343), errback=(continuation of Deferred@1290057372 after retry RPC@1215030343)))) after lookup
20:05:12.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.440893  4295 tablet_service.cc:3018] Rejecting scan request for tablet 103f24311307443987af06decbf2e421: Uninitialized: clean time has not yet been initialized
20:05:12.442 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029) for tablet 103f24311307443987af06decbf2e421: clean time has not yet been initialized
20:05:12.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 103f24311307443987af06decbf2e421 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
20:05:12.477 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=103f24311307443987af06decbf2e421@[1c80890445d94e318c0cf4d3eb58c3a5(127.3.218.195:44031),447c889737b74d95ba54ccfc6bd35aab(127.3.218.194:35041),b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)[L]]}]
20:05:12.478 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=103f24311307443987af06decbf2e421, attempt=5, KuduRpc(method=Scan, tablet=103f24311307443987af06decbf2e421, attempt=5, TimeoutTracker(timeout=30000, elapsed=77), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [5ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [37ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [38ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [73ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [77ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, deferred=Deferred@899715504(state=PENDING, result=null, callback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830), errback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830)))) after lookup
20:05:12.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.481526  4295 tablet_service.cc:3018] Rejecting scan request for tablet 103f24311307443987af06decbf2e421: Uninitialized: clean time has not yet been initialized
20:05:12.483 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029) for tablet 103f24311307443987af06decbf2e421: clean time has not yet been initialized
20:05:12.563 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 103f24311307443987af06decbf2e421 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
20:05:12.563 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=103f24311307443987af06decbf2e421@[1c80890445d94e318c0cf4d3eb58c3a5(127.3.218.195:44031),447c889737b74d95ba54ccfc6bd35aab(127.3.218.194:35041),b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)[L]]}]
20:05:12.564 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=103f24311307443987af06decbf2e421, attempt=7, KuduRpc(method=Scan, tablet=103f24311307443987af06decbf2e421, attempt=7, TimeoutTracker(timeout=30000, elapsed=163), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [5ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [37ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [38ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [73ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [77ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [78ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [83ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [83ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [154ms] refreshing cache from master, [154ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [163ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, deferred=Deferred@899715504(state=PENDING, result=null, callback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830) -> (continuation of Deferred@1969033759 after retry RPC@1023900146), errback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830) -> (continuation of Deferred@1969033759 after retry RPC@1023900146)))) after lookup
20:05:12.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.571111  4295 tablet_service.cc:3018] Rejecting scan request for tablet 103f24311307443987af06decbf2e421: Uninitialized: clean time has not yet been initialized
20:05:12.577 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029) for tablet 103f24311307443987af06decbf2e421: clean time has not yet been initialized
20:05:12.737 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 103f24311307443987af06decbf2e421 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
20:05:12.738 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=103f24311307443987af06decbf2e421@[1c80890445d94e318c0cf4d3eb58c3a5(127.3.218.195:44031),447c889737b74d95ba54ccfc6bd35aab(127.3.218.194:35041),b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)[L]]}]
20:05:12.738 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=103f24311307443987af06decbf2e421, attempt=9, KuduRpc(method=Scan, tablet=103f24311307443987af06decbf2e421, attempt=9, TimeoutTracker(timeout=30000, elapsed=337), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [5ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [37ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [38ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [73ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [77ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [78ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [83ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [83ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [154ms] refreshing cache from master, [154ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [163ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [164ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [177ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [177ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [333ms] refreshing cache from master, [333ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [337ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, deferred=Deferred@899715504(state=PENDING, result=null, callback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830) -> (continuation of Deferred@1969033759 after retry RPC@1023900146) -> (continuation of Deferred@1584201229 after retry RPC@1136448053), errback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830) -> (continuation of Deferred@1969033759 after retry RPC@1023900146) -> (continuation of Deferred@1584201229 after retry RPC@1136448053)))) after lookup
20:05:12.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 20:05:12.742600  4295 tablet_service.cc:3018] Rejecting scan request for tablet 103f24311307443987af06decbf2e421: Uninitialized: clean time has not yet been initialized
20:05:12.744 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029) for tablet 103f24311307443987af06decbf2e421: clean time has not yet been initialized
20:05:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.770730  4717 consensus_queue.cc:1048] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c80890445d94e318c0cf4d3eb58c3a5" member_type: VOTER last_known_addr { host: "127.3.218.195" port: 44031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:05:12.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:12.792362  4717 consensus_queue.cc:1048] T 103f24311307443987af06decbf2e421 P b0d8e132946043c59a76ba90022a7228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "447c889737b74d95ba54ccfc6bd35aab" member_type: VOTER last_known_addr { host: "127.3.218.194" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:05:13.498 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 103f24311307443987af06decbf2e421 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
20:05:13.498 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=103f24311307443987af06decbf2e421@[1c80890445d94e318c0cf4d3eb58c3a5(127.3.218.195:44031),447c889737b74d95ba54ccfc6bd35aab(127.3.218.194:35041),b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)[L]]}]
20:05:13.499 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=103f24311307443987af06decbf2e421, attempt=11, KuduRpc(method=Scan, tablet=103f24311307443987af06decbf2e421, attempt=11, TimeoutTracker(timeout=30000, elapsed=1098), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [4ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [5ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [37ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [38ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [73ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [77ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [78ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [83ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [83ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [154ms] refreshing cache from master, [154ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [163ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [164ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [177ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [177ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [333ms] refreshing cache from master, [333ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [337ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, [339ms] sending RPC to server b0d8e132946043c59a76ba90022a7228, [344ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [344ms] received response from server b0d8e132946043c59a76ba90022a7228: Uninitialized: clean time has not yet been initialized (error 0), [1094ms] refreshing cache from master, [1094ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.218.253:37995, [1098ms] Sub RPC GetTableLocations: received response from server master-127.3.218.253:37995: OK, deferred=Deferred@899715504(state=PENDING, result=null, callback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830) -> (continuation of Deferred@1969033759 after retry RPC@1023900146) -> (continuation of Deferred@1584201229 after retry RPC@1136448053) -> (continuation of Deferred@278633515 after retry RPC@691963043), errback=(continuation of Deferred@1290057372 after retry RPC@1215030343) -> (continuation of Deferred@325807905 after retry RPC@2052221830) -> (continuation of Deferred@1969033759 after retry RPC@1023900146) -> (continuation of Deferred@1584201229 after retry RPC@1136448053) -> (continuation of Deferred@278633515 after retry RPC@691963043)))) after lookup
20:05:13.507 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=CREATE_TABLE, tablet=103f24311307443987af06decbf2e421, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:05:13.507 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:05:13.510 [DEBUG - main] (Connection.java:575) [peer b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)] disconnecting while in state READY
20:05:13.511 [DEBUG - main] (Connection.java:575) [peer master-127.3.218.254:37865(127.3.218.254:37865)] disconnecting while in state READY
20:05:13.511 [DEBUG - main] (Connection.java:575) [peer master-127.3.218.252:43127(127.3.218.252:43127)] disconnecting while in state TERMINATED
20:05:13.511 [DEBUG - main] (Connection.java:575) [peer master-127.3.218.253:37995(127.3.218.253:37995)] disconnecting while in state READY
20:05:13.512 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.218.254:37865(127.3.218.254:37865)] handling channelInactive
20:05:13.512 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.218.254:37865(127.3.218.254:37865)] cleaning up while in state READY due to: connection closed
20:05:13.512 [DEBUG - kudu-nio-0] (Connection.java:239) [peer b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)] handling channelInactive
20:05:13.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer b0d8e132946043c59a76ba90022a7228(127.3.218.193:37029)] cleaning up while in state READY due to: connection closed
20:05:13.512 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:05:13.512 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.218.253:37995(127.3.218.253:37995)] handling channelInactive
20:05:13.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.218.253:37995(127.3.218.253:37995)] cleaning up while in state READY due to: connection closed
20:05:13.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:13.514591  3947 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 4229
20:05:13.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:13.540882  3947 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 4388
20:05:13.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:13.569837  3947 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 4530
20:05:13.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:13.607540  3947 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 3959
20:05:13.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 20:05:13.636097  3947 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskP4R3uz/build/tsan/bin/kudu with pid 4029
20:05:14.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T20:05:14Z chronyd exiting

Time: 90.052

OK (4 tests)

