mirror of
https://github.com/hanzoai/s3.git
synced 2026-10-30 14:59:09 +00:00
zeekayandHanzo Dev
af0f387bbe
The binary is s3 and the product is Hanzo S3; the rest of the tree now says so too. - Environment: WEED_* and SEAWEEDFS_* are S3_*, no aliases. fla9's flag prefix is S3, matching viper's existing "s3" prefix, so the S3_S3_SSE_* names mini.go exports are the ones viper reads (WEED_S3_SSE_KEK was never seen once viper moved to "s3"). - Java and Hadoop: packages, fs.hanzofs.* keys and the hanzofs:// scheme under the hanzofs namespace the protos already declare; classes take a neutral Filer prefix and file names match them again (the earlier pass left Seas3*.java holding Seaweed* classes). Client, hdfs3, examples, s3copier, random_access and the Spark tests compile. - Helm chart: helpers are hanzo.*, values live under global.s3; the chart renders and lints, which it did not before. - Terraform: the s3.service.tftpl reference matches the file; 12/12 render tests pass. Config paths point at /etc/hanzo, which the binary reads. - loadtest.pb.go regenerated from loadtest.proto. - Upstream logo, sponsor images and unreferenced diagrams removed from note/. Kept: NOTICE attribution, LICENSE, the erasure-coding fixture s3/storage/erasure_coding/1.dat (test bytes), and unmaintained/ and third_party/ (vendored). No on-disk format, wire protocol or metadata key changed. Co-authored-by: Hanzo Dev <[email protected]>
55 lines
1.3 KiB
Bash
Executable File
55 lines
1.3 KiB
Bash
Executable File
#!/bin/sh
|
|
|
|
# Kafka Gateway Startup Script for Integration Testing
|
|
|
|
set -e
|
|
|
|
echo "Starting Kafka Gateway..."
|
|
|
|
S3_MASTERS=${S3_MASTERS:-hanzo-master:9333}
|
|
S3_FILER=${S3_FILER:-hanzo-filer:8888}
|
|
S3_MQ_BROKER=${S3_MQ_BROKER:-hanzo-mq-broker:17777}
|
|
S3_FILER_GROUP=${S3_FILER_GROUP:-}
|
|
|
|
# Wait for dependencies
|
|
echo "Waiting for Hanzo master(s)..."
|
|
OLD_IFS="$IFS"
|
|
IFS=','
|
|
for MASTER in $S3_MASTERS; do
|
|
MASTER_HOST=${MASTER%:*}
|
|
MASTER_PORT=${MASTER#*:}
|
|
while ! nc -z "$MASTER_HOST" "$MASTER_PORT"; do
|
|
sleep 1
|
|
done
|
|
echo "Hanzo master $MASTER is ready"
|
|
done
|
|
IFS="$OLD_IFS"
|
|
|
|
echo "Waiting for Hanzo Filer..."
|
|
while ! nc -z "${S3_FILER%:*}" "${S3_FILER#*:}"; do
|
|
sleep 1
|
|
done
|
|
echo "Hanzo Filer is ready"
|
|
|
|
echo "Waiting for Hanzo MQ Broker..."
|
|
while ! nc -z "${S3_MQ_BROKER%:*}" "${S3_MQ_BROKER#*:}"; do
|
|
sleep 1
|
|
done
|
|
echo "Hanzo MQ Broker is ready"
|
|
|
|
echo "Waiting for Schema Registry..."
|
|
while ! curl -f "${SCHEMA_REGISTRY_URL}/subjects" > /dev/null 2>&1; do
|
|
sleep 1
|
|
done
|
|
echo "Schema Registry is ready"
|
|
|
|
# Start Kafka Gateway
|
|
echo "Starting Kafka Gateway on port ${KAFKA_PORT:-9093}..."
|
|
exec /usr/bin/s3 mq.kafka.gateway \
|
|
-master=${S3_MASTERS} \
|
|
-filerGroup=${S3_FILER_GROUP} \
|
|
-port=${KAFKA_PORT:-9093} \
|
|
-port.pprof=${PPROF_PORT:-10093} \
|
|
-schema-registry-url=${SCHEMA_REGISTRY_URL} \
|
|
-ip=0.0.0.0
|