mirror of
https://github.com/hanzoai/s3.git
synced 2026-10-30 14:59:09 +00:00
zeekayandHanzo Dev
af0f387bbe
The binary is s3 and the product is Hanzo S3; the rest of the tree now says so too. - Environment: WEED_* and SEAWEEDFS_* are S3_*, no aliases. fla9's flag prefix is S3, matching viper's existing "s3" prefix, so the S3_S3_SSE_* names mini.go exports are the ones viper reads (WEED_S3_SSE_KEK was never seen once viper moved to "s3"). - Java and Hadoop: packages, fs.hanzofs.* keys and the hanzofs:// scheme under the hanzofs namespace the protos already declare; classes take a neutral Filer prefix and file names match them again (the earlier pass left Seas3*.java holding Seaweed* classes). Client, hdfs3, examples, s3copier, random_access and the Spark tests compile. - Helm chart: helpers are hanzo.*, values live under global.s3; the chart renders and lints, which it did not before. - Terraform: the s3.service.tftpl reference matches the file; 12/12 render tests pass. Config paths point at /etc/hanzo, which the binary reads. - loadtest.pb.go regenerated from loadtest.proto. - Upstream logo, sponsor images and unreferenced diagrams removed from note/. Kept: NOTICE attribution, LICENSE, the erasure-coding fixture s3/storage/erasure_coding/1.dat (test bytes), and unmaintained/ and third_party/ (vendored). No on-disk format, wire protocol or metadata key changed. Co-authored-by: Hanzo Dev <[email protected]>
77 lines
2.5 KiB
Docker
77 lines
2.5 KiB
Docker
FROM golang:1.26.8 AS builder
|
|
ENV GOTOOLCHAIN=auto
|
|
|
|
RUN apt-get update
|
|
RUN apt-get install -y build-essential libsnappy-dev zlib1g-dev libbz2-dev libgflags-dev liblz4-dev libzstd-dev
|
|
|
|
ARG ROCKSDB_VERSION=v10.10.1
|
|
ENV ROCKSDB_VERSION=${ROCKSDB_VERSION}
|
|
|
|
# build RocksDB
|
|
RUN cd /tmp && \
|
|
git clone https://github.com/facebook/rocksdb.git /tmp/rocksdb --depth 1 --single-branch --branch $ROCKSDB_VERSION && \
|
|
cd rocksdb && \
|
|
PORTABLE=1 make -j"$(nproc)" static_lib && \
|
|
make install-static
|
|
|
|
ENV CGO_CFLAGS="-I/tmp/rocksdb/include"
|
|
ENV CGO_LDFLAGS="-L/tmp/rocksdb -lrocksdb -lstdc++ -lm -lz -lbz2 -lsnappy -llz4 -lzstd"
|
|
|
|
# build Hanzo
|
|
RUN mkdir -p /go/src/github.com/hanzo/
|
|
RUN git clone https://github.com/hanzoai/s3 /go/src/github.com/hanzoai/s3
|
|
ARG BRANCH=master
|
|
RUN cd /go/src/github.com/hanzoai/s3 && git checkout $BRANCH
|
|
RUN cd /go/src/github.com/hanzoai/s3/s3 \
|
|
&& export LDFLAGS="-X github.com/hanzoai/s3/s3/util/version.COMMIT=$(git rev-parse --short HEAD)" \
|
|
&& go install -tags "5BytesOffset rocksdb" -ldflags "-extldflags -static ${LDFLAGS}"
|
|
|
|
|
|
FROM alpine AS final
|
|
LABEL author="Hanzo AI"
|
|
COPY --from=builder /go/bin/s3 /usr/bin/
|
|
RUN mkdir -p /etc/hanzo
|
|
COPY --from=builder /go/src/github.com/hanzoai/s3/docker/filer_rocksdb.toml /etc/hanzo/filer.toml
|
|
COPY --from=builder /go/src/github.com/hanzoai/s3/docker/entrypoint.sh /entrypoint.sh
|
|
|
|
# Install dependencies and create non-root user
|
|
RUN apk upgrade --no-cache && \
|
|
apk add --no-cache fuse snappy gflags curl su-exec && \
|
|
addgroup -g 1000 hanzo && \
|
|
adduser -D -u 1000 -G hanzo hanzo
|
|
|
|
# volume server gprc port
|
|
EXPOSE 18080
|
|
# volume server http port
|
|
EXPOSE 8080
|
|
# filer server gprc port
|
|
EXPOSE 18888
|
|
# filer server http port
|
|
EXPOSE 8888
|
|
# master server shared gprc port
|
|
EXPOSE 19333
|
|
# master server shared http port
|
|
EXPOSE 9333
|
|
# s3 server http port
|
|
EXPOSE 8333
|
|
# webdav server http port
|
|
EXPOSE 7333
|
|
|
|
# Create data directory and set proper ownership for hanzo user
|
|
RUN mkdir -p /data/filer_rocksdb && \
|
|
chown -R hanzo:hanzo /data && \
|
|
chown -R hanzo:hanzo /etc/hanzo && \
|
|
chmod 755 /entrypoint.sh
|
|
|
|
VOLUME /data
|
|
|
|
WORKDIR /data
|
|
|
|
# Entrypoint will handle permission fixes and user switching
|
|
ENTRYPOINT ["/entrypoint.sh"]
|
|
# Default to a complete single-process cluster (master+volume+filer+S3+admin)
|
|
# so the image is usable out of the box — including in environments like
|
|
# GitHub Actions service containers that cannot pass arguments to the entrypoint.
|
|
# Override with any other subcommand at `docker run` / compose time.
|
|
CMD ["mini", "-dir=/data"]
|