mirror of
https://github.com/hanzo-ml/kuberay.git
synced 2026-10-30 19:48:47 +00:00
* refactor: Standardize main.go style - Add package doc - Move flag declarations into a var() block - Add description strings to each flag - Add section dividers for readability - Group imports into stdlib / third-party / project - Remove dead initialization of runtimeClassConfigPath (overwritten by flag default) No behavior change. Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Lazy session processing via Supervisor with isDead probe - Add a Supervisor as /enter_cluster broker - Use in-process loaded set to record processed sessions - Add a Pipeline that wraps the parse steps - Remove eager processing on startup and ticker Signed-off-by: JiangJiaWei1103 <[email protected]> * test: Cover Supervisor error propagation and no-retry contracts Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Surface storage outage error in ProcessSingleSession Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Handle isDead for RayCluster recreation with the same namespacedname Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Use live sentinel to avoid querying empty in-mem state Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Skip singleflight for already-loaded sessions Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Reuse k8s client Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Surface errors of two subsystems Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Add SessionSnapshot schema type Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Add SnapshotLoader (LRU cache) Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Add GetRawEventsByJobID for snapshot building Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Pipeline returns SessionSnapshot, Supervisor uses SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Migrate /tasks family to SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Migrate /actors family to SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Migrate /jobs family to SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Migrate /nodes family to SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Migrate /events and /api/cluster_status to SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * docs: Describe LRU cache layer Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Add missing copy Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Migrate log file resolvers to SnapshotLoader Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Clean up Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Clean up Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Streamline LRU cache impl Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Keep dir structure simple Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Remove dead codes Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Make eventserver focused on event ingestion Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Fatal instead of panic Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Use clusterSessionKey Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Guide users to re-enter the cluster Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Avoid over-engineering Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Clean up Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Ensure snapshot first Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Simplify log events handling Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Better naming and align the orig behavior Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Treat snap as SSOT Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Correct session key example Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Align function name Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Fix test fixture and remove unused tests Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Rename cache priming to align with getter Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Support per-request view of snapshot to avoid race Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: GC in-mem maps Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Remove dead EventHandler accessors made unreachable by per-call handler Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Align getter deep copy Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Support absolute ttl expiry in lru cache Signed-off-by: JiangJiaWei1103 <[email protected]> * feat: Support idle TTL Signed-off-by: JiangJiaWei1103 <[email protected]> * docs: Clarify ttl semantics Signed-off-by: JiangJiaWei1103 <[email protected]> * fix: Fix tests Signed-off-by: JiangJiaWei1103 <[email protected]> * refactor: Remove unused field Signed-off-by: JiangJiaWei1103 <[email protected]> --------- Signed-off-by: JiangJiaWei1103 <[email protected]>
147 lines
6.9 KiB
AMPL
147 lines
6.9 KiB
AMPL
module github.com/ray-project/kuberay/historyserver
|
|
|
|
go 1.26
|
|
|
|
require (
|
|
cloud.google.com/go/storage v1.59.2
|
|
github.com/Azure/azure-sdk-for-go/sdk/azcore v1.20.0
|
|
github.com/Azure/azure-sdk-for-go/sdk/azidentity v1.13.1
|
|
github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v1.6.4
|
|
github.com/aliyun/alibabacloud-oss-go-sdk-v2 v1.4.1
|
|
github.com/aliyun/credentials-go v1.4.12
|
|
github.com/aws/aws-sdk-go v1.55.8
|
|
github.com/bmatcuk/doublestar/v4 v4.10.0
|
|
github.com/emicklei/go-restful/v3 v3.13.0
|
|
github.com/fsnotify/fsnotify v1.9.0
|
|
github.com/fsouza/fake-gcs-server v1.53.1
|
|
github.com/hashicorp/golang-lru/v2 v2.0.7
|
|
github.com/onsi/gomega v1.38.2
|
|
github.com/ray-project/kuberay/ray-operator v1.5.1
|
|
github.com/sirupsen/logrus v1.9.3
|
|
github.com/stretchr/testify v1.11.1
|
|
google.golang.org/api v0.264.0
|
|
k8s.io/apimachinery v0.35.0
|
|
k8s.io/client-go v0.35.0
|
|
sigs.k8s.io/controller-runtime v0.22.4
|
|
)
|
|
|
|
require (
|
|
github.com/Masterminds/semver/v3 v3.4.0 // indirect
|
|
github.com/alibabacloud-go/debug v1.0.1 // indirect
|
|
github.com/beorn7/perks v1.0.1 // indirect
|
|
github.com/blang/semver/v4 v4.0.0 // indirect
|
|
github.com/cespare/xxhash/v2 v2.3.0 // indirect
|
|
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
|
|
github.com/evanphx/json-patch/v5 v5.9.11 // indirect
|
|
github.com/fxamacker/cbor/v2 v2.9.0 // indirect
|
|
github.com/go-logr/logr v1.4.3 // indirect
|
|
github.com/go-openapi/jsonpointer v0.21.2 // indirect
|
|
github.com/go-openapi/jsonreference v0.21.0 // indirect
|
|
github.com/go-openapi/swag v0.23.1 // indirect
|
|
github.com/go-task/slim-sprig/v3 v3.0.0 // indirect
|
|
github.com/gogo/protobuf v1.3.2 // indirect
|
|
github.com/google/btree v1.1.3 // indirect
|
|
github.com/google/gnostic-models v0.7.0 // indirect
|
|
github.com/google/go-cmp v0.7.0
|
|
github.com/google/pprof v0.0.0-20250403155104-27863c87afa6 // indirect
|
|
github.com/google/uuid v1.6.0 // indirect
|
|
github.com/gorilla/websocket v1.5.4-0.20250319132907-e064f32e3674 // indirect
|
|
github.com/jmespath/go-jmespath v0.4.0 // indirect
|
|
github.com/josharian/intern v1.0.0 // indirect
|
|
github.com/json-iterator/go v1.1.12 // indirect
|
|
github.com/mailru/easyjson v0.9.0 // indirect
|
|
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
|
|
github.com/modern-go/reflect2 v1.0.3-0.20250322232337-35a7c28c31ee // indirect
|
|
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 // indirect
|
|
github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f // indirect
|
|
github.com/onsi/ginkgo/v2 v2.27.2 // indirect
|
|
github.com/openshift/api v0.0.0-20250602203052-b29811a290c7 // indirect
|
|
github.com/prometheus/client_golang v1.23.0 // indirect
|
|
github.com/prometheus/client_model v0.6.2 // indirect
|
|
github.com/prometheus/common v0.65.0 // indirect
|
|
github.com/prometheus/procfs v0.17.0 // indirect
|
|
github.com/spf13/pflag v1.0.9 // indirect
|
|
github.com/x448/float16 v0.8.4 // indirect
|
|
go.opentelemetry.io/otel v1.39.0 // indirect
|
|
go.opentelemetry.io/otel/trace v1.39.0 // indirect
|
|
go.yaml.in/yaml/v2 v2.4.3 // indirect
|
|
go.yaml.in/yaml/v3 v3.0.4 // indirect
|
|
golang.org/x/net v0.49.0 // indirect
|
|
golang.org/x/oauth2 v0.34.0 // indirect
|
|
golang.org/x/sync v0.19.0
|
|
golang.org/x/sys v0.40.0 // indirect
|
|
golang.org/x/term v0.39.0 // indirect
|
|
golang.org/x/text v0.33.0 // indirect
|
|
golang.org/x/time v0.14.0 // indirect
|
|
google.golang.org/protobuf v1.36.11 // indirect
|
|
gopkg.in/inf.v0 v0.9.1 // indirect
|
|
gopkg.in/yaml.v3 v3.0.1 // indirect
|
|
k8s.io/api v0.35.0
|
|
k8s.io/apiextensions-apiserver v0.34.1 // indirect
|
|
k8s.io/apiserver v0.34.1 // indirect
|
|
k8s.io/component-base v0.34.1 // indirect
|
|
k8s.io/klog/v2 v2.130.1 // indirect
|
|
k8s.io/kube-openapi v0.0.0-20250910181357-589584f1c912 // indirect
|
|
k8s.io/utils v0.0.0-20260319190234-28399d86e0b5 // indirect
|
|
sigs.k8s.io/gateway-api v1.4.0 // indirect
|
|
sigs.k8s.io/json v0.0.0-20250730193827-2d320260d730 // indirect
|
|
sigs.k8s.io/randfill v1.0.0 // indirect
|
|
sigs.k8s.io/structured-merge-diff/v6 v6.3.0 // indirect
|
|
sigs.k8s.io/yaml v1.6.0 // indirect
|
|
)
|
|
|
|
require (
|
|
cel.dev/expr v0.24.0 // indirect
|
|
cloud.google.com/go v0.123.0 // indirect
|
|
cloud.google.com/go/auth v0.18.1 // indirect
|
|
cloud.google.com/go/auth/oauth2adapt v0.2.8 // indirect
|
|
cloud.google.com/go/compute/metadata v0.9.0 // indirect
|
|
cloud.google.com/go/iam v1.5.3 // indirect
|
|
cloud.google.com/go/monitoring v1.24.3 // indirect
|
|
cloud.google.com/go/pubsub/v2 v2.3.0 // indirect
|
|
github.com/Azure/azure-sdk-for-go/sdk/internal v1.11.2 // indirect
|
|
github.com/AzureAD/microsoft-authentication-library-for-go v1.6.0 // indirect
|
|
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.30.0 // indirect
|
|
github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric v0.54.0 // indirect
|
|
github.com/GoogleCloudPlatform/opentelemetry-operations-go/internal/resourcemapping v0.54.0 // indirect
|
|
github.com/cncf/xds/go v0.0.0-20251022180443-0feb69152e9f // indirect
|
|
github.com/envoyproxy/go-control-plane/envoy v1.35.0 // indirect
|
|
github.com/envoyproxy/protoc-gen-validate v1.2.1 // indirect
|
|
github.com/evanphx/json-patch v5.6.0+incompatible // indirect
|
|
github.com/felixge/httpsnoop v1.0.4 // indirect
|
|
github.com/go-jose/go-jose/v4 v4.1.3 // indirect
|
|
github.com/go-logr/stdr v1.2.2 // indirect
|
|
github.com/golang-jwt/jwt/v5 v5.3.0 // indirect
|
|
github.com/google/renameio/v2 v2.0.0 // indirect
|
|
github.com/google/s2a-go v0.1.9 // indirect
|
|
github.com/googleapis/enterprise-certificate-proxy v0.3.11 // indirect
|
|
github.com/googleapis/gax-go/v2 v2.16.0 // indirect
|
|
github.com/gorilla/handlers v1.5.2 // indirect
|
|
github.com/gorilla/mux v1.8.1 // indirect
|
|
github.com/kylelemons/godebug v1.1.0 // indirect
|
|
github.com/moby/spdystream v0.5.0 // indirect
|
|
github.com/pkg/browser v0.0.0-20240102092130-5ac0b6a4141c // indirect
|
|
github.com/pkg/xattr v0.4.12 // indirect
|
|
github.com/planetscale/vtprotobuf v0.6.1-0.20240319094008-0393e58bdf10 // indirect
|
|
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
|
|
github.com/spiffe/go-spiffe/v2 v2.6.0 // indirect
|
|
go.opencensus.io v0.24.0 // indirect
|
|
go.opentelemetry.io/auto/sdk v1.2.1 // indirect
|
|
go.opentelemetry.io/contrib/detectors/gcp v1.38.0 // indirect
|
|
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.63.0 // indirect
|
|
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.61.0 // indirect
|
|
go.opentelemetry.io/otel/metric v1.39.0 // indirect
|
|
go.opentelemetry.io/otel/sdk v1.39.0 // indirect
|
|
go.opentelemetry.io/otel/sdk/metric v1.39.0 // indirect
|
|
golang.org/x/crypto v0.47.0 // indirect
|
|
golang.org/x/mod v0.31.0 // indirect
|
|
golang.org/x/tools v0.40.0 // indirect
|
|
gomodules.xyz/jsonpatch/v2 v2.4.0 // indirect
|
|
google.golang.org/genproto v0.0.0-20251202230838-ff82c1b0f217 // indirect
|
|
google.golang.org/genproto/googleapis/api v0.0.0-20251202230838-ff82c1b0f217 // indirect
|
|
google.golang.org/genproto/googleapis/rpc v0.0.0-20260122232226-8e98ce8d340d // indirect
|
|
google.golang.org/grpc v1.78.0 // indirect
|
|
gopkg.in/evanphx/json-patch.v4 v4.13.0 // indirect
|
|
gopkg.in/ini.v1 v1.67.0 // indirect
|
|
)
|