Files
Jia-Wei JiangandGitHub c4cb484690 [2/N] [History Server Beta] [Feat] LRU cache (#4796)
* refactor: Standardize main.go style

- Add package doc
- Move flag declarations into a var() block
- Add description strings to each flag
- Add section dividers for readability
- Group imports into stdlib / third-party / project
- Remove dead initialization of runtimeClassConfigPath (overwritten by flag default)

No behavior change.

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Lazy session processing via Supervisor with isDead probe

- Add a Supervisor as /enter_cluster broker
  - Use in-process loaded set to record processed sessions
- Add a Pipeline that wraps the parse steps
- Remove eager processing on startup and ticker

Signed-off-by: JiangJiaWei1103 <[email protected]>

* test: Cover Supervisor error propagation and no-retry contracts

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Surface storage outage error in ProcessSingleSession

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Handle isDead for RayCluster recreation with the same namespacedname

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Use live sentinel to avoid querying empty in-mem state

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Skip singleflight for already-loaded sessions

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Reuse k8s client

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Surface errors of two subsystems

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Add SessionSnapshot schema type

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Add SnapshotLoader (LRU cache)

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Add GetRawEventsByJobID for snapshot building

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Pipeline returns SessionSnapshot, Supervisor uses SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Migrate /tasks family to SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Migrate /actors family to SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Migrate /jobs family to SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Migrate /nodes family to SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Migrate /events and /api/cluster_status to SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* docs: Describe LRU cache layer

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Add missing copy

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Migrate log file resolvers to SnapshotLoader

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Clean up

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Clean up

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Streamline LRU cache impl

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Keep dir structure simple

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Remove dead codes

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Make eventserver focused on event ingestion

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Fatal instead of panic

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Use clusterSessionKey

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Guide users to re-enter the cluster

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Avoid over-engineering

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Clean up

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Ensure snapshot first

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Simplify log events handling

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Better naming and align the orig behavior

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Treat snap as SSOT

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Correct session key example

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Align function name

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Fix test fixture and remove unused tests

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Rename cache priming to align with getter

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Support per-request view of snapshot to avoid race

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: GC in-mem maps

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Remove dead EventHandler accessors made unreachable by per-call handler

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Align getter deep copy

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Support absolute ttl expiry in lru cache

Signed-off-by: JiangJiaWei1103 <[email protected]>

* feat: Support idle TTL

Signed-off-by: JiangJiaWei1103 <[email protected]>

* docs: Clarify ttl semantics

Signed-off-by: JiangJiaWei1103 <[email protected]>

* fix: Fix tests

Signed-off-by: JiangJiaWei1103 <[email protected]>

* refactor: Remove unused field

Signed-off-by: JiangJiaWei1103 <[email protected]>

---------

Signed-off-by: JiangJiaWei1103 <[email protected]>
2026-06-18 11:50:33 -07:00

147 lines
6.9 KiB
AMPL

module github.com/ray-project/kuberay/historyserver
go 1.26
require (
cloud.google.com/go/storage v1.59.2
github.com/Azure/azure-sdk-for-go/sdk/azcore v1.20.0
github.com/Azure/azure-sdk-for-go/sdk/azidentity v1.13.1
github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v1.6.4
github.com/aliyun/alibabacloud-oss-go-sdk-v2 v1.4.1
github.com/aliyun/credentials-go v1.4.12
github.com/aws/aws-sdk-go v1.55.8
github.com/bmatcuk/doublestar/v4 v4.10.0
github.com/emicklei/go-restful/v3 v3.13.0
github.com/fsnotify/fsnotify v1.9.0
github.com/fsouza/fake-gcs-server v1.53.1
github.com/hashicorp/golang-lru/v2 v2.0.7
github.com/onsi/gomega v1.38.2
github.com/ray-project/kuberay/ray-operator v1.5.1
github.com/sirupsen/logrus v1.9.3
github.com/stretchr/testify v1.11.1
google.golang.org/api v0.264.0
k8s.io/apimachinery v0.35.0
k8s.io/client-go v0.35.0
sigs.k8s.io/controller-runtime v0.22.4
)
require (
github.com/Masterminds/semver/v3 v3.4.0 // indirect
github.com/alibabacloud-go/debug v1.0.1 // indirect
github.com/beorn7/perks v1.0.1 // indirect
github.com/blang/semver/v4 v4.0.0 // indirect
github.com/cespare/xxhash/v2 v2.3.0 // indirect
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
github.com/evanphx/json-patch/v5 v5.9.11 // indirect
github.com/fxamacker/cbor/v2 v2.9.0 // indirect
github.com/go-logr/logr v1.4.3 // indirect
github.com/go-openapi/jsonpointer v0.21.2 // indirect
github.com/go-openapi/jsonreference v0.21.0 // indirect
github.com/go-openapi/swag v0.23.1 // indirect
github.com/go-task/slim-sprig/v3 v3.0.0 // indirect
github.com/gogo/protobuf v1.3.2 // indirect
github.com/google/btree v1.1.3 // indirect
github.com/google/gnostic-models v0.7.0 // indirect
github.com/google/go-cmp v0.7.0
github.com/google/pprof v0.0.0-20250403155104-27863c87afa6 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/gorilla/websocket v1.5.4-0.20250319132907-e064f32e3674 // indirect
github.com/jmespath/go-jmespath v0.4.0 // indirect
github.com/josharian/intern v1.0.0 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/mailru/easyjson v0.9.0 // indirect
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.3-0.20250322232337-35a7c28c31ee // indirect
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 // indirect
github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f // indirect
github.com/onsi/ginkgo/v2 v2.27.2 // indirect
github.com/openshift/api v0.0.0-20250602203052-b29811a290c7 // indirect
github.com/prometheus/client_golang v1.23.0 // indirect
github.com/prometheus/client_model v0.6.2 // indirect
github.com/prometheus/common v0.65.0 // indirect
github.com/prometheus/procfs v0.17.0 // indirect
github.com/spf13/pflag v1.0.9 // indirect
github.com/x448/float16 v0.8.4 // indirect
go.opentelemetry.io/otel v1.39.0 // indirect
go.opentelemetry.io/otel/trace v1.39.0 // indirect
go.yaml.in/yaml/v2 v2.4.3 // indirect
go.yaml.in/yaml/v3 v3.0.4 // indirect
golang.org/x/net v0.49.0 // indirect
golang.org/x/oauth2 v0.34.0 // indirect
golang.org/x/sync v0.19.0
golang.org/x/sys v0.40.0 // indirect
golang.org/x/term v0.39.0 // indirect
golang.org/x/text v0.33.0 // indirect
golang.org/x/time v0.14.0 // indirect
google.golang.org/protobuf v1.36.11 // indirect
gopkg.in/inf.v0 v0.9.1 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
k8s.io/api v0.35.0
k8s.io/apiextensions-apiserver v0.34.1 // indirect
k8s.io/apiserver v0.34.1 // indirect
k8s.io/component-base v0.34.1 // indirect
k8s.io/klog/v2 v2.130.1 // indirect
k8s.io/kube-openapi v0.0.0-20250910181357-589584f1c912 // indirect
k8s.io/utils v0.0.0-20260319190234-28399d86e0b5 // indirect
sigs.k8s.io/gateway-api v1.4.0 // indirect
sigs.k8s.io/json v0.0.0-20250730193827-2d320260d730 // indirect
sigs.k8s.io/randfill v1.0.0 // indirect
sigs.k8s.io/structured-merge-diff/v6 v6.3.0 // indirect
sigs.k8s.io/yaml v1.6.0 // indirect
)
require (
cel.dev/expr v0.24.0 // indirect
cloud.google.com/go v0.123.0 // indirect
cloud.google.com/go/auth v0.18.1 // indirect
cloud.google.com/go/auth/oauth2adapt v0.2.8 // indirect
cloud.google.com/go/compute/metadata v0.9.0 // indirect
cloud.google.com/go/iam v1.5.3 // indirect
cloud.google.com/go/monitoring v1.24.3 // indirect
cloud.google.com/go/pubsub/v2 v2.3.0 // indirect
github.com/Azure/azure-sdk-for-go/sdk/internal v1.11.2 // indirect
github.com/AzureAD/microsoft-authentication-library-for-go v1.6.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.30.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric v0.54.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/internal/resourcemapping v0.54.0 // indirect
github.com/cncf/xds/go v0.0.0-20251022180443-0feb69152e9f // indirect
github.com/envoyproxy/go-control-plane/envoy v1.35.0 // indirect
github.com/envoyproxy/protoc-gen-validate v1.2.1 // indirect
github.com/evanphx/json-patch v5.6.0+incompatible // indirect
github.com/felixge/httpsnoop v1.0.4 // indirect
github.com/go-jose/go-jose/v4 v4.1.3 // indirect
github.com/go-logr/stdr v1.2.2 // indirect
github.com/golang-jwt/jwt/v5 v5.3.0 // indirect
github.com/google/renameio/v2 v2.0.0 // indirect
github.com/google/s2a-go v0.1.9 // indirect
github.com/googleapis/enterprise-certificate-proxy v0.3.11 // indirect
github.com/googleapis/gax-go/v2 v2.16.0 // indirect
github.com/gorilla/handlers v1.5.2 // indirect
github.com/gorilla/mux v1.8.1 // indirect
github.com/kylelemons/godebug v1.1.0 // indirect
github.com/moby/spdystream v0.5.0 // indirect
github.com/pkg/browser v0.0.0-20240102092130-5ac0b6a4141c // indirect
github.com/pkg/xattr v0.4.12 // indirect
github.com/planetscale/vtprotobuf v0.6.1-0.20240319094008-0393e58bdf10 // indirect
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
github.com/spiffe/go-spiffe/v2 v2.6.0 // indirect
go.opencensus.io v0.24.0 // indirect
go.opentelemetry.io/auto/sdk v1.2.1 // indirect
go.opentelemetry.io/contrib/detectors/gcp v1.38.0 // indirect
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.63.0 // indirect
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.61.0 // indirect
go.opentelemetry.io/otel/metric v1.39.0 // indirect
go.opentelemetry.io/otel/sdk v1.39.0 // indirect
go.opentelemetry.io/otel/sdk/metric v1.39.0 // indirect
golang.org/x/crypto v0.47.0 // indirect
golang.org/x/mod v0.31.0 // indirect
golang.org/x/tools v0.40.0 // indirect
gomodules.xyz/jsonpatch/v2 v2.4.0 // indirect
google.golang.org/genproto v0.0.0-20251202230838-ff82c1b0f217 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20251202230838-ff82c1b0f217 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20260122232226-8e98ce8d340d // indirect
google.golang.org/grpc v1.78.0 // indirect
gopkg.in/evanphx/json-patch.v4 v4.13.0 // indirect
gopkg.in/ini.v1 v1.67.0 // indirect
)