mirror of
https://github.com/hanzoai/visor.git
synced 2026-09-24 17:04:14 +00:00
There were several issues with how runsc log and profile files were generated:
- Variables like "%ID" in flag-specified file paths were substituted by the
runsc shim in `pkg/shim/v1/runsccmd/utils.go:replaceID()`. Consequently, runsc
commands that did *not* invoke the shim missed this logic. Notably, Docker
invokes runsc via `runc shim`, so Docker use cases were missing this
feature.
- Variable support across flags was inconsistent. For example, the --debug-log
flag supported variables like ID, TIMESTAMP, COMMAND, and TEST, while
--profile-cpu supported ID, TIMESTAMP, YYYY, MM, etc.
- "%ID%" was intended to be substituted with the sandbox ID, but the shim was
incorrectly substituting it with the container ID.
- Variables specified via flag annotations were not substituted because the
shim did not process flag annotations.
- `specutils.ReadSpec() => ReadSpecFromFile() => fixSpec()` had the side effect
of modifying the `Config` object itself with annotation-based flags, rather
than just fixing the spec.
- Flag annotations were applied to Config for only 6 runsc commands (via
`fixSpec()`): boot, gofer, create, restore, run, and start. Other commands
did not see flags set via annotations.
- When using flag annotations to generate debug logs, only boot and gofer logs
were generated. This is because the debug file was created by the runsc CLI,
but flag annotations were processed later by the sub-command implementation.
Only `boot` and `gofer` had the correct configuration because `runsc create`
had already fixed its config by the time it invoked them.
- The parent directories of the configured file paths is created via
os.MkdirAll() only for a subset of the flags. This is inconsistent.
This change fixes all above-mentioned issues:
- Moves all variable substitution logic from the shim to the runsc CLI.
- Centralizes the logic for opening and formatting paths for log and profile
files within `specutils`.
- Introduces `specutils.LogFileOpts` to standardize variable substitution in
log and profile paths.
- Refactors profile file handling to use `DonateProfileFDs`, leveraging
`LogFileOpts` and `DonateLogFile` for consistent path substitution.
- Extracts `specutils.FixConfig()` from `specutils.fixSpec()` to only call it
when necessary. This prevents side effects; `fixSpec()` now only fixes the OCI
spec, and `FixConfig()` only fixes `config.Config`. The config is now fixed
uniformly for all commands via the runsc CLI.
- Standarizes the variables supported across all file path flags:
- `%TIMESTAMP%`: Replaced with the start-up time of the command with format
`<yyyymmdd-hhmmss.uuuuuu>`.
- `%COMMAND%`: Replaced with the command name.
- `%TEST%`: Replaced with the value of the environment variable named
`-TESTONLY-test-name-env`. The value is fetched from container spec.
- `%ID%`: Replaced with the sandbox ID.
- `%CID%`: Replaced with the container ID.
- Open all log files consistently with mode 0644 and create intermediate
directories with mode 0755.
To facilitate these improvements, the `subcommands.Command` interface has been
extended via `util.SubCommand` to include `FetchSpec(conf, flatSet)`.
- All runsc sub-commands must implement this interface.
- `FetchSpec` extracts the container ID from the command line arguments and
ensures the OCI spec is loaded (either from the bundle or container) for
configuration processing.
- Caching is added to all sub-commands to reuse the work done by `FetchSpec`
during `Execute()`.
Note: `runsc tar` and `runsc trace` implement `FetchSpec` as a no-op. These
commands have nested sub-commands that make spec pre-fetching complex. Variable
substitution is currently not supported for their file path flags.
PiperOrigin-RevId: 877758843
121 lines
4.4 KiB
Go
121 lines
4.4 KiB
Go
// Copyright 2018 The gVisor Authors.
|
|
//
|
|
// Licensed under the Apache License, Version 2.0 (the "License");
|
|
// you may not use this file except in compliance with the License.
|
|
// You may obtain a copy of the License at
|
|
//
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
//
|
|
// Unless required by applicable law or agreed to in writing, software
|
|
// distributed under the License is distributed on an "AS IS" BASIS,
|
|
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
// See the License for the specific language governing permissions and
|
|
// limitations under the License.
|
|
|
|
package specutils
|
|
|
|
import (
|
|
specs "github.com/opencontainers/runtime-spec/specs-go"
|
|
)
|
|
|
|
const (
|
|
// ContainerdContainerTypeAnnotation is the OCI annotation set by
|
|
// containerd to indicate whether the container to create should have
|
|
// its own sandbox or a container within an existing sandbox.
|
|
ContainerdContainerTypeAnnotation = "io.kubernetes.cri.container-type"
|
|
// ContainerdContainerTypeContainer is the container type value
|
|
// indicating the container should be created in an existing sandbox.
|
|
ContainerdContainerTypeContainer = "container"
|
|
// ContainerdContainerTypeSandbox is the container type value
|
|
// indicating the container should be created in a new sandbox.
|
|
ContainerdContainerTypeSandbox = "sandbox"
|
|
|
|
// ContainerdSandboxIDAnnotation is the OCI annotation set to indicate
|
|
// which sandbox the container should be created in when the container
|
|
// is not the first container in the sandbox.
|
|
ContainerdSandboxIDAnnotation = "io.kubernetes.cri.sandbox-id"
|
|
|
|
// ContainerdContainerNameAnnotation is the OCI annotation set by
|
|
// containerd to indicate the name of the container.
|
|
ContainerdContainerNameAnnotation = "io.kubernetes.cri.container-name"
|
|
|
|
// CRIOContainerTypeAnnotation is the OCI annotation set by
|
|
// CRI-O to indicate whether the container to create should have
|
|
// its own sandbox or a container within an existing sandbox.
|
|
CRIOContainerTypeAnnotation = "io.kubernetes.cri-o.ContainerType"
|
|
|
|
// CRIOContainerTypeContainer is the container type value
|
|
// indicating the container should be created in an existing sandbox.
|
|
CRIOContainerTypeContainer = "container"
|
|
// CRIOContainerTypeSandbox is the container type value
|
|
// indicating the container should be created in a new sandbox.
|
|
CRIOContainerTypeSandbox = "sandbox"
|
|
|
|
// CRIOSandboxIDAnnotation is the OCI annotation set to indicate
|
|
// which sandbox the container should be created in when the container
|
|
// is not the first container in the sandbox.
|
|
CRIOSandboxIDAnnotation = "io.kubernetes.cri-o.SandboxID"
|
|
)
|
|
|
|
// ContainerType represents the type of container requested by the calling container manager.
|
|
type ContainerType int
|
|
|
|
const (
|
|
// ContainerTypeUnspecified indicates that no known container type
|
|
// annotation was found in the spec.
|
|
ContainerTypeUnspecified ContainerType = iota
|
|
// ContainerTypeUnknown indicates that a container type was specified
|
|
// but is unknown to us.
|
|
ContainerTypeUnknown
|
|
// ContainerTypeSandbox indicates that the container should be run in a
|
|
// new sandbox.
|
|
ContainerTypeSandbox
|
|
// ContainerTypeContainer indicates that the container should be run in
|
|
// an existing sandbox.
|
|
ContainerTypeContainer
|
|
)
|
|
|
|
// SpecContainerType tries to determine the type of container specified by the
|
|
// container manager using well-known container annotations.
|
|
func SpecContainerType(spec *specs.Spec) ContainerType {
|
|
if t, ok := spec.Annotations[ContainerdContainerTypeAnnotation]; ok {
|
|
switch t {
|
|
case ContainerdContainerTypeSandbox:
|
|
return ContainerTypeSandbox
|
|
case ContainerdContainerTypeContainer:
|
|
return ContainerTypeContainer
|
|
default:
|
|
return ContainerTypeUnknown
|
|
}
|
|
}
|
|
if t, ok := spec.Annotations[CRIOContainerTypeAnnotation]; ok {
|
|
switch t {
|
|
case CRIOContainerTypeSandbox:
|
|
return ContainerTypeSandbox
|
|
case CRIOContainerTypeContainer:
|
|
return ContainerTypeContainer
|
|
default:
|
|
return ContainerTypeUnknown
|
|
}
|
|
}
|
|
return ContainerTypeUnspecified
|
|
}
|
|
|
|
// IsRootContainer returns true if the spec represents the sandbox's root
|
|
// container.
|
|
func IsRootContainer(spec *specs.Spec) bool {
|
|
return SpecContainerType(spec) != ContainerTypeContainer
|
|
}
|
|
|
|
// SandboxID returns the ID of the sandbox to join and whether an ID was found
|
|
// in the spec.
|
|
func SandboxID(spec *specs.Spec) (string, bool) {
|
|
if id, ok := spec.Annotations[ContainerdSandboxIDAnnotation]; ok {
|
|
return id, true
|
|
}
|
|
if id, ok := spec.Annotations[CRIOSandboxIDAnnotation]; ok {
|
|
return id, true
|
|
}
|
|
return "", false
|
|
}
|