API Reference
Packages
thalamus.cloud/v1alpha1
Package v1alpha1 contains API Schema definitions for the thalamus.cloud v1alpha1 API group.
Resource Types
BackendType
Underlying type: string
Validation:
- Enum: [native kserve kaito]
Appears in:
| Field | Description |
|---|---|
native | |
kserve | |
kaito |
EPPType
Underlying type: string
Validation:
- Enum: [llm-d unknown]
Appears in:
| Field | Description |
|---|---|
llm-d | |
unknown |
EngineType
Underlying type: string
Validation:
- Enum: [vllm unknown]
Appears in:
| Field | Description |
|---|---|
vllm | |
unknown |
HFWeightsSpec
HFWeightsSpec configures model weights sourced from Hugging Face.
Appears in:
| Field | Description | Default | Validation |
|---|---|---|---|
repoId string | RepoID is the Hugging Face repository ID, e.g. "openai/gpt-oss-120b". | ||
tokenSecret SecretKeySelector | TokenSecret references the key within a Kubernetes secret containing the Hugging Face token. | Optional: {} |
Model
Model is the Schema for the models API.
Appears in:
| Field | Description | Default | Validation |
|---|---|---|---|
apiVersion string | thalamus.cloud/v1alpha1 | ||
kind string | Model | ||
metadata ObjectMeta | Refer to Kubernetes API documentation for fields of metadata. | Optional: {} | |
spec ModelSpec | spec defines the desired state of the Model. | Required: {} | |
status ModelStatus | status defines the observed state of the Model. | Optional: {} |
ModelList
ModelList contains a list of Model.
| Field | Description | Default | Validation |
|---|---|---|---|
apiVersion string | thalamus.cloud/v1alpha1 | ||
kind string | ModelList | ||
metadata ListMeta | Refer to Kubernetes API documentation for fields of metadata. | ||
items Model array |
ModelPhase
Underlying type: string
Appears in:
| Field | Description |
|---|---|
Pending | TODO: set Pending when admission/resource checks block reconciliation (e.g. insufficient GPU quota). Currently unused. |
Creating | |
Ready | |
Inactive | |
Failed |
ModelSpec
ModelSpec defines the configuration for the model instance.
Appears in:
| Field | Description | Default | Validation |
|---|---|---|---|
backend BackendType | Backend selects which inference backend manages this model's resources. Defaults to "native". | native | Enum: [native kserve kaito] Optional: {} |
replicas integer | Replicas defines the number of engine replicas to deploy for this model. Defaults to 1. | 1 | Minimum: 0 Optional: {} |
serving ServingSpec | Serving defines how the model is served. | ||
weights WeightsSpec | Weights defines where the model weights are sourced from. | ||
aliases string array | Aliases are the model names under which this model is exposed. When empty, the base model name from the weights is used. | MaxItems: 5 Optional: {} items:MaxLength: 4096 items:MinLength: 1 items:Pattern: ^[!-~]+([\t ]?[!-~]+)*$ |
ModelStatus
ModelStatus defines the observed state of a Model.
Appears in:
| Field | Description | Default | Validation |
|---|---|---|---|
engineType EngineType | EngineType is the detected inference engine type, derived from the engine image. | Enum: [vllm unknown] Optional: {} | |
eppType EPPType | EPPType is the detected EPP type, derived from the EPP image. | Enum: [llm-d unknown] Optional: {} | |
phase ModelPhase | Phase summarizes the current lifecycle state of the model. | Optional: {} | |
conditions Condition array | Conditions represent the latest observations of the model's state. | Optional: {} |
ServingSpec
ServingSpec defines the serving configuration for the model instance.
Appears in:
| Field | Description | Default | Validation |
|---|---|---|---|
engine PodSpec | Engine is the pod spec for the inference engine. The container named 'engine' is the main container and must set an image. Containers with other names are added as sidecars. | ||
router PodSpec | Router is the pod spec for the entry point. The container named 'router' is the main container and must set an image. Containers with other names are added as sidecars. |
WeightsSpec
WeightsSpec defines where the model weights are sourced from.
Appears in:
| Field | Description | Default | Validation |
|---|---|---|---|
type WeightsType | Type of the weights source. | Enum: [hf] | |
hf HFWeightsSpec | HF configures weights sourced from Hugging Face. | Optional: {} |
WeightsType
Underlying type: string
Validation:
- Enum: [hf]
Appears in:
| Field | Description |
|---|---|
hf |