Add Observability (Optional)#
Integrate OSMO with Grafana and Kubernetes Dashboard to monitor backend clusters, track resource usage, and improve operational visibility.
Prerequisites
Install the following components in your compute cluster for full observability support:
Install Grafana Dashboards#
OSMO provides pre-configured dashboards for monitoring workflows and backend operators.
Download Dashboard Files#
Download the following dashboard JSON files:
osmo-workflow-resources.json- Monitor CPU, memory, and GPU usage for running workflowsosmo-backend-operators.json- Monitor backend operator health and performance
Import to Grafana#
Import the dashboards using Grafana’s Import Dashboard documentation.
Configure Alerts#
Set up alerts using Grafana’s alert configuration .
Install Storage Metrics#
To enable usage metrics for ephemeral storage in Grafana, install the k8s-ephemeral-storage-metrics plugin in your compute cluster.
Update Backend Configs#
Next, update your OSMO backend configuration to include the Grafana and Kubernetes Dashboard URLs:
$ cat << EOF > /tmp/backend_config.json
{
"description": "<backend-description>",
"dashboard_url": "<kubernetes-dashboard-url>",
"grafana_url": "<grafana-url>"
}
EOF
$ export BACKEND_NAME=default # Update to your backend name
$ osmo config update BACKEND $BACKEND_NAME --file /tmp/backend_config.json
Once configured, you can access dashboard and resource usage links for each workflow in the OSMO UI. See the Workflow Resource Usage for details.
Security Considerations#
Configure secure access to monitoring tools:
Grafana: Configure user authentication and access control using the Grafana security documentation
Kubernetes Dashboard: Implement token-based login, user roles, and RBAC configuration. See Kubernetes Dashboard access control