What's New? - CAIP - 24-PI4
🚀 What's New in CAIP after 24-PI4?
24-PI4 (July 2 – August 26, 2024) streamlined CAIP project delivery and brought richer operational metrics to pipeline workloads, helping teams move from delivery to insight with less friction.
🖥️ CAIP Offboard v1 / v1.5: Classic & Managed Kubeflow
✨ New Features
📓 Notebooks & Development
The CAIP SDK added default image tags and shell autocompletion to reduce friction when building and running projects. GitHub Actions could expose direct links to the corresponding Kubeflow pipeline and run, while local pipeline and image versions responded to configuration environment variables—making project activity easier to connect with its pipeline context. Recurring pipeline schedules could now be declared in config.yaml, keeping execution timing version-controlled, reviewable, and reproducible alongside the rest of a project configuration.
🔀 Pipelines & Serving
A reusable CAIP Streamlit deployment action made consistent Streamlit application deployment simpler. The run-metrics component could publish multiple labelled Prometheus metrics alongside run status, and EMR workflows added Prometheus metrics with Grafana visualizations for Spark-on-EKS workloads, providing a more complete operational view.
📦 Repositories in This Release
caip-sdk— image tags, autocompletion, workflow links, configuration-aware versions, and YAML-defined schedules.deploy-caip-streamlit-action— reusable Streamlit deployment action.kubeflow-components— labelled metrics, run status, and EMR observability.
This section covers customer-visible changes for CAIP Offboard v1/v1.5 from July 2 – August 26, 2024 (24-PI4). For guides and reference material, see the CAIP Documentation.