Version 2.4.0

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here

Install python SDK (python 3.9 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

What's Changed

• chore: Update RELEASE.md to remove obsolete instructions by @chensun in #11183
• chore: Release kfp-pipeline-spec 0.4.0 by @chensun in #11189
• chore: release kfp-kubernetes 1.3.0 by @chensun in #11190
• chore: update kfp-kubernetes release scripts and instructions by @chensun in #11191
• feat(sdk)!: Pin kfp-pipeline-spec==0.4.0, kfp-server-api>=2.1.0,<2.4.0 by @chensun in #11192
• chore(sdk): release KFP SDK 2.9.0 by @chensun in #11193
• replaced deprecated image repos with registry.k8s.io by @HumairAK in #11152
• chore: Set Python 3.9 as the Minimum Supported Version by @diegolovison in #11159
• chore(docs): clean up kfp-kubernetes documentation index page by @gregsheremeta in #11207
• chore: move release instruction screenshots out of root directory by @chensun in #11215
• fix(ui): Fixes V1 Run detail unnecessary reloading. Fixes #10590 by @quinnovator in #11214
• fix(frontend): first time choosing a pipeline definition is VERY slow. Fixes #10897 by @ElayAharoni in #11130
• chore: clean up obsolete requirements.txt under root directory by @chensun in #11216
• chore(components): GCPC 2.17.0 Release by @copybara-service in #11213
• chore: fix CI by adding a dependency of python/sdk for the e2e-test by @rimolive in #11221
• refactor: fix invalid escape sequences by @TheKevJames in #11147
• fix(backend): upgrade PyYMAL to fix metadata_writer build error by @chensun in #11231
• chore(deps-dev): bump elliptic from 6.5.5 to 6.5.7 in /frontend by @dependabot in #11127
• chore(deps): bump fast-xml-parser and @aws-sdk/credential-providers in /frontend/server by @dependabot in #11056
• chore(deps): bump send and express in /frontend/server by @dependabot in #11229
• chore: add workflow to build images by @HumairAK in #11232
• fix(workflows): patch reversed launcher / driver in workflow matrix by @CarterFendley in #11238
• chore: Remove PaulinaPacyna from reviewers by @PaulinaPacyna in #11242
• test: Fixed kubeflow-pipelines-integration-v2 workflow by @hbelmiro in #11244
• feat(sdk): Allow disabling default caching via a CLI flag and env var by @DharmitD in #11222
• feat(frontend/backend): Allow the ability to sort experiments by last run creation. Fixes #10884 by @ElayAharoni in #11163
• chore: adding HumairAK to root OWNERS by @chensun in #11253
• feat(backend): add configurable S3 path style support by @ntny in #11246
• chore: adding @hbelmiro to backend reviewers by @hbelmiro in #11256
• chore: pinned estroz/rerun-actions version by @hbelmiro in #11257
• feat(backend): Remove PipelineSpec Template storage from ObjStore responsibilies. Fixes #10509 by @gmfrasca in #10790
• fix(backend): randomizing output uri path to avoid overwriting. Fixes #10186 by @b4sus in #11243
• correct lastrun unittest timestamps by @HumairAK in #11270
• chore(deps): bump rollup from 2.63.0 to 2.79.2 in /frontend by @dependabot in #11254
• chore(deps): bump webpack from 5.90.3 to 5.95.0 in /frontend by @dependabot in #11271
• chore(doc): Update kfp-kubenetes release instructions. by @chensun in #11276
• fix(backend): set default value to true for ForcePathStyle by @zazulam in #11281
• fix(components): remove default prediction column names in evaluation regression component to fix issues with bigquery data source by @copybara-service in #11282
• feat(workflows): use built images in Github workflows by @CarterFendley in #11284
• test: Integrate Git Hub Action Results into Tide by @VaniHaripriya in #11262
• chore(deps): bump golang.org/x/net from 0.0.0-20210726213435-c6fcb2dbf985 to 0.23.0 in /test/tools/project-cleaner by @dependabot in #10728
• Revert "chore(deps): bump golang.org/x/net from 0.0.0-20210726213435-… by @hbelmiro in #11297
• chore: update SinglePlatformSpec and ComponentSpec for Vertex Platform speci… by @chenyifan-vertex in #11298
• feat: add fields in SinglePlatformSpec by @chenyifan-vertex in #11299
• test: Resolve ci-check failures in long-running CI tests by @VaniHaripriya in #11295
• test: Fix failing SDK tests by creating Python virtual environment by @VaniHaripriya in #11300
• feat(testing): use kustomize to patch deployments before deploy by @CarterFendley in #11294
• test: Disabled ci-check and add-ci-passed-label workflows. by @hbelmiro in #11306
• chore(components): move old components to contrib folder by @chensun in #11315
• test: Enabled ci-check and add-ci-passed-label workflows by @VaniHaripriya in #11320
• fix(tests): remove redundant integration test wf by @droctothorpe in #11322
• adding chore as a new template. Fixes #11263 by @varodrig in #11317
• Add-Create-Experiment-button-when-selecting-experiement-final by @ElayAharoni in #11332
• feat(components): Add reservation_affinity support in v1.create_custom_training_job_from_component by @copybara-service in #11330
• feat(components)!: Deprecate preview.custom_job module by @copybara-service in #11336
• feat(api): add PipelineConfig to api to re-implement pipeline-level config by @gregsheremeta in #11333
• feat(component): execute in a virtual env by @leseb in #11326
• feat(sdk): add PipelineConfig to DSL to re-implement pipeline-level config by @gregsheremeta in #11112
• chore: fix release note by @chensun in #11337
• fix(components): Fix create_custom_training_job_from_component default location by @copybara-service in #11334
• chore(components): Update docker base image to marketplace.gcr.io/google/ubuntu2404, which will install newer Python by @copybara-service in #11338
• chore(backend): typo in max concurrency error text by @Gkrumbach07 in #11342
• feat(backend): implement subdag output resolution by @droctothorpe in #11196
• chore: upstream our authorization changes for oauth2-proxy by @juliusvonkohout in #11347
• test: Fix ci-passed label update on PR synchronization by @VaniHaripriya in #11358
• chore: Added cached layer for Go dependencies to Dockerfiles by @hbelmiro in #11348
• chore: Update the generated cache proto file by @rimolive in #11359
• feat(sdk)!: stop auto-populating metrics as dag output by @chensun in #11362
• chore(sdk): release KFP SDK 2.10.0 by @chensun in #11364
• chore(components): bump highest support KFP SDK version to 2.10.0 and highest support Python version to 3.13 by @copybara-service in #11369
• chore(sdk): remove kfp.deprecated from sdk, legacy samples, and legacy tests by @chensun in #11366
• chore: Updating Pytorch-Launcher component to work with pipelines v2 by @Fiona-Waters in #11273
• chore(components): remove upper limit on python_requires by @copybara-service in #11371
• fix(sdk): accelerator type setting in kfp by @HumairAK in #11373
• chore(sdk): support Python 3.13 by @chensun in #11372
• chore(api): release kfp-pipeline-spec 0.5.0 by @chensun in #11378
• chore(sdk): release KFP SDK 2.10.1 by @chensun in #11379
• chore(sdk): release kfp-kubernetes 1.4.0 by @chensun in #11380
• chore(backend): remove mentions of Argo Workflows from the pipelinerun by @ntny in #11368
• test: Added support for Python 3.13 to tests by @hbelmiro in #11376
• chore(components): support KFP SDK 2.10.* by @copybara-service in #11387
• feat[frontend]: implement artifact-repositories configmap support by @droctothorpe in #11354
• chore(components): User virtual env in GCPC Dockerfile and update incompatible dependencies by @copybara-service in #11388
• feat(cli): expose existing_token client property by @tumido in #11400
• chore(components): Bump image version for Structured Data pipelines by @copybara-service in #11397
• fix(backend): handle client side HTTP timeouts to fix crashes of metadata-writer. Fixes #8200 by @OutSorcerer in #11361
• fix(backend): stop heartbeat status updates for ScheduledWorkflows. Fixes #8757 by @demarna1 in #11363
• chore(deps): bump tornado from 6.3.3 to 6.4.2 in /backend/src/apiserver/visualization by @dependabot in #11402
• chore(deps-dev): bump elliptic from 6.5.7 to 6.6.0 in /frontend by @dependabot in #11343
• chore: Added Dockerfiles to .dockerignore by @hbelmiro in #11408
• fix(ui): Disable GKE Metadata as default Fixes: #11247, fixes #11260 by @dvcanton in #11403
• chore: have ci check run from default branch by @HumairAK in #11414
• chore(components): Update Dockerfile by @copybara-service in #11415
• chore: add workflow to approve pr runs by @HumairAK in #11416
• chore(deps): bump tornado from 6.4.1 to 6.4.2 in /test/sample-test by @dependabot in #11407
• fix(backend): return error properly by @leseb in #11424
• feat(component): Created Snowflake data unload component by @ChaosEternal in #11349
• feat(components): add strategy to v1 GCPC custom job components/utils by @copybara-service in #11286
• fix(sdk): Add error handling. Fixes #11164 by @Yael-F in #11356
• fix(backend): remove unused function argument by @leseb in #11425
• chore: Fix pr-commands.yml to enable /ok-to-test alongside other commands by @hbelmiro in #11427
• fix(sdk): Backport fixes in #11075 by @rimolive in #11392
• feat(backend): Add Parallelism Limit to ParallelFor tasks. Fixes #8718 by @gmfrasca in #10798
• feat(sdk/backend): enable parameterization of container images by @HumairAK in #11404
• chore(components): release GCPC SDK 2.18.0 by @copybara-service in #11435
• feat: Introduce cache_key for cache key customization by @zzmao in #11434
• chore: add adr template/docs by @HumairAK in #11437
• chore(deps): bump path-to-regexp and express in /frontend/mock-backend by @dependabot in #11444
• fix(backend): Allow initializing the Kubernetes client with a kubeconfig by @mprahl in #11443
• chore(sdk): Upgrade kfp-pipeline-spec to 0.6.0 (#11434) by @zzmao in #11447
• chore(sdk): release kfp sdk 2.11.0 by @chensun in #11451
• chore: Added Kubernetes 1.30 and 1.31 to e2e tests by @hbelmiro in #11450
• chore: Add instructions to develop the API server locally with kind by @mprahl in #11459
• chore: Added Kubernetes 1.30 and 1.31 to other tests by @hbelmiro in #11463
• chore: Update test READMEs to reflect correct information on testing workflows by @DharmitD in #11445
• chore: Update image for metacontroller by @biswassri in #11474
• fix(backend): modelToCRDTrigger was not including periodic schedule correctly by @hbelmiro in #11475
• fix(backend): upgrade various old dependencies by @HumairAK in #11448
• chore: Add securitycontext for PSS PoC (rootless Kubeflow) by @juliusvonkohout in #11462
• chore(deps): bump golang.org/x/crypto from 0.22.0 to 0.31.0 by @hbelmiro in #11482
• test: fixes SDK tests by @hbelmiro in #11488
• chore(tests): fixed conflicting artifacts names by @hbelmiro in #11491
• chore(test): Fix SDK tests by @rimolive in #11496
• chore(backend): Fixed namespace in job creation by @hbelmiro in #11480
• chore(backend): Fixed ServiceAccount in job creation by @hbelmiro in #11481
• fix(backend): Synced ScheduledWorkflow CRs on apiserver startup by @hbelmiro in #11469
• chore(deps): Update client-go and controller-runtime by @mprahl in #11473
• feat(sdk/backend): Add support for placeholders in resource limits by @mprahl in #11501
• chore: Add instructions to remote debug the Driver pods by @mprahl in #11499
• fix(backend): Use an Argo Workflow exit lifecycle hook for exit handlers by @mprahl in #11470
• nominate approver & reviewer for backend by @HumairAK in #11507
• nominate reviewers for backend by @HumairAK in #11508
• chore(deps): bump nanoid and mocha in /test/frontend-integration-test by @dependabot in #11454
• fix(frontend): Detailed information of nodes is not displayed when clicking the node. Fixes #11325 by @ElayAharoni in #11493
• Fix the failing exit handler SDK execution tests by @mprahl in #11519
• chore: Address CVEs by @mprahl in #11514
• add remaining dockerfiles to build workflow by @HumairAK in #11522
• fix(frontend): Fix the frontend image build with Node 22 (#11524) by @HumairAK in #11525
• chore: switch to using gh container registry in manifests (#11526) by @HumairAK in #11527
• switch release/api generator images to ghcr (#11528) by @HumairAK in #11530

New Contributors

• @quinnovator made their first contribution in #11214
• @TheKevJames made their first contribution in #11147
• @CarterFendley made their first contribution in #11238
• @PaulinaPacyna made their first contribution in #11242
• @ntny made their first contribution in #11246
• @chenyifan-vertex made their first contribution in #11298
• @varodrig made their first contribution in #11317
• @leseb made their first contribution in #11326
• @Gkrumbach07 made their first contribution in #11342
• @tumido made their first contribution in #11400
• @OutSorcerer made their first contribution in #11361
• @demarna1 made their first contribution in #11363
• @dvcanton made their first contribution in #11403
• @ChaosEternal made their first contribution in #11349
• @Yael-F made their first contribution in #11356
• @biswassri made their first contribution in #11474

Full Changelog: 2.3.0...2.4.0