KFP-Tekton V2 tracker issue

[Tomcli]

/kind feature

Description:

• KFP-Tekton V2 code refactoring and optimization:

  • Performance enhancement: Update pipelineloop to use informer instead of lister for updating pipeline status. #1357
  • [KFP-Tekton v2] Merge driver, ktp-task, and taskrun logic into a single custom task controller #1361
  • Moving KFP-Tekton V2 custom task controller to master branch and use go mod import #1364
  • [KFP-Tekton v2] Merge DAG drivers and publishers into a sub-dag controller to reduce Tekton graph complexity. #1419
    • Pending on Status IR implementation.

• KFP V2 upstream features:

  • KFP V1 feature complete:
    • Support all k8s spec on the new KFP V2 IR [feature/idea] Integrate kubernetes's models into kfp-kubernetes pipelines#9768
    • Support log archive [feature] display main.log as artifact for each step pipelines#10036
    • Update our fluentd example to store the log archive file in the KFP V2 location (not implemented yet) Update fluentd example to support new KFP V2 log archive #1365
  • KFP V2 Status-IR: KFP V2 tracking issue KFP v2 tracker pipelines#6110
    • feature(backend) Status-IR: add MLMD client to persistence agent and support for Status-IR pipelines#8964
      • May need to implement the "Publisher" for updating dag and pipeline status according to original KFP V2 design bit.ly/kfp-v2.
    • feature(backend) Provide interface for calling MLMD via api-server pipelines#8965
    • feature(frontend) Support Status-IR and remove MLMD client in KFP Frontend pipelines#8966
  • Remove client dependency on schedule workflows and persistent agent
    • feat(scheduledworkflow): add functionality to relay on pipeline id instead of copy workflow. Fixes #4752 pipelines#6207
    • See can persistent agent be opted out or be crobjob for just asking api-server to sync the mlmd status to the kfp run status.

Once all these issues are resolved, we can push the Tekton compiler/executor spec code to upstream since it will only need to be embedded into the api-server.

Additional information:
[Miscellaneous information that will assist in solving the issue.]