Skipping of cached task outputs via execution config

[MorpheusXAUT]

TL;DR

Cached output of tasks can now be skipped and overwritten for single executions.

Type

• Bug Fix
• Feature
• Plugin

Are all requirements met?

• Code completed
• Smoke tested
• Unit tests added
• Code documentation added
• Any pending items have an associated Issue

Complete description

flytepropeller now supports the new cache skip flag via execution configuration, causing it to ignore any cached outputs and re-running all tasks. Any stored data will be overwritten with the new results of the execution.
As the HTTP verb PUT can either be used to create or update data, I've decided to extend the Put method of CatalogClient to allow for either creation or updating of artifacts instead of creating a separate new method.

As this uses currently unmerged versions of flyteidl, flyteplugins and flytestdlib, the PR is created as a draft (for review) until the respective new versions are available.

Tracking Issue

flyteorg/flyte#2867

Follow-up issue

NA

[codecov]

Codecov Report

Merging #489 (612ad89) into master (3405a04) will increase coverage by 0.14%.
The diff coverage is 72.41%.

❗ Current head 612ad89 differs from pull request most recent head 7edfbfe. Consider uploading reports for the commit 7edfbfe to get more accurate results

[MorpheusXAUT]

@hamersaw Just pushed an update that renamed the flag from skipCache to overwriteCache and handles NotFound while updating gracefully.
Last thing that should be missing for this PR to be ready for merge is the discussion in the flyteplugins PR to be resolved and for that to be merged so I can remove the replace directive in go.mod.

[hamersaw]

@MorpheusXAUT looks like we need to manually specify the go version for codeql, can you add the middle "step" the .github/workflows/codeql-analysis.yml file?

    - name: Checkout repository
      uses: actions/checkout@v2

    - uses: actions/setup-go@v2
      with:
        go-version: '1.18'

    # Initializes the CodeQL tools for scanning.
    - name: Initialize CodeQL
      uses: github/codeql-action/init@v1
      with:
        languages: ${{ matrix.language }}
        # If you wish to specify custom queries, you can do so here or in a config file.
        # By default, queries listed here will override any specified in a config file.
        # Prefix the list here with "+" to use these queries and those in the config file.
        # queries: ./path/to/local/query, your-org/your-repo/queries@main

[MorpheusXAUT]

@hamersaw Pushed, seems to be working now 👍