Skip to content

Releases: flyteorg/flyte

Flyte v1.11.0-b0 milestone release

29 Feb 06:59
a2a63eb
Compare
Choose a tag to compare
Pre-release

Flyte v1.11.0-b0

Beta release to test new idl

Flyte v1.10.7 milestone release

14 Feb 04:00
80a8765
Compare
Choose a tag to compare

Flyte 1.10.7 Release Notes

We're excited to share the release of Flyte 1.10.7, featuring a broad spectrum of updates, improvements, and bug fixes across the Flyte ecosystem. This release marks a pivotal shift in our development approach, notably with our adoption of buf for protobuf stub generation. This move optimizes our development workflow and discontinues the automatic creation of Java and C++ stubs, making it easier to adapt the generated code for other languages as needed. Additionally, we've upgraded to gRPC-gateway v2, aligning with the latest advancements and recommendations found in the v2 migration guide.

Our sincere gratitude goes to all contributors for their invaluable efforts towards this release.

Core Improvements and Bug Fixes

  • Improved error handling for transient secret sync issues, enhancing the robustness of secret management. [PR #4310]
  • Introduced Sphinx build for Monodocs, improving documentation generation and integration. [PR #4347]
  • Enhanced the Spark plugin by fixing the environment variable ValueFrom for pod templates, allowing for more dynamic configurations. [PR #4532]
  • Optimized fastcache behavior to not cache lookups on node skip, reducing unnecessary cache hits. [PR #4524]
  • Removed composition errors from branch nodes, streamlining execution paths. [PR #4528]
  • Added support for ignoring warnings related to AWS SageMaker imports, improving integration compatibility. [PR #4540]
  • Fixed a bug related to setting the service account from PodTemplate, ensuring correct service account usage. [PR #4536]
  • Addressed flaky tests in test_monitor, enhancing test reliability. [PR #4537]
  • Updated the boilerplate version and contribution guide, facilitating better community contributions. [PR #4541], [PR #4501]
  • Improved documentation build processes by manually creating version files and introducing a conda-lock file for consistent environment setup. [PR #4556], [PR #4553]
  • Enhanced array node evaluation frequency optimization by detecting subNode phase updates. [PR #4535]
  • Introduced support for failure nodes, allowing workflows to handle failures more gracefully. [PR #4308]
  • Made various updates to Go versions, plugin integrations, and GitHub workflows to enhance performance and developer experience. [PR #4534], [PR #4582], [PR #4589]
  • Addressed several bugs and made improvements in caching, metadata handling, and task execution, further stabilizing the Flyte platform. [PR #4594], [PR #4590], [PR #4607]
  • Streamlined development workflow with the transition to buf for generating protobuf stubs, ceasing the automatic generation of Java and C++ stubs.
  • Upgraded to grpc-gateway v2, optimizing API performance and compatibility.

Plugin and Integration Enhancements

  • Added new features and fixed bugs in the Spark plugin, Ray Autoscaler integration, and other areas, expanding Flyte's capabilities and integration ecosystem. [PR #4363]
  • Updated various dependencies and configurations, ensuring compatibility and security. [PR #4571], [PR #4643]
  • Improved the handling and documentation of plugin secrets management, making it easier for users to manage sensitive information. [PR #4732]

Documentation and Community

  • Updated community meeting cadence and contribution guidelines, fostering a more engaged and welcoming community. [PR #4699]
  • Enhanced documentation through various updates, including the introduction of a new architecture image for FlytePlugins and clarification of propeller scaling. [PR #4661], [PR #4741]

Full Changelog

Read more

Flyte v1.10.7-b4 milestone release

06 Feb 23:20
3180b23
Compare
Choose a tag to compare
Pre-release

Flyte v1.10.7-b4 Release

Pre-release testing.

Flyte v1.10.7-b3 milestone release

01 Feb 02:28
5d24d23
Compare
Choose a tag to compare
Pre-release

Flyte v1.10.7-b3 Release

Pre-release testing.

Flyte v1.10.7-b2 milestone release

24 Jan 00:09
92af9ef
Compare
Choose a tag to compare
Pre-release

Flyte v1.10.7-b2 Release

Pre-release testing.

Flyte v1.10.7-b1 milestone release

19 Jan 00:14
2866d5a
Compare
Choose a tag to compare
Pre-release

Flyte v1.10.7-b1 Release

Pre-release testing.

Flyte v1.10.7-b0 milestone release

08 Jan 23:05
7b3f405
Compare
Choose a tag to compare
Pre-release

Flyte v1.10.7-b0 Release

Beta release.

Flyte v1.10.6 milestone release

06 Dec 00:34
c049865
Compare
Choose a tag to compare

Flyte 1.10.6 Release

Due to a mishap in the move to the monorepo, we ended up generating the git tags between 1.10.1 to 1.10.5, so in order to decrease the confusion we decided to skip those patch versions and go straight to the next available version.

We've shipped a ton of stuff in this patch release, here are some of the highlights.

GPU Accelerators

You'll be able to get more fine-grained in the use GPU Accelerators in your tasks. Here are some examples:

No preference of GPU accelerator to use:

@task(limits=Resources(gpu="1"))
def my_task() -> None:
    ...

Schedule on a specific GPU accelerator:

from flytekit.extras.accelerators import T4


@task(
    limits=Resources(gpu="1"),
    accelerator=T4,
)
def my_task() -> None:
    ...

Schedule on a Multi-instance GPU (MIG) accelerator with no preference of partition size:

from flytekit.extras.accelerators import A100


@task(
    limits=Resources(gpu="1"),
    accelerator=A100,
)
def my_task() -> None:
    ...

Schedule on a Multi-instance GPU (MIG) accelerator with a specific partition size:

from flytekit.extras.accelerators import A100


@task(
    limits=Resources(gpu="1"),
    accelerator=A100.partition_1g_5gb,
)
def my_task() -> None:
    ...

Schedule on an unpartitioned Multi-instance GPU (MIG) accelerator:

from flytekit.extras.accelerators import A100


@task(
    limits=Resources(gpu="1"),
    accelerator=A100.unpartitioned,
)
def my_task() -> None:
    ...

Improved support for Ray logs

#4266 opens the door for RayJob logs to be persisted.

In #4397 we added support for a link to a Ray dashboard to show up in the task card.

Updated grafana dashboards

We updated the official grafana dashboards in #4382.

Support for Azure AD

A new version of our stow fork added support for Azure AD in flyteorg/stow#9.

Full changelog:

New Contributors

Read more

Flyte v1.10.6-b0 milestone release

30 Nov 06:49
7d712de
Compare
Choose a tag to compare
Pre-release

Flyte v1.10.6-b0 Release

Beta release.

Flyte v1.10.0 milestone release

21 Oct 00:13
fa49d3b
Compare
Choose a tag to compare

Flyte v1.10.0 Release

This release marks the move to the (monorepo](#4014). From now on the development of backend components is going to be done in the Flyte main repo.

Flyte Agents are also getting a major lift. They are not only more performant, but we're also announcing support for a variety of agents, including Airflow, Memverge, Snowflake, Databricks.

Programmatically consuming inputs and outputs using flyteremote became a lot easier with the introduction of code snippets directly in the UI. For example, notice the small blurbs below inputs and outputs in the side panel:

Usage snippet

You'll now be able to use offloaded types in eager workflows.

More ergonomic improvements to pyflyte, including the inclusion of a progress bar, the ability to activate launchplans, and the ability to interact with gate nodes in local executions.

And much more. Here's the exhaustive list of changes:

Flytekit

Flyteadmin

  • Fixed bug for incorrect name (#4175)
  • Add version control for ArrayNode eventing (#4165)
  • Update golang experimental dep (#4177)
  • Add Additional gRPC service handler hook (#4171)
  • Handle batched TaskExecutionEvent reasons (#615)
  • Lint flyteadmin/auth/handlers_test.go
  • #patch Update FromWorkflowModel API (#617)
  • add codespell: config, workflow and have typos fixed (#4054)
  • Handle batched TaskExecutionEvent reasons (#615)
  • Update FromWorkflowModel API (#617)
  • Update boilerplate version (#605)
  • Reduce a warning to info (#612)
  • Logout hook plugin (#611)
  • Expire flyte_idt cookie at logout (#610)
  • Use configured domain on expired cookie...
Read more