Home >News >Introducing Meta Scheduling in the Cloud

Introducing Meta Scheduling in the Cloud

27.05.2021

YellowDog has announced the concept of Meta Scheduling in the latest release of its Platform, providing businesses with a single management pane for workloads, regardless of cluster technology.

A Single System to Dynamically Scale Clusters Using a Variety of Technologies

Meta Scheduling provides a single workload submission system that can coordinate multiple third-party heterogeneous clusters. This is achieved by allowing users to create and manage dynamically scaling compute clusters, run by a variety of technologies and schedulers.

Meta Scheduling enables the YellowDog Workload Manager to control an overall queue of work and through templating, define the configuration and type of nodes required to execute this work. Once defined, it then orchestrates and pushes workloads to these nodes.

Flexible Event-Driven Configuration Management

By applying configuration to the worker nodes at particular points in the lifecycle, YellowDog offers flexible event-driven configuration management. Templated configuration can be deployed using scripts or tools, such as Ansible, on specific nodes. The general use case involves the creation of loosely or tightly coupled compute clusters, but sidecars, such as file and DNS servers, can also be deployed for the cluster to use. When the workload has been executed, the cluster can either be dynamically scaled up or down for other tasks or be rapidly dismantled and the instances terminated.

Extensive Visibility of Workload Execution

With Meta Scheduling, businesses can benefit from a single view on cost and department consumption across applications. Users can build economically viable compute clusters at scale, in both hybrid and multi-cloud environments, and multiple clusters can be created concurrently to help customers overcome on-premise capacity constraints.

Fundamentally, Meta Scheduling enables businesses to utilise a wide range of familiar technologies and processes, whilst taking advantage of the intelligent provisioning strategies provided by the YellowDog Platform.

About YellowDog

YellowDog, founded in 2015 in Bristol, UK, helps business scale across the cloud like no other. The YellowDog Platform is an intelligent, cloud native workload management and provisioning solution, which is used all over the world for multiple applications.

YellowDog works with cloud partners including Amazon Web Services, Microsoft Azure, Oracle Cloud Infrastructure, Google Cloud Platform and Alibaba Cloud.

Share this: Latest News Articles
Running FSI workloads on AWS with YellowDog 10.07.2024
Mark Noctor joins YellowDog as Chief Commercial Officer 09.05.2024
YellowDog enables Nextflow users to go Hybrid and Multi-Cloud 08.11.2023
YellowDog Please upgrade your browser

You are seeing this because you are using a browser that is not supported. The YellowDog website is built using modern technology and standards. We recommend upgrading your browser with one of the following to properly view our website:

Windows Mac

Please note that this is not an exhaustive list of browsers. We also do not intend to recommend a particular manufacturer's browser over another's; only to suggest upgrading to a browser version that is compliant with current standards to give you the best and most secure browsing experience.