> A note first: the final text and the illustrations are generated, of course. I have been using LLMs since the GPT-3 preview, so it feels odd to even make the comment. The point is that the thought...
GCS/OCS provides a flexible resource management system that has been refined over many years. Integrating new resources—whether quantum computers, tape libraries, cloud instances, hardware...
Gridware Cluster Scheduler 9.0.10 based on Open Cluster Scheduler 9.0.10 (fka. Grid Engine) is now available. This is a patch release with fixes accumulated over the last month. If you want to give...
Gridware Cluster Scheduler supports munge authentication in daily builds since a while, bringing enhanced security to containerized workloads. This widely-adopted service runs as a separate daemon,...
Grid Engine introduced the parallel job concept to the scheduler domain decades ago, laying the foundational groundwork. In today's AI age, multi-node computations are the essential building blocks...
The job priority system that was refined over years continues to be one of the most sophisticated features in Open Cluster Scheduler and its fully supported companion, Gridware Cluster Scheduler. Yet...
Update (July 21, 2025): Newer versions are now available! You can install OCS 9.0.6 or 9.0.7 for testing using: curl -s...
I'm excited to share our latest podcast, which explores the release of Gridware Cluster Scheduler 9.0.5 — built on the new Open Cluster Scheduler 9.0.5! Once again, I turned to NotebookLM to...
Over at HPC Gridware I recently published a blog post highlighting how Gridware Cluster Scheduler (formerly known as "Grid Engine") can significantly simplify GPU management and maximize efficiency...
Observability in HPC and AI clusters continues to evolve, and we’re thrilled to introduce qtelemetry, now in developer preview. This new tool provides deep insight into your Gridware Cluster...
Ever dreamed of capturing custom metrics for your jobs—like user-generated performance counters or application-specific usage data—directly in your accounting logs? Gridware Cluster Scheduler...
If you’re managing HPC or AI clusters with Grid Engine, scalability is probably your daily obsession. As core counts explode and workloads grow more complex, the Gridware Cluster Scheduler (GCS)...
Check out the full article here. Unlock the full potential of your GPU resources with Open Cluster Scheduler's latest feature — Resource Map (RSMAP). This powerful and flexible resource type...
Looks like another gap between Kubernetes and traditional HPC scheduler is solved: Kubernetes 1.18 enables a new feature called Topology Manager. That’s very interesting for HPC workload since the...
runc is a tool written in Go which is creating and starting up a Linux container according to the OCF specification. Its source code repository can be found here. If you have a Go development...
Univa Grid Engine can run any workload in your compute cluster. Hence Univa Grid Engine can also easily run Grid Engine as a job. This could be probably required if you want to strictly isolate...
At Univa we hold 2014 several webinars about Univa Grid Engine and related topics. They contain lots of useful technical information also for open source Grid Engine users. The videos can be...
There is no direct way in Grid Engine for getting all host groups in which one particular host is part of. But Grid Engine offers a mighty command qconf -shgrp\_resolved which returns all hosts of a...
Grid Engine's scheduler configuration is very flexible. But unfortunately flexibility often comes with interdependencies and hence increases complexity. In this article I want to have a look at one...
A little bit late with my blog entry, I’m happy to announce the availability of a new major version update of Grid Engine: Univa Grid Engine 8.2 There are too many improvements to handle them all...
Univa provides demo packages for Univa Grid Engine for free. The only restriction is that those packages have a built-in limitation to handle a cluster with 48 cores at maximum. But this should be...
You can find my slides from the HEPiX 2014 conference about the cgroup integration in Univa Grid Engine here.
With JSV scripts you can verify and change your job submission parameters. Depending on the called functions you can also reject jobs which does not follow rules you specify in the script. Those JSV...
When configuring Grid Engine a good tuning point is always to reduce the amount of queues (i.e. queue instances). When having a need for different machine type specific prolog and epilog scripts (for...
Sometimes it is useful to display the communcation between two Grid Engine daemons. For example when load sensor values are not visable in qstat (or wrong values appear). In order to print out a...
Tightly integrated parallel jobs are under full control of Grid Engine (accounting/resource limitation/etc.). But what happens when a tightly integrated parallel job is suspended? The default signal...
Since today the next milestone of Grid Engine - UGE 8.1.5 is officially available. It not just contains over 40 important fixes, it is also the first version with built-in support for our new product...
Some weeks ago we released the Univa Grid Engine (UGE) 8.0.1p16 maintenance release for our 8.0.1 users and today we are happy to ship the next version of our 8.1 branch: 8.1.4. Overall it has about...
A compute cluster or grid often varies in the hardware installed. Some compute nodes offers processors with strong compute capabilities while others are older and slower. This becomes an issue when...
Version 8.1.3 of Grid Engine is out! It comes with some performance improvements in the scheduler, some new features, and of course bug fixes. The most important thing first: The scheduler is now in...
The current release of Univa‘s Grid Engine 8.1.2 is not only further improving stability, it also has a small enhancement for a better support of heterogenous clusters having hyper-threaded and non...
Due to the tremendous amount of configuration options in Grid Engine one complex configuration parameter is often overlooked: FORCED complexes. Grid Engine handles resources in the complex...
This article describes exploiting a per-rank binding when using a "rankfile" with OpenMPI jobs and hybrid jobs using OpenMP in Univa Grid Engine 8.1 That compute jobs can improve performance when...
Normally you get with qstat -f (besides other values) the load\_avg value which is the medium (5 min. avg. OS run-queue length in Linux) load of a machine. This is the same value which you will get...
This article introduces the different methods how cluster usage can be accessed in Univa Grid Engine Job accounting and cluster usage data can be accessed in Univa Grid Engine at different layers....
My colleague Ernst has assembled an overview about what's new in Univa Grid Engine 8.1.
This enhancement was already implemented for the patch release 8.0.1p5. But since it wasn‘t in the 8.0.1 FCS I denote it here as an 8.1 enhancement (the real truth is that I don‘t want to mix up...
Resource urgencies can be set in the so called complex configuration with qconf -mc. One prominent example is the „slots“ resource which comes with a default urgency of 1000. This leads to the...
Grid Engine supported 3 different spooling methods in the past: classic spooling (where the data is written directly into files on the filesystem), berkeleydb spooling (where the data is written into...
Another new enhancement of Univa Grid Engine 8.1 is that it simplifies debugging in case of problems during job execution. When you encounter that your job was not executed successfully on the...
Grid Engine deals with several different resource types like memory, resources which can be counted (integer), resources with names (strings/regex), resources with values (double), and boolean...
For the UGE 8.1 release we will add several new features to Univa Grid Engine. One of them is an enhancement of the Grid Engine scheduler component: it is now completely NUMA aware! I.e. it does its...
One of my current projects is implementing cgroups in Univa Grid Engine. It will be available in the next releases (Univa Grid Engine 8.1.7 or 8.2). Control groups are a Linux kernel enhancement...
For the 6.2u5 release of Sun Grid Engine (SGE) I designed and implemented a new feature called „core binding“. Because it was developed under an open source license it is available for the whole...