Propose a more intuitive queue priority about volcano HOT 4 OPEN

/assign

from volcano.

Queue Priority

Motivation

The current queue prioritization in Volcano is based on the principle that a lower share value indicates higher priority for resource allocation during scheduling.

However, based on user feedback and practical scenarios, there is a strong preference for a more straightforward approach to establishing queue priorities. Explicitly assigning priorities provides users with clear and immediate control over the order in which their queues are serviced.

While Volcano's current method of using queue shares effectively determines priority, there is a clear demand for a more intuitive and user-friendly approach to setting and managing queue order. Enabling users to directly assign and adjust queue priorities in the specifications would simplify queue management significantly.

Implementation

Data Structure

Add priority to spec of queues.scheduling.volcano.sh. The priority attribute controls the order of queues in all plugins that implement QueueOrderFn.

spec:
    ...
    priority:
        type: number
    ...

The range for priority is from 0 to the maximum limit of int32.

Queue Ordering

Under the premise that queues that are overused will not enter the scheduling process, all QueueOrderFn plugins adhere to the following sorting logic:

• Check queue priority first, queues with higher priority are positioned at the front of the PriorityQueue and are popped first.
• When queue priority values are identical, the logic reverts to the current method of comparing queue shares.

from volcano.

Queue Priority

Motivation

The current queue prioritization in Volcano is based on the principle that a lower share value indicates higher priority for resource allocation during scheduling.

However, based on user feedback and practical scenarios, there is a strong preference for a more straightforward approach to establishing queue priorities. Explicitly assigning priorities provides users with clear and immediate control over the order in which their queues are serviced.

While Volcano's current method of using queue shares effectively determines priority, there is a clear demand for a more intuitive and user-friendly approach to setting and managing queue order. Enabling users to directly assign and adjust queue priorities in the specifications would simplify queue management significantly.

Implementation

Data Structure

Add priority to spec of queues.scheduling.volcano.sh. The priority attribute controls the order of queues in all plugins that implement QueueOrderFn.

spec:
    ...
    priority:
        type: number
    ...

The range for priority is from 0 to the maximum limit of int32.

Queue Ordering

Under the premise that queues that are overused will not enter the scheduling process, all QueueOrderFn plugins adhere to the following sorting logic:

• Check queue priority first, queues with higher priority are positioned at the front of the PriorityQueue and are popped first.
• When queue priority values are identical, the logic reverts to the current method of comparing queue shares.

Please also descibe the behavior of scheduler in queue reclaim case, and submit a design pr individually: )

from volcano.

/assign @TaiPark

from volcano.