[Ray Dashboard] Observe GRAM Process Consumption about ray HOT 3 OPEN

We also have similar ideas. I'd like to know, in addition to the actual GRAM usage at the actor/task level, do you think adding a column to describe the logical resource usage of the GPU or XPU would be helpful?

Something like that could help better understand why the GRAM may have a certain amount of idle capacity, or assist in identifying cases where there is a significant deviation between the logical resource allocation and the actual usage.
Looking forward to hearing your thoughts. @gilljon

from ray.

Additionally, the GRAM info at actor/task level is actually available, but there's a small bug that's preventing it from being displayed. We will help fix it.

from ray.

We also have similar ideas. I'd like to know, in addition to the actual GRAM usage at the actor/task level, do you think adding a column to describe the logical resource usage of the GPU or XPU would be helpful?

I do think describing the logical resource is useful. We saturate our GPUs, so I always have about 90% utilization but am lost what is actually consuming the resources.

from ray.