2024-10-17
Summary: HAMi 2.4.0 release brings multiple important updates from RiseUnion, including enhanced GPU virtualization capabilities, intelligent task scheduling, and resource monitoring features. The new version significantly improves AI computing resource efficiency, supports more flexible multi-tenant management, and provides comprehensive support for enterprise AI infrastructure management, facilitating enterprise digital transformation.
We are excited to announce the release of HAMi 2.4.0! This new version brings significant improvements in device heterogeneity capabilities and usability.
HAMi (Heterogeneous AI Computing Virtualization Middleware), initiated in 2021, is an efficient heterogeneous AI device management tool. As a CNCF (Cloud Native Computing Foundation) sandbox project, HAMi demonstrates its development potential in the cloud-native ecosystem with key features including:
Through GPU computing power sharing and resource isolation, combined with priority and other scheduling strategies, HAMi can effectively optimize GPU resource utilization, becoming an important tool in heterogeneous AI chip scenarios.
The new version supports Ascend 910b and Ascend310P devices, providing dynamic NPU virtualization capabilities. Users can use dynamically partitioned vNPU devices.
In the new version, HAMi has added a WebUI to provide users with a more friendly interface. Features include: resource overview, node management, GPU management, and task management. This makes it convenient for users to clearly understand GPU resource usage in the cluster and more effectively monitor GPU resource allocation and usage.
For more details: https://github.com/Project-HAMi/HAMi-WebUI
In this v2.4.0 release, RiseUnion (Beijing RiseUnion Technology Co., Ltd.) led the development of several key features, including:
RiseUnion will continue to promote HAMi's progress and innovation in the field of heterogeneous AI computing, helping users better manage and schedule heterogeneous device resources.
To learn more about RiseUnion's GPU virtualization and computing power management solutions, contact@riseunion.io