ASUS launched the UGen 300 on May 6, 2024, marking its entry into the USB-C AI accelerator market. The device is designed to add local artificial intelligence processing capabilities to existing personal computers. It connects to host systems via a USB 3.1 Gen2 Type-C interface. This hardware solution allows users to run AI workloads without relying solely on cloud-based services.
Device connects to host systems via USB 3.1 Gen2 Type-C interface
The core of the UGen 300 is the Hailo-10H AI processor. This chip delivers a compute performance of 40 TOPS at INT4 precision. The system includes 8GB of dedicated LPDDR4 memory to handle data locally. This dedicated memory ensures that complex AI tasks do not slow down the host computer's general performance. The device consumes only 2.5W of power under typical working loads.
ASUS states that the 40 TOPS performance level meets the minimum NPU requirements for Microsoft Copilot+ PCs. The accelerator supports Windows, Linux, and Android operating systems. It is compatible with major AI frameworks including TensorFlow, PyTorch, and ONNX. ASUS plans to release UGen Utility software that provides access to over 100 pre-trained models for immediate use.
The UGen 300 is available for purchase in Taiwan starting May 6, 2024. The recommended retail price is 6380 TWD, which is approximately $204. ASUS has not yet announced the launch date or pricing for the mainland China market. These details for mainland China remain pending an official announcement from the vendor.
Local AI inference offers benefits for privacy and cost savings by keeping data on the device. The UGen 300 enables this capability through a simple plug-and-play peripheral form factor. This approach allows older PCs to gain modern AI processing power without internal hardware upgrades. The product targets users who need efficient local AI acceleration for various computing tasks.
Discussion
0 comments
Log in to join the thread with a thoughtful take, question, or correction.