To accelerate AI research and deployment, FPT and NVIDIA® brought together leading international organizations in the industry establish a state-of-the-art AI factory to support for ever-expanding AI innovation while also reinforcing sovereign AI across diverse industries such as healthcare, finance and transportation in Vietnam and Japan.
The challenge
FPT needed an AI factory that could handle the immense computational demands of training and deploying large-scale AI models while ensuring efficiency, reliability, and scalability. The infrastructure had to support high-performance GPUs for deep learning and large-language-model (LLM) training while maintaining optimal energy efficiency to minimize operational costs and environmental impact. Ensuring seamless integration of hardware and software was crucial to optimize AI performance, requiring a robust solution that provided high-speed data processing, efficient cooling, and workload management. The factory also needed to guarantee system reliability, ensuring consistent uptime to prevent disruptions during peak workloads. Furthermore, deploying such an advanced AI infrastructure required expert validation, seamless integration, and ongoing remote management capabilities to monitor and optimize system performance efficiently.
Our solution
ASUS provides advanced hardware and software total solution to deliver a comprehensive and high-performance AI development environment. The facility utilizes ASUS ESC N8-E11 servers equipped with NVIDIA HGX H100 GPUs and powered by 5th Gen Intel® Xeon® Scalable processors. These capable servers are designed to handle complex AI workloads with high efficiency, offering advanced cooling systems, superior scalability and support for demanding AI tasks such as LLM training and generative AI. ASUS also provided tailored deployment and validation services to ensure the infrastructure integrated seamlessly into FPT’s AI factory.
The comprehensive AI solution provided by ASUS has enabled FPT’s AI factory to to deliver robust, scalable and efficient AI outcomes, fostering innovation and empowering businesses to harness AI’s potential.
Hardware performance: ASUS ESC N8-E11 servers offer offers a dedicated one-GPU-to-one-NIC topology and supports up to eight NICs for the highest throughput during compute-intensive workloads.
Cloud AI excellence: ASUS supports public and private clouds with AIHPC infrastructure, PaaS and AI Foundry Service (AFS), enabling model training, inferencing, pre-trained models and fine-tuning capabilities. Additionally, ASUS enhances remote server management with ASMB11-iKVM, which allows out-of-band control via WebGUI, IPMI and Redfish® API.
Intelligent server management: ASUS provides a comprehensive server-management solutions, allowing IT teams to remotely monitor and control servers even when systems are unresponsive and ACC streamlines infrastructure oversight by offering centralized remote monitoring, automated BIOS updates, diagnostics and security enhancements together enhance operational efficiency and security of infrastructure management.
Outcome
Optimized AI infrastructure for peak performance
ASUS ESC N8-E11 delivers exceptional performance, scalability and reliability, empowering FPT’s AI factory to handle the intensive computational demands of training and deploying large-scale AI models. The infrastructure supports high-performance GPUs, optimizes energy consumption, and ensures uninterrupted operations during peak workloads. The server’s performance aligns seamlessly with customer requirements and NVIDIA’s SuperPOD design standards, providing a robust foundation for future AI advancements.
Strategic AI advancement for global competitiveness
With the deployment of ASUS infrastructure solution, FPT is accelerating its vision to place Vietnam on the global AI map. The AI Factory has successfully integrated over 200 products into the Made by FPT ecosystem, including 30 AI-enabled applications and 11 ready-to-use products. Driven by the GenAI First strategy, this initiative enhances operational efficiency and extends AI capabilities to individuals, SMEs, enterprises and government organizations, solidifying FPT’s competitive edge in the AI industry.
