Advantech Introduces GenAI Studio to Edge AI SDK Empowering On-premises LLM Development for Edge AI Innovations
1/21/2025

Taipei, January 21, 2025 – Advantech (TWSE: 2395), a leading provider of AIoT platforms and services, announces a new software offering - GenAI Studio for the Advantech Edge AI SDK, addressing the growing demand for cost-effective, on-premises large language model (LLM) solutions. This initiative aims to make LLM adoption more accessible for developers and small- to medium-sized businesses (SMBs) by significantly reducing the reliance on GPUs, thereby lowering costs and enabling broader utilization of generative AI technologies.
Accelerating AI Development to Address Industry Challenges
As one of the Advantech Edge AI SDK software offerings, GenAI Studio addresses industry pain points, such as reducing factory operator wait times for critical information and easing the documentation workload of healthcare professionals. Its no-code, cost-effective platform streamlines LLM adoption, enabling businesses to deploy AI solutions quickly and efficiently, improving productivity and operational efficiency. Built for the Advantech Edge AI SDK, GenAI Studio leverages a versatile LLM platform with exceptional integration capabilities for both local and cloud-based LLMs, including OpenAI, Gemini, Anthropic, and Ollama. It also introduces full-parameter fine-tuning functionality, optimized for environments with limited GPU resources, enabling broader accessibility and performance enhancements.
The GenAI Studio offers a comprehensive suite of tools for LLM development:
- Integrated Fine-Tuning and Inference Services: GenAI Studio combines fine-tuning and inference capabilities to maximize hardware utilization, enabling more flexible and efficient allocation of resources.
- Advanced GPU Resource Management and Task Scheduling: These features enable users to optimize AI hardware performance, improving the cost-effectiveness of high-value equipment.
Empowering AI Innovation with Advantech’s GenAI Studio and Edge AI Server
To complement GenAI Studio, Advantech's AIR-520 edge AI server provides a robust hardware platform equipped with NVIDIA RTX GPUs and Phison AI SSDs. This integration delivers reliable, high-efficiency computing capabilities designed to meet the demands of AI applications across industries such as manufacturing, healthcare, and retail.
Advantech Edge AI SDK: Streamlining Workflows from Model Fine-Tuning to Deployment
The Advantech Edge AI SDK is a fully integrated platform designed for seamless edge AI development. With pre-configured hardware and optimally tuned software, it delivers a plug-and-play experience enables cost-effective LLM customization, seamless toolkit compatibility, and effortless management of large-scale edge deployments. Designed with reliability, scalability, and user-friendliness in mind, the Advantech Edge AI SDK simplifies the path to AI innovation. It now includes three core components:
- GenAI Studio: Facilitates cost-effective creation, evaluation, and integration of custom LLMs on-premises.
- Inference Kit: Enables rapid optimization and assessment of efficient AI runtimes compatible with embedded operating systems.
- Orchestration Platform: Provides efficient management of AI model and application updates across large-scale edge deployments, integrating MLOps for streamlined operations.