→ Back to Home
AI Models

DeepX DX-M2 Chip Promises Affordable Edge AI for Generative Models

South Korean startup DeepX has announced the tape-out of its DX-M2, a second-generation edge AI chip fabricated using Samsung Electronics' 2nm process. This new chip is designed to run generative AI models locally, consuming approximately 5 watts of power and aiming for a price point under $50 per chip. Mass production is anticipated for fall 2027, with initial silicon expected in March 2027 and customer samples in Q2 2027. This development is significant for the AI landscape, particularly for cloud and DevOps practitioners. The ability to run complex generative AI models directly on edge devices at such low power and cost fundamentally changes deployment strategies. It democratizes access to advanced AI capabilities, moving processing closer to the data source and reducing reliance on centralized cloud infrastructure. This is especially impactful for applications requiring real-time inference, privacy, or operation in environments with limited connectivity. Industries such as robotics, autonomous vehicles, industrial automation, and consumer AI devices stand to benefit immensely, as it enables more responsive, secure, and cost-effective AI solutions. The DX-M2's focus on memory bandwidth, tripling from 50GB/s to 150GB/s compared to its predecessor, and its use of custom Samsung LPDDR5X processing-in-memory (PIM) technology, aligns with the broader trend of optimizing hardware for AI workloads. As AI models grow in complexity, memory access often becomes a bottleneck, and DeepX's approach directly addresses this. The ability to handle mixture-of-experts models with up to 100 billion total parameters, decoding at 10 to 30 tokens per second within the power budget, positions it as a strong contender for on-device generative AI. This mirrors the industry's push towards more efficient and specialized hardware, moving beyond general-purpose GPUs for specific AI tasks. In practice, this means developers will have more flexibility in designing AI-powered products. The sub-$50 price point, reportedly a quarter of rival edge accelerators, could reset the bill of materials for many AI-enabled devices, making previously cost-prohibitive applications feasible. Practitioners should closely watch the availability and performance benchmarks of the DX-M2, as it could become a foundational component for the next generation of edge AI. The trade-off between power consumption, cost, and the ability to run large models locally will be a critical consideration for architects. This also signals a growing need for DevOps methodologies tailored to edge deployments, including efficient model optimization, remote management, and secure updates for distributed AI systems.
#edge ai#generative ai#ai hardware#deepx#samsung#ai models
Read original source