NPU / AI accelerator with emphasis in LLM

Skymizer EdgeThought is compatible with Hugging Face and Nvidia. It supports most cutting-edge LLMs, including the newest Llama3. With expertise in software-hardware co-design, EdgeThought can leverage the high bandwidth of specialty DRAM to run a Llama3 8B at up to 200 tokens per second on just 4GB of memory.

• 查看 NPU / AI accelerator with emphasis in LLM 完整数据手册
• 联系 NPU / AI accelerator with emphasis in LLM 供应商