Arm: Open-Source Optimization Tools for Accelerated AI Inference

Описание: Presented by Anton Kachatkou, Principal Software Engineer, Arm

Arm NPUs deliver high throughput and efficiency in AI applications on the edge. They provide significant advantage in power, performance, and area over conventional CPUs and GPUs for INT8 inferences out-of-the-box. However, further performance improvements can be unlocked by fine-tuning neural network models to take advantage of the underlying hardware architecture. This presentation will describe the recent developments in open-source machine learning tools that enable such optimizations and explore how various techniques can be combined to achieve the optimal balance between model accuracy and inference performance.

The Linley Spring Processor Conference featured technical presentations on chips and IP for AI applications, embedded, data center, automotive, IoT, and communications. The conference also covered new CPU architectures, networking, memory, security, SoC design, AI training, and other processor-related topics.

For more info on the Linley Spring Processor Conference 2021 you can visit our proceedings page:
https://www.linleygroup.com/events/ev...

If you enjoyed this video, be sure to also check out:

"Keynote: The Next Generation of AI Processors - Linley Gwennap, The Linley Group"
   • Keynote: The Next Generation of AI Process...  

"Tenstorrent: Neurons, NAND Gates, or Networks: Choosing an AI Compute Substrate"
   • Tenstorrent: Neurons, NAND Gates, or Netwo...  

"Groq Rocks Neural Networks: The Architecture Story"
   • Groq Rocks Neural Networks: The Architectu...  

"Achronix: Massive Edge Computing Opportunity and the Fourth FPGA Wave"
   • Achronix: Massive Edge Computing Opportuni...