Technical Evolution and Production Deployment of Xiaohongshu’s Native Engine - Xiuli Wei
Автор: VeloxCon
Загружено: 2026-01-02
Просмотров: 5
Описание:
Xiaohongshu’s Native Engine is built upon the Gluten and Velox technology frameworks, leveraging vectorized execution to accelerate data processing and computation. By integrating the Native Engine into the Apache Spark ecosystem, Xiaohongshu has achieved substantial performance gains and reductions in resource consumption.
Through continuous technical iteration and optimization—including enhancements to query execution planning, I/O efficiency, and other core components—the Native Engine has achieved up to a 1.45× performance boost compared to the original Spark engine. It is now being fully deployed in production across key business domains such as AI Platform, Search & Recommendation, Applied Algorithm Platforms, and Offline Data Warehousing, resulting in an overall 30%+ reduction in computing resource costs and delivering a more efficient, scalable, and high-performance data processing infrastructure.
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке:
