3.6.1 #4662
wangzhaode
announced in
Announcements
3.6.1
#4662
Replies: 3 comments
|
这是来自QQ邮箱的自动回复邮件。邮件收到^_^
|
0 replies
|
既然mnn支持视频生成了,那aop为啥不支持 |
0 replies
|
Thank you for your work. You're awesome!!! |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
MNN 3.6.1 版本发布说明
发布日期: 2026年7月
📦 安装:
pip install mnn==3.6.1| PyPI📌 版本概述
MNN 3.6.1 版本聚焦于 Hexagon NPU 后端、Transformer C4 Fuse 全后端性能优化 与 稳定性修复 三大核心主题:
🚀 版本亮点
✨ 新功能
后端:Hexagon(新增)
skills/hexagon开发文档LLM / 推理加速
GPU 后端
CPU 后端
工具
-fa选项:新增 flash attention 开关(默认 1,启用 flash attention)🐛 缺陷修复
LLM / VLM
--chunk_size的问题GPU 后端
CPU 后端
框架 / 其它
📚 其他改进
📊 性能基准
相比 3.6.0(同设备、同量化配置,模型用 3.6.1 重新导出):
Hexagon NPU 后端性能
Qwen3-0.6B(4-bit 对称量化,block64,C4)在 SM8750(骁龙 8 Elite,Hexagon v79)上三后端对比:
Hexagon NPU 在 prefill 上优势显著(7.9×),decode 目前仍以 CPU 最优。Hexagon SDK 5.x 与 6.x 编译的 DSP skeleton 性能一致(差异 <2%,误差范围内)。
🙏 致谢
衷心感谢所有贡献者对本版本的宝贵贡献(按 GitHub login 列出):
-fa选项 ([Tools:Feature] llm_bench: add '-fa' meaning whether to use flash att… #4658)、Metal ATTENTION_C4 分支修复 ([Metal:Bugfix] prefill_qkv_tensor missing ATTENTION_C4 output branch #4654)、MPS Q4 全零权重修复 ([LLM:Bugfix] Fix silent all-zero Q4 weights when quantizing large ten… #4649)、Arm82 LinearAttention fp16 修复 ([CPU:Bugfix] Arm82 LinearAttention fp16: use fp32 accumulators #4634)、mmap 失败崩溃修复 ([Core:Bugfix] Fix crashes when mmap allocation fails across all backends #4630)MNN 3.6.1 Release Notes
Release Date: July 2026
📦 Install:
pip install mnn==3.6.1| PyPI📌 Overview
MNN 3.6.1 focuses on three core themes: Hexagon NPU Backend, Transformer C4 Fuse Optimization Across Backends, and Stability Fixes:
🚀 Highlights
✨ New Features
Backend: Hexagon (New)
skills/hexagondevelopment docsLLM / Inference Acceleration
GPU Backends
CPU Backend
Tools
-faOption: New flash attention toggle (default 1, flash attention enabled)🐛 Bug Fixes
LLM / VLM
--chunk_sizewhen generating QNN prefill IOGPU Backends
CPU Backend
Core / Misc
📚 Other Improvements
📊 Performance Benchmarks
Compared with 3.6.0 (same devices and quantization config, models re-exported with 3.6.1):
Hexagon NPU Backend Performance
Qwen3-0.6B (4-bit symmetric, block64, C4) on SM8750 (Snapdragon 8 Elite, Hexagon v79), three-backend comparison:
Hexagon NPU excels at prefill (7.9×); CPU remains fastest for decode. DSP skeletons built with Hexagon SDK 5.x and 6.x perform identically (<2% difference, within noise).
🙏 Acknowledgements
We sincerely thank all contributors for their valuable contributions to this release (listed by GitHub login):
-faoption ([Tools:Feature] llm_bench: add '-fa' meaning whether to use flash att… #4658), Metal ATTENTION_C4 branch fix ([Metal:Bugfix] prefill_qkv_tensor missing ATTENTION_C4 output branch #4654), MPS all-zero Q4 weights fix ([LLM:Bugfix] Fix silent all-zero Q4 weights when quantizing large ten… #4649), Arm82 LinearAttention fp16 fix ([CPU:Bugfix] Arm82 LinearAttention fp16: use fp32 accumulators #4634), mmap failure crash fix ([Core:Bugfix] Fix crashes when mmap allocation fails across all backends #4630)Full Changelog: 3.6.0...3.6.1
This discussion was created from the release 3.6.1.
All reactions