Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PPQ已经支持了不少后端推理框架(TensorRT,ncnn,mnn等），这些后端的量化规格细节都是怎么获取的呢？现在PPQ与后端量化推理可以完全对齐吗？ #561

Open
666DZY666 opened this issue May 15, 2024 · 1 comment
Open

PPQ已经支持了不少后端推理框架(TensorRT,ncnn,mnn等），这些后端的量化规格细节都是怎么获取的呢？现在PPQ与后端量化推理可以完全对齐吗？ #561

666DZY666 opened this issue May 15, 2024 · 1 comment

Comments

@666DZY666
Copy link

No description provided.

@Jzz24
Copy link
Collaborator

Jzz24 commented Nov 5, 2024

trt的话，最新的文档有详细描述量化细节，其他黑盒平台，ppq是按照谷歌白皮书标准进行concat/add量化模拟，我们只能力求对齐量化融合方式，置于算子的比特对齐，这个做不到

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@666DZY666 @Jzz24