Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[sparse_conv] add semi-structured sparse #8063

Merged
merged 19 commits into from
Jan 6, 2022
Merged

[sparse_conv] add semi-structured sparse #8063

merged 19 commits into from
Jan 6, 2022

Conversation

hcms1994
Copy link
Contributor

@hcms1994 hcms1994 commented Dec 22, 2021 •
edited
Loading

添加半结构化稀疏推理功能：
与之前合入的非结构化稀疏计算类似，半结构化稀疏相比非结构化稀疏在mbvnet模型上性能提升5%~30%，参考http://wiki.baidu.com/pages/viewpage.action?pageId=1689087861；

主要更新：

  • 新增sparse_semi_conv_impl.cc和sparse_semi_conv_impl.h文件，里面包含半结构化armv8 kernel的实现和armv7 kernel的实现；
  • sparse_conv_detect_pass加入稀疏模式判断，flag_semi=1，表示半结构化稀疏；flag_semi=0，走非结构化稀疏计算；

@paddle-bot-old
Copy link

Thanks for your contribution!

@PaddlePaddle PaddlePaddle locked as off-topic and limited conversation to collaborators Dec 30, 2021
@PaddlePaddle PaddlePaddle unlocked this conversation Dec 30, 2021
chenjiaoAngel
chenjiaoAngel reviewed Jan 6, 2022
View reviewed changes
Copy link
Collaborator

@chenjiaoAngel chenjiaoAngel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

建议FP32 和 int8分两个文件实现，一个文件的代码太长了
如果V8 和 V7 非汇编部分内容相似，建议合并实现
减少代码量

chenjiaoAngel
chenjiaoAngel reviewed Jan 6, 2022
View reviewed changes
Copy link
Collaborator

@chenjiaoAngel chenjiaoAngel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

添加单测测试文件

@chenjiaoAngel
Copy link
Collaborator

下个PR 补齐单测，建议将FP32 和 Int8 实现分两个文件添加，减少CC 代码长度

chenjiaoAngel
chenjiaoAngel approved these changes Jan 6, 2022
View reviewed changes
Copy link
Collaborator

@chenjiaoAngel chenjiaoAngel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@chenjiaoAngel chenjiaoAngel merged commit 678dec8 into PaddlePaddle:develop Jan 6, 2022
WeiLi233 pushed a commit to WeiLi233/Paddle-Lite that referenced this pull request Mar 29, 2022
@hcms1994 @WeiLi233
[sparse_conv] add semi-structured sparse (PaddlePaddle#8063)
bd221c0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@chenjiaoAngel chenjiaoAngel chenjiaoAngel approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@hcms1994 @chenjiaoAngel