[OpenCL] Save kernel cache & tuned params immediatelly #6440
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…oop finish. test=develop
|
Thanks for your contribution! |
xiebaiyuan
reviewed
Jul 9, 2021
xiebaiyuan
approved these changes
Jul 18, 2021
zhaoyang-star
added a commit
to zhaoyang-star/Paddle-Lite
that referenced
this pull request
Jul 22, 2021
…addlePaddle#6440) * move save to destructor of RuntimeProgram * fix multi models executed in sequential way in one thread * support multi-thread executation
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
【问题1】
单线程单个模型运行时，在 APP 环境下无法保存 cache 文件。
【原因分析】
CLRuntime全局单例类的析构函数中。在 adb shell 环境下，CLRuntime单例类的析构函数在程序结束时一定会被调用到，因此可以正常触发保存文件操作；CLRuntime全局单例类的析构函数并不会被执行到，因此无法触发保存文件操作。【解决方法】
将保存文件操作提前，放在
RuntimeProgram类的析构函数内执行，确保 APP 退出时一定执行保存文件操作。【问题2】
在一个线程内，串行执行 2 个模型，在 adb shell 环境下只保存了第1个模型对应的 cache 文件，无法保存第2个模型对应的 cache 文件。
【原因分析】
在
SetBinaryPathName函数中，对kernel_path_name_变量是直接通过push_back赋值，然后在GetBinaryPathName函数中，通过at(0)/at(1)方法获得的永远都是第一个path/name。因此需要在push_back前clear数据。【解决方法】
在
push_back前执行clear。【问题3】
在N个线程下，每个线程有自己的 predictor，并行执行N个模型，在 adb shell 环境下无法正常保存N个模型的对应的N个 cache file。
【原因分析】
CLRuntime是一个单例类，因此该类的成员变量并不是线程安全的，也就会出现binary_path_name_只保存了其中一个模型对应的设置。【解决方法】
通过定义一个
thread_local的实例，实现该实例在每个线程内是唯一的。