Skip to content
This repository has been archived by the owner on Dec 1, 2021. It is now read-only.

Smarter memory allocation and reuse for DLK runtime #473

Open
primenumber opened this issue Oct 1, 2019 · 2 comments
Open

Smarter memory allocation and reuse for DLK runtime #473

primenumber opened this issue Oct 1, 2019 · 2 comments

Comments

@primenumber
Copy link
Contributor

  • Reduce memory consumption
  • Erase useless memory copy
    In dlk runtime, buffer size are known in compile time, we can optimize memory usage and memory transfer.
@primenumber
Copy link
Contributor Author

Some operations require temporary buffer to compute.
In current implementation, temporary buffer are managed by global std::unique_ptr<T[]> to avoid memory allocation in inference time.
It prevent concurrent inference and increase memory consumption.
We should consider to manage these buffer in Network.

@primenumber
Copy link
Contributor Author

Temporary buffer is now allocated in Network::init except RunTCA.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant