You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A buffer pool was added in #108 to enable re-use of buffers for operator outputs and temporary tensors. This is now used by almost all operators and for most large temporary buffers, with one exception: prepacked matrix weights created by GemmExecutor::{prepack_a, prepack_b} are not allocated from the pool yet. They should be.
The text was updated successfully, but these errors were encountered:
Allocate and auto-return prepacked matrices to the shared pool. There is an
exception for the GRU op, because I'm expecting to revise its internals shortly
as part of #85.
Fixes#128
Allocate and auto-return prepacked matrices to the shared pool. There is an
exception for the GRU op, because I'm expecting to revise its internals shortly
as part of #85.
Fixes#128
Allocate and auto-return prepacked matrices to the shared pool. There is an
exception for the GRU op, because I'm expecting to revise its internals shortly
as part of #85.
Fixes#128
A buffer pool was added in #108 to enable re-use of buffers for operator outputs and temporary tensors. This is now used by almost all operators and for most large temporary buffers, with one exception: prepacked matrix weights created by
GemmExecutor::{prepack_a, prepack_b}
are not allocated from the pool yet. They should be.The text was updated successfully, but these errors were encountered: