Add experimental support of cuQuantum #1400
Conversation
doichanj
requested review from
chriseclectic,
hhorii,
mtreinish and
vvilpas
as code owners
|
I added On-hold until 0.10 release is out |
|
@doichanj a release note is necessary. |
|
This probably should also wait for Aer 0.11 - it's a big new feature, and patch releases are usually for bugfixes. |
| if(cuStateVec_enable_){ | ||
| enable_batch_multi_shots_ = false; //cuStateVec does not support batch execution of multi-shots | ||
| parallel_shots_ = 1; //cuStateVec is currently not thread safe | ||
| return; |
There was a problem hiding this comment.
if cuStateVec_enable=True is configured in AerSimulator.run(), parallel_state_update_ is not set. This will produce performance regression if application accidientaly sets cuStateVec_enable with device='CPU'.
There was a problem hiding this comment.
Question: when enable_batch_multi_shots_=true would you create nShots copies of the statevector for parallelization? If so & IIUC, I think a proper "workaround" is to create multiple cuStateVec handles (or just retain and reuse a pool of handles at init time to reduce overhead) and use them in parallel.
IMHO though it's beyond a "workaround": even after we fix the thread safety issue, generally speaking it is still challenging for library handles to be shared by multiple host threads. For example, despite cuBLAS supports this usage pattern they explicitly recommend to not do so. Thus the handle pool approach is commonly seen in ML/DL frameworks.
There was a problem hiding this comment.
enable_batch_multi_shots_=true is not applicable for cuStateVec currently, because multiple state vectors are calculated in a single CUDA kernel and each state vector refers classical registers to handle branch operations, this is not implemented in cuStateVec.
Multiple cuStateVec handle is required when enable_batch_multi_shots_=false and shot level parallelization is required. In this case, state vectors are independently calculated using OpenMP threads. (Currently cuStateVec is not thread safe and we disable OpenMP parallelization)
There was a problem hiding this comment.
Thanks for explanation @doichanj. I understand better now. So once we fix thread safety we can unblock you for the shot-level parallelization.
| #'GPU_cuStateVec' is used only inside tests not available in Aer | ||
| #and this is converted to "device='GPU'" and option "cuStateVec_enalbe = True" is added | ||
| if cuStateVec: | ||
| data_args.append((method, 'GPU_cuStateVec')) |
There was a problem hiding this comment.
@chriseclectic could you review this change? This is a hack to minimize changes of tests for tests of cuStateVec option. cuStateVec is an option only for device=GPU. Current annotator supported_methods() requires tests to take two argument method and device. Adding new option cuStateVec_enable to all the tests is not productive, I believe.
|
I confirmed that no regressions will be happened with this PR. |
Summary
This is the experimental support for NVIDIA's cuQuantum Beta 2 (ver 0.1.0).
Details and comments
We can use cuStateVec APIs instead of Aer's GPU implementations by setting options at runtime (see CONTRIBUTING.md for details). cuStateVec is enabled when building with
CUSTATEVEC_ROOTwith the path to cuQuantum.By using cuStateVec, we can speed up x2 for large qubits (larger than 22 qubits) but Aer's implementation is still faster for smaller qubits.
Since cuQuantum is beta version, there are some limitations: