Description
The example calls unconditionally. On machines without a CUDA GPU, this raises an error before the model is even loaded.
Reproduction
Run on a CPU-only or Ascend NPU environment:
Expected
The script should detect the available device and fall back to CPU when CUDA is not present.
Proposed fix
Use to decide the target device.
I have submitted PR #43 with the fix.
Description
The example calls unconditionally. On machines without a CUDA GPU, this raises an error before the model is even loaded.
Reproduction
Run on a CPU-only or Ascend NPU environment:
Expected
The script should detect the available device and fall back to CPU when CUDA is not present.
Proposed fix
Use to decide the target device.
I have submitted PR #43 with the fix.