CUDA

SP1 supports CUDA acceleration, which can provide dramatically better latency and cost performance compared to using the CPU prover, even with AVX acceleration.

Software Requirements

Please make sure you have the following installed before using the CUDA prover:

• CUDA 12
• CUDA Container Toolkit

Hardware Requirements

• CPU: We recommend having at least 8 CPU cores with 32GB of RAM available to fully utilize the GPU.
• GPU: 24GB or more for core/compressed proofs, 40GB or more for shrink/wrap proofs

Usage

To use the CUDA prover, you can compile the sp1-sdk crate with the cuda feature enabled. You can use the normal methods on the ProverClient to generate proofs.