CUDA works best when the application workset is able to be run, concurrently, on the many processing cores that make up a present-generation GPU - and this is where we can see a 10x improvement ...

According to reliable leaker Greymon55, Nvidia's enthusiast-grade RTX 4090 GPU will come equipped with 18,432 CUDA cores, which is 7,936 more than the current generation RTX 3090.

NVIDIA's new RTX PRO 6000 Blackwell workstation GPU details: GB202 GPU, 24064 CUDA cores, 752 Tensor Cores, 188 RT Cores, 96GB GDDR7 with ECC, 600W power.

NVIDIA GeForce RTX 5090 details so far: 20,000+ CUDA cores: With a rumored 21,760 CUDA cores, we're looking at a big upgrade over the 16,384 inside of the RTX 4090.

With an astounding 24,576 CUDA cores, this suggests that it has received an impressive upgrade from the 18,432 CUDA cores found in the AD102 chip, which currently drives Nvidia's flagship RTX 4090.

The upcoming Nvidia GeForce RTX 5090 GPU could have 5,000 more CUDA cores than last generation with a 600 W default TGP.

Rumors surrounding NVIDIA's upcoming Ampere GPU keep swirling, the latest of which points to a full version of the GPU as having 8,192 CUDA cores and 32GB of HBM2e memory.