As AMD, Intel, Tenstorrent, and other companies develop better hardware, more software developers will be inclined to design for these platforms, and Nvidia’s CUDA dominance could ease over time.

This seems a bit optimistic to me. CUDA is currently the de facto method of utilising a GPU’s power efficiently. This makes them an easy choice for anyone with serious compute power needs. The other manufacturers are fighting an uphill battle trying to create an alternative that won’t be used until it is definitively better.

This just seems like a catch 22 to me

I’ve used phind a few times and it’s pretty good. I’m not sure if it’s open source, though