One thing I wonder is why no one has made a fork of PyTorch yet that removes all the API surface that doesn't produce GPU friendly code. Make dtype and device arg mandatory without defaults, remove in place operations that trigger a CPU sync, etc. This would increase confidence that written code will run on the GPU and pass torch.export() on the first try.
https://docs.jax.dev/en/latest/notebooks/Common_Gotchas_in_J...
Try and compile the stack from source and you'll find out why nobody is making forks with small divergences.
I'm curious to hear about your work geometric optics with PyTorch. May I ask you to share some examples of something you are working on right now?
I work on one of the projects in the list, need to update a link to the project, as old one is not actual anymore. And unclear how to do it => at least with respect to my project Albumentations, the landscape is outdated :(
--- Also, added the project to the Pytorch Ecosystem many years back, but if you ask me about practical value of being the part of the Ecosystem, I would not be able to tell you anything useful.
I also thought that Jax would in turn take over after PyTorch but it never seemed to quite take off (still in use though from what I can tell).
But there are absolutely pain points. In particular, especially for weaker programmers (common in academia), it's quite easy to write bad JAX. The functional programming and stateless paradigms require a little more thinking ahead. This is particularly tough when you're doing research and you're, in real time, finding out what's ahead!
[dead]
If you file an issue here, I think it would work to update things:
Submitted 3 weeks ago: https://github.com/pytorch-fdn/ecosystem/issues/67
Did it ever? PyTorch always seemed more popular to me, unless you were around Google people, then obviously everything was Tensorflow. But like many Google projects, I never got the impression it was as ubiquitous as PyTorch out in the community outside of Google. Maybe around 2018-2019 it felt like Tensorflow would become more popular than PyTorch eventually, but it never seemed to actually happen.
[dead]