yeah, this has been my experience -- i'm working with a lot of custom data, and even though some of it is CV adjacent, it doesn't fit exactly (e.g., ~40 channels instead of 3 like RGB). would be nice, especially for research prposes, to have something to plug and play that just worked.

What are some good tools for data pipelines that scale well? I'm locked into Jax/Flax for work, but would like to disconnect from TensorFlow to the greatest extent possible. I was looking at the huggingface dataloaders, does anyone have experience with those?

How do flax/haiku (for ML with Jax) compare? I've seen people use both, but there seem to be a lot more people using flax. I've alwyas preferred Haiku, but last tried Flax 2 years ago -- curious if things have changed?