Viewing a single comment thread. View all comments

moist_buckets t1_iw5g8j3 wrote

I’ve never used a pre trained network for anything but my projects are applied to astrophysics which has some very different requirements than NLP or image classification

21

cautioushedonist OP t1_iw5uajx wrote

Astrophysics is an interesting use-case!

Can you share with us what the data looks like? Is it structured, tabular data?

6

moist_buckets t1_iw7ryet wrote

My latest project is modeling irregularly sampled multivariate time series using neural differential equations. We want to both reconstruct the time series and also do parameter estimation. The architecture is a variational auto encoder where the decoder is the neural differential equation.

3

HallowedAntiquity t1_iw8917k wrote

This sounds cool. I’m a physicist with an interest in ML—would you happen to have a link to a paper?

1

Kurohagane t1_iw6dgck wrote

That sounds cool, what kind of work do you do?

1

moist_buckets t1_iw7s24x wrote

I mainly research quasars (supermassive black holes at the center of galaxies)

1

wavyje t1_iw6o0hp wrote

How did you get into the astrophysics niche? I really would like to in the near future.

1

moist_buckets t1_iw7rdde wrote

I’m doing a PhD in it. That would be the most straightforward way. I’m not sure how feasible it is without a PhD.

2

DigThatData t1_iw7r5ou wrote

this is interesting to me and it sounds like there's probably an opportunity here to develop some pre-trained models specifically to support astrophysicists, especially with JWST hitting the scene.

would you be interested in connecting to discuss the potential opportunity here? just because there aren't currently any 'foundation models' relevant to your work doesn't mean there couldn't be.

1

moist_buckets t1_iw7sjwh wrote

I’m in the process of building pre-trained models to apply to different astronomical surveys. We almost exclusively train on simulated data.

1