Submitted by floppy_llama t3_1266d02 in MachineLearning
dreaming_geometry t1_je7wweh wrote
I've thinking about trying something like this. Everything is moving so fast now in ml, I feel like nearly every new idea I have gets published before I even find the time to get started.
9182763498761234 t1_je8wfs4 wrote
Work in a niche field instead! There are hundreds of smaller topics in ML that are yet unexplored and only a couple people working on it. I’m working on one of those and it is awesome. The field is slowly progressing but slowly enough that I can make a valuable contribution without getting scooped all the time.
silva_p t1_je9aw63 wrote
Can you share your niche?
saintshing t1_je9e5q1 wrote
Natural language processing for cats and dogs
currentscurrents t1_jean0il wrote
Other researchers are working on an LLM for whales.
Looks feasible to me, whale calls are no more alien to the computer than English is. The hard part is collecting enough data.
DigThatData t1_jeb49b8 wrote
this is probably not a concern for whale vocalizations, but an issue for attempting to decode animal communications generally via LLMs is that they're probably communicating as much information (if not more) non-vocally. for example, if we wanted to train an LLM to "understand" dog communication, it'd probably be more important to provide it with signals corresponding to changes in body and face pose than vocalizations. interesting stuff in any event.
currentscurrents t1_jeb4shv wrote
Yeah, I think that's why they're starting with whales - they're an easy subject since their vocalizations can be heard through the water from miles away. They also seem to have a fairly complex vocal language, unlike for example songbirds with memorized mating calls.
Koda_20 t1_jecddbs wrote
I feel like they are starting with whales because it generates more publicity because Nemo lol
They are probably not but I thought it was funny
tvetus t1_jebkax4 wrote
Did you see the paper on voice to voice for talking with whales?
currentscurrents t1_jebm09t wrote
No, do you have a link?
saintshing t1_je9okpn wrote
Apparently some people managed to reconstruct images from brain activitiy using stable diffusion technique. I wonder how it would apply to animals.
9182763498761234 t1_je9bhu7 wrote
I’ll dm you
DigThatData t1_je8pm87 wrote
I've decided to just lean into it and am literally just giving my ideas away. https://github.com/dmarx/bench-warmers
TheAdvisorZabeth t1_je90pzt wrote
Hi!~ <3
umm... I am just an uneducated idiot, but I've been having a lot of ideas lately and I think some of them might be real Science too.
But I have no credentials or anyone to discuss ideas with or to help fact-check me about stuff I don't have nearly the Time to Learn.
You seem like a kind person, (and like you might have more Time than Puzzles with which to fruitfully spend that Time on.), do you think you might care to to chat about my ideas? Or possibly offer any sincere advice that is a bit more useful to an autistic puppy than: "That is not a real Theory."?
I never used Tumblr before, but Neil Gaiman made a point to explicitly state that he hangs out there a lot; and since there's no living Author who I have more respect for, I recently began posting my ideas there.
From my perspective I am writing 100% Non-Fiction.
From my perspective I am just a very strange Harmless-Holistic-Aberrant; who managed to dumb-luck their way into figuring out how to gain "Coherent-Root-Access-To-My-Own-Brain".
I am being fully sincere.
I would just ask that if you (or anyone else) thinks that I am just being a stupid Fool, that you please tell me gently, I am pretty sensitive.
Love ya either way!~
Keep on doin your awesome Science stuff no matter what! Cause it's just the coolest thing! (hehe, I wonder if they got that joke?)
hugs!~~~
bye!^!^(for, now...)
OH! I almost forgot to actually Hand You One End Of The Thread lol~
jan_antu t1_je9me91 wrote
I read a few of your posts. It seems like you're having a break from reality. I'm a scientist but not a psychologist; I think you should speak with one, or a psychiatrist. Things may be fine for now but you don't want to end up hurting yourself or someone else by accident as this progresses.
3z3ki3l t1_je9qt86 wrote
If this isn’t copypasta, you’re having a manic episode. See a doctor, please.
seedbrage t1_je9b2zz wrote
What
DigThatData t1_jea10sg wrote
yeah... i hate to say it but I agree with the other commenters. If you have access to medical support, I strongly recommend you get seen by a physician. I'm concerned you might be experiencing some kind of psychiatric episode. If you're skeptical that's fine, you can even tell them that.
> "Strangers on the internet expressed concern that I might be experiencing a psychiatric episode of some kind. I don't see it, but enough people suggested it that I felt it merited a professional opinion, so here I am."
Appropriate-Crab-379 t1_jefz9og wrote
There’s a ton of noise, not all techniques are worth knowing because in a few years a bunch of these concepts will be outdone by something new.
-_1_2_3_- t1_je8p5xx wrote
They are using gpt-4 to accelerate their work
idontcareaboutthenam t1_je8rz5a wrote
Can you elaborate?
drizel t1_je8v9cj wrote
GPT-4 can parse millions of papers and help uncover new optimizations or other improvements much faster than without it. Not only that but you can brainstorm ideas with it.
Swolnerman t1_jead4wo wrote
How can it do that with a context window of 32k?
On top of that, I don’t think gpt4 can make informed decisions on picking between academic research papers as of yet
Viewing a single comment thread. View all comments