Oswald_Hydrabot
Oswald_Hydrabot t1_jcpqshf wrote
Reply to comment by crazymonezyy in [P] nanoT5 - Inspired by Jonas Geiping's Cramming and Andrej Karpathy's nanoGPT, we fill the gap of a repository for pre-training T5-style "LLMs" under a limited budget in PyTorch by korec1234
Those are bad managers. I certainly have had these conversations and I left companies over their response until I found one that listened.
You have to try harder. You have to stop accepting short-sighted near term profit as "just how it is" or assuming that financial malpratice at scale is "good business", because if you do not and you don't keep trying, failure is inevitable. Corruption and corporate bailouts that take our tax revenue and cost us layoffs to pay for those mistakes are inevitable. Stop being complacent if you cannot accept putting in the effort to make what you know is right a reality.
I have been involved in those conversations at the highest levels in some of the largest companies in the world. More often than not I told them to either listen to the consulting that they PAID me for, or I will take my business somewhere else, and I did. If you don't suck at what you do then firing bad clients will not hurt you; in fact is it critical to your own growth in your career. You need to treat your employer as a client.
Oswald_Hydrabot t1_jcizf9y wrote
Reply to comment by crazymonezyy in [P] nanoT5 - Inspired by Jonas Geiping's Cramming and Andrej Karpathy's nanoGPT, we fill the gap of a repository for pre-training T5-style "LLMs" under a limited budget in PyTorch by korec1234
"We will use it only when nothing else can solve the problem", I believe is your answer.
There are solutions that cost less than GPT-4, and they don't require integration of a black box that is gatekept by a single provider. There is a significant amount of risk in integration of a product like GPT-4 as a dependency.
Oswald_Hydrabot t1_jci6kf3 wrote
Reply to [P] nanoT5 - Inspired by Jonas Geiping's Cramming and Andrej Karpathy's nanoGPT, we fill the gap of a repository for pre-training T5-style "LLMs" under a limited budget in PyTorch by korec1234
This is more interesting than GPT-4 to me, by a great deal. Thank you for sharing!
Optimization and ownership of your full product is important. This is how we combat being locked out of the gated community, providing tangible value through running code.
I am going to check it out this evening!
Oswald_Hydrabot t1_jci6a41 wrote
Reply to comment by currentscurrents in [P] nanoT5 - Inspired by Jonas Geiping's Cramming and Andrej Karpathy's nanoGPT, we fill the gap of a repository for pre-training T5-style "LLMs" under a limited budget in PyTorch by korec1234
You don't need a nuclear bomb to hunt elk.
This is a solution you can fully own on top of that.
It has value.
Oswald_Hydrabot t1_jd5d0h0 wrote
Reply to [Project] Machine Learning for Audio: A library for audio analysis, feature extraction, etc by Leo_D517
Very cool! I have been looking for a better toolkit for audio analysis, this looks great!