Submitted by gokulPRO t3_11pyvb3 in deeplearning
ats678 t1_jc4lem7 wrote
In the same fashion as LLM, I think Large Vision Models and multimodal intersections with LLM are the next big thing.
Apart from that, I think things such as model quantisation and model distillation are going to become extremely relevant in the short term. If the trend of making models larger will keep running at this pace, it will be necessary to find solutions to run them without using a ridiculous amount of resources. In particular I can see people pre-train large multimodal models and then distill them for specific tasks
Viewing a single comment thread. View all comments