Viewing a single comment thread. View all comments

visarga t1_isij2xr wrote

I'm wondering what is the minimum hardware to run this model, is this really the portable alternative of GPT-3?

10

cwhaley112 t1_ispnv6f wrote

If you mean gpu, then 20B parameters * 2 bytes (assuming fp16) = 40GB VRAM.

4