Sure, but the real value here is the 65B. Can you have multiple GPUs on colab? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		koheripbal on March 4, 2023 \| parent \| context \| favorite \| on: Facebook LLAMA is being openly distributed via tor... Sure, but the real value here is the 65B. Can you have multiple GPUs on colab?

arthurcolle on March 4, 2023 [–]

I can't even get the 13B on colab to do inference with a very small sequence length.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact