What did you use for specs? 32G of memory is enough? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		belter on March 15, 2024 \| parent \| context \| favorite \| on: Show HN: Implementation of the "Self-Rewarding Lan... What did you use for specs? 32G of memory is enough?

gregschoeninger on March 15, 2024 [–]

We used an A10 with 24GB of VRAM, this was enough for PEFT on Mistral-7B

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact