A float16 is 2 bytes. 7B \* 2 bytes = 14GB. I can't say if that's an accurate nu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		a_t48 8 months ago \| parent \| context \| favorite \| on: Bagel: Open-source unified multimodal model A float16 is 2 bytes. 7B * 2 bytes = 14GB. I can't say if that's an accurate number, but that's almost certainly how tonii141 calculated it.

sfphoton 8 months ago [–]

Oh, so FP16 means FloatingPoint16? I'm glad to learn something today, thanks!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact