> They are doing things with $100 and 13B params that we struggle with at $10M a... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kccqzy on May 4, 2023 \| parent \| context \| favorite \| on: Google “We have no moat, and neither does OpenAI” > They are doing things with $100 and 13B params that we struggle with at $10M and 540B. Does this mean Bard took $10M to train and it has 540B parameters?

squishylicious on May 4, 2023 [–]

Bard is based on PaLM: https://ai.googleblog.com/2022/04/pathways-language-model-pa.... They haven't published training costs but estimates have been in the $10-20M range, so that seems reasonable.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact