Bard is based on PaLM: https://ai.googleblog.com/2022/04/pathways-language-model-pa.... They haven't published training costs but estimates have been in the $10-20M range, so that seems reasonable.