It's a bit amusing how people treat chinchilla scaling laws as a law of nature, ...

		cypress66 on Sept 4, 2023 \| parent \| context \| favorite \| on: TinyLlama project aims to pretrain a 1.1B Llama mo... It's a bit amusing how people treat chinchilla scaling laws as a law of nature, when it's just about a certain architecture and dataset.