500 million parameters seems like a lot, are there not duplication or redundanci...

		peter_retief on Oct 7, 2021 \| parent \| context \| favorite \| on: How to train large deep learning models as a start... 500 million parameters seems like a lot, are there not duplication or redundancies that can reduce the parameters. One could also use batches of data. Seems very expensive!