> To be fair if they released detailed instructions and datasets on how to rebuild llama

Where?

Books3 was famously one of the datasets used to train llama and it’s very illegal to put that together nowadays.

I believe the guy who wrote the script to build it got arrested