Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be.

Train an LLM with text books and other legal books, you do not need to train it on pop culture to make it intelligent.

For face generations you might need to be more creative, you should not need milions of images stolen from social media to train your model.

But makes sense that tech giants do not want to share their data set and be transparent about stuff.



> Train an LLM with text books and other legal books

Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.


>Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.

There are books that are out of copyright, and also free books.


If LLM organizations are free to throw billions at hardware they can spare a paltry €50 million for 10 million e-books though, right?


€50 million is about 130% of OpenEuroLLM's budget. And I'm very sceptical publishers will give training licenses for €5 per book. Especially as OpenEuroLLM intends to have an openly available training set.

Copyright sucks.


Open AI fed their original model Anna’s archive for breakfast.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: