but you cant prove it, can you? you just assume the output id novel because you cant find it easily.

You can literally make up a language yourself and get ChatGPT to talk in it. Sure I can't prove that I didn't just make up a language that someone in the trainingset also made up exactly the same way. But that just seems incredibly unlikely.