Wouldn't it be better to unify around ChatML, for the sake of all future training data being consistent? I thought it was strange that they used <|im_start|> but not the rest of the ChatML syntax.
(There is always the possibility that they are using it, but the AI has hallucinated a slightly different syntax when repeating it)
Telling ChatGPT to "think it out loud" first before giving the final answer generally leads to better results than just telling it to answer right away. This is especially true in multi-step tasks where you keep adding to input.
Platform lock-in.
Interoperability would not only be more costly in terms of the work to design and agree on a common standard, but it'd also makes it easier to switch to a competitor.
Their prompt - https://old.reddit.com/r/bing/comments/11bd91j/release_of_th...
Wouldn't it be better to unify around ChatML, for the sake of all future training data being consistent? I thought it was strange that they used <|im_start|> but not the rest of the ChatML syntax.
(There is always the possibility that they are using it, but the AI has hallucinated a slightly different syntax when repeating it)