What do the tokens for an image even look like? I understand that tokens for tex... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		IshKebab on Feb 21, 2024 \| parent \| context \| favorite \| on: The killer app of Gemini Pro 1.5 is using video as... What do the tokens for an image even look like? I understand that tokens for text are just fragments of text... but that obviously doesn't make sense for images.

bonoboTP on Feb 21, 2024 [–]

The image is subdivided by a grid and the resulting patches are fed through a linear encoder to get the token embeddings.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact