Nice! I wonder what is the hardware required to run qwen2.5vl locally. A 6gb 2cp... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		leodip 6 months ago \| parent \| context \| favorite \| on: Llama-Scan: Convert PDFs to Text W Local LLMs Nice! I wonder what is the hardware required to run qwen2.5vl locally. A 6gb 2cpu VPS can do?

mdaniel 6 months ago [–]

It does not appear that qwen2.5vl is one thing, so it would depend a great deal on the size you wish to use

Also, watch out, it seems the weights do not carry a libre license https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct/blob/main...

kaycey2022 6 months ago | [–]

What is a libre license and why is it important?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact