Will it distribute training across multiple GFX cards? I have a 4x 2080Ti box I ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		sbrother on May 4, 2023 \| parent \| context \| favorite \| on: Google “We have no moat, and neither does OpenAI” Will it distribute training across multiple GFX cards? I have a 4x 2080Ti box I would love to be able to use for this sort of thing.

eulers_secret on May 4, 2023 [–]

Not for training with the webui: https://github.com/oobabooga/text-generation-webui/issues/11...

It does seem to work using alpca-lora directly, though.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact