there's a pretty cool Vulkan LLM engine here for example: https://github.com/mlc...

		electroglyph on Feb 13, 2024 \| parent \| context \| favorite \| on: AMD funded a drop-in CUDA implementation built on ... there's a pretty cool Vulkan LLM engine here for example: https://github.com/mlc-ai/mlc-llm