Hacker Newsnew | past | comments | ask | show | jobs | submit | cheesehead's commentslogin

Nice work! I did something similar with a personal project a few months ago using an open source llm. Also, not sure if you know, there is an api you can use. https://github.com/HackerNews/API


Awesome, did not know about the HN api, nice!

What open source LLM did you use? Anything that would run on a CPU of a 5 year old MacBook Air (which I’m using as my home server)

Do you have the code for your project? Or maybe some features/ideas that you could share?

Thank you


I'm using https://github.com/ggerganov/llama.cpp and currently mistral 7b (on a m1 macbook pro). I'm sure with some prompt examples you can get pretty good results on a smaller model.

At the moment I don't have it open sourced due to it being part of a larger project that I'm working on that contains tailwindui licensed components.

A cool feature that I'm working on is creating a firefox plugin so you can save/index job postings from other sites and extract out meta information via an LLM. Very similar to this chrome plugin. https://chromewebstore.google.com/detail/huntr-job-search-tr...


Love the extension idea, definitely useful for tracking opportunities

Thank you for the perspective on running local LLMs

Do you think that saas or local LLMs will be the most popular in the next 5 years?


Hoping it's local :)


Hi I'm Patrick, long time lurker, first time poster. Looking for my next role. I'm passionate about building great products, coding, and learning new things. My current interests are in cloud, ebpf, code generation, observability, virtualization, k8s, and LLMs. I have experience with frontend/fullstack but would prefer to stay doing backend development. I've worn many hats in my career and have a wide range of experience. Feedback on the resume would be great to have as well!

Location: Salt Lake City, UT

Remote: Yes

Willing to relocate: Unlikely

Technologies: go, python, ml, elixir, k8s

Résumé/CV: https://drive.google.com/file/d/1ZmeiTaiOVypw6liBI_inNxE6RFD...

Email: developer.pjr.software.jobs@gmail.com


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: