Hacker Newsnew | past | comments | ask | show | jobs | submit | TheArcane's commentslogin

chat.qwenlm.ai has quickly risen to the preferred choice for all my LLM needs. As accurate as Deepseek v3, but without the server issues.

This makes it even better!


There is so many options, if you ever wonder which use case every option has, go to your profile (bottom left), click on it, go to settings, select the "model" option and there you have explanation for every model and its use case.

They also show what the context length is for every model.


> Don't have to expose my home IP address and open a port for the world to start banging on

Is that really an issue if all you're exposing is the VPN port? Wireguard for instance has industrial-grade encryption. Even open port 51820 should be fine


With wireguard in particular, you're probably not running much risk, as wireguard runs over UDP, and as long as you're not connecting with a correct (recognized) key, it will not even generate a response, so a potential attacker has no way of knowing for sure that wireguard is running on a given port.


I mean, probably not. But I like the idea of keeping everything closed anyways.


Bit of a waste to host this locally and still need an openai api key. This would be great with Ollama


And they did all this under a GPU embargo? We're witnessing a Cuba moment.


Sorry what's a Cuba moment?


I'm confused as to how you haven't found R1 to be much better. My experience has been exactly like that of the OP's


What type of prompts were you feeding it? My limited understanding is that reasoning models will outperform LLMs like GPT-4/Claude at certain tasks but not others. Prompts that have answers that are more fuzzy and less deterministic (ie. soft sciences) will see reasoning models underperform because their training revolves around RL with rewards.


This has the same energy as labelling any critique of Israel anti-semitic


Our problem isn't with the critiques of Israel, it's with the fact that the people critiquing Israel are almost universally singling Israel out for critique.


My overwhelming experience is that people who are critical of Israel's actions in Palestine are also critical of Russia's actions in Ukraine and, back in the day, were critical if the US's actions in Iraq. This comes from a generally anti-war (or anti-invasion/occupation) political philosophy.

There are also a lot of people in the Republican Party who go the exact opposite way: They support Israel's actions and Russia's actions, and they were also in favor of the US's invasion of Iraq (though they shut up about that now). They have a very hawkish political philosophy.

Then there is a third group of people I've identified, who confuse me: they oppose Russia's actions in Ukraine, but they support Israel's actions in Palestine. (I do not know what their opinions were in Iraq because this is a group of people I have only encountered online, not in person.) I do not understand their political philosophy at all because it is seemingly self-contradictory; most of my attempts to understand it suggest that it is not really a philosophy so much, but more about nationalism or racism — they like Ukraine more than they like Russia, and they like Israel more than they like Palestine, and that's all the thought they put into it.


The people critiquing Israel are almost universally singling Israel out for critique.

They're not, of course.

But labeling them as such is one of the myriad ways by which criticism of Israel gets automatically branded as you-know-what.


I love the "of course" you threw in. Do please try to appreciate the emotional toll of having non-Jews out there all helpfully informing us Jews what is, and isn't, antisemitism. It must be nice not having to endure that kind of thing in your daily life, to say nothing of having to bring my children past armed guards to get into synagogue.


Do please try to appreciate the emotional toll of having non-Jews out there all helpfully informing us Jews what is, and isn't, antisemitism.

I have no idea what your essential attributes are. Nor do you have any idea as to mine. And I'm not telling you what to think about anything.

This thread is getting far from the original topic. Recommend we both close shop here, and move on.


I wonder if you ever listen to the many, many, many Jews who state that criticism of Israel is not 'antisemitism' and that blowback from the state violence and the intensely evil persecution & genocide of the Palestinian people perpetrated by Zionist Israel over more than 70 years now is the single biggest contributor towards them ever feeling 'unsafe' as Jews?

Again, there are many, many, many such Jewish voices that have emphatically dismissed the format of your attempted victimisation play here.


I wonder if you have any idea what the term "tokenization" means.


Is the startup boom in the room with us?


Never address the elephant directly.


The best strategic decision Apple has made in the last 15 years is to vertically integrate and build their own processors.

M-series is so far ahead of the game than an air-cooled M4 has better single-core performance than the best desktop PC chip money can buy. Incredible.


I don't understand why the non-Apple world has been so slow to copy Apple here. Are there any Windows or Linux laptops that match even the oldest M1 machines in battery life and performance?

I get that Apple has an advantage over companies like Dell and Lenovo in that they also build the OS but then there are Linux computer companies that have the source for everything and their machines are usually even worse from a performance / watt perspective.


The other CPU catch back after several months, the Apple Silicon is a good marketing prowess, the reality is that Apple CPUs wins because they are the first on to be produced on a new lithography node, because Apple can book a larger quantity than anyone else. When the other CPU manufacturer produce CPUs on the same CPU node, the performance is matched.

Here Jim Keller explain why CPU architecture doesn't matter a lot in performance now: https://www.anandtech.com/show/16762/an-anandtech-interview-...


CPU architecture probably doesn't matter.

But then I'm back to my original question: where are the Linux or Windows machines with great battery life and good performance. Is there anything like what Apple sells at Walmart: a 13.3" MacBook Air with the M1 chip, retina display, and 8 GB of RAM for $700. This is a very old machine at this point and still very hard to beat.


He does talk about why Apple is doing so well. Architecture, but Apple has IC process, top-level designers, a wide well balanced design and RAM bandwidth advantages.


I'm saying all this as a frustrated ThinkPad buyer. It's been 3.5 years since the first M1 machines went on the market and I still can't buy a ThinkPad as good as the Apple computers of that generation. I have to remember to power off completely before putting my ThinkPad in my bag otherwise I will have a very hot laptop, fans at full, with 50% battery remaining by the time I get to work.

Sometimes it feels like Apple is the only company even trying. It sucks.


Is it still true? My Ryzen desktop is a lot faster than my M1 Mini. A laptop Ryzen won't be as fast as my desktop, but it should be close?

Regardless, it certainly feels like an own goal that AMD or Intel hasn't yet released a CPU with at least 256 bit wide on package RAM. They'd be able to capture a higher percentage of the BOM cost of the laptop if they did so on top of the speed benefits.


The M1 used in the original MacBook Air has a TDP of around 10 watts. I don't track this closely, but AFAIK there aren't any good performing chips on the PC side of the world that can beat that.

I don't really track this directly, but periodically I look for passively cooled (fanless) laptops. I haven't looked into Ryzen, but it would be a very nice surprise if there are fanless Ryzen laptops out there.



The real world implications of these number matter more than the numbers themselves.

If you tell me TDP is a lie, I’ll believe you.

However, that doesn’t change the fact that there still aren’t any great fanless laptops from anybody other than Apple. I was attributing it to TDP, but maybe it’s something else.


Did you paste the wrong link? That is about M1 Max, which is a very different, much bigger, chip.


Indeed the M1 not max draw 30W max, there is a link in the article I sent, my mistake.


> The other CPU catch back after several months, the Apple Silicon is a good marketing prowess, the reality is that Apple CPUs wins because they are the first on to be produced on a new lithography node, because Apple can book a larger quantity than anyone else.

Uh, but M2 on TSMC's N5 node is faster and more efficient than AMD's products fabbed with TSMC's N4 node. Edit: more efficient in general, but I meant "faster" in comparison with AMD's latest laptop chips.

> Here Jim Keller explain why CPU architecture doesn't matter a lot in performance now: https://www.anandtech.com/show/16762/an-anandtech-interview-...

Let's see what he has to say:

> But instruction sets only matter a little bit - you can lose 10%, or 20%, [of performance] because you're missing instructions.

20% is quite a lot in the current competitive landscape. Jim Keller is stuck thinking like it's 10+ years ago.


> but I meant "faster" in comparison with AMD's latest laptop chips.

The 7940HS is way faster than the M2. Efficiency is harder to compare since TDP doesn't mean anything theses days.


In cinebench, or in (eg) compiling or JVM/Javacode/other bytecode workloads etc?

because even in cinebench the m3 max is already ahead in cinebench 2024 let alone R23...

https://www.notebookcheck.net/R9-7940HS-vs-Apple-M3-Max-16-C...


We were talking about the M2.

The M3 max is on TSMC N3B, which have a +30% of transistor density compared to the TSMC nodes AMD is using (N4).


I guess it exists, especially on the Chinese market, but the apps just are not there. Windows ARM is as popular as Windows Mobile 7


Then forget Windows. There are lots of ARM-based Linux machines out there and I don't know of any that can match the performance / watt that Apple gets.


So where are apps?


On the hard drive? I'm not sure what you are asking.


So not on the Macintosh HD...


I guess I still don’t know what you are asking. Mac apps will be on the Mac disk.


For what exists, I guess that'd be the case, but for useful apps...


How does someone not in the EU get this?

I wonder what Apple's line is to justify not making this open for everyone


something something security


I think the main point is the theft protection and protection from state. The US and the UK's democratic systems are broken.

In the US the social structure is slowly collapsing which increases theft and other petty crimes, at the same time the federal state has a huge surveillance power.

Solving the societal and political problems so there is less incentive having your iPhone stolen is hard. Expecting a state-like company to benevolently save you is the way they cope.

TBH without the EU, legislation like DMA would also be hard to come up with. The independent countries have less power to exert over American behemoths. This is the nice thing about EU.


companies with AI chatbots probably:

1. Replace customer service agents with shitty LLM

2. Distance yourself with shitty service by shitty LLM

3. Profit.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: