Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Nice except DeepSeek is Chinese, and I've not heard of Qwen but I suspect it is, too.

Why not the Meta one? And what other models can reasonably be run locally?
would you trust Meta over chinese and Qwen is that ? some workloads then this more than acceptable. See some AI declines in shares recently, well for some enterprises string a bunch of studios together and run this or Llama etc ..

Free AI in effect no subs, no openAI etc
 
This is - IF it’s as advertised and if it works well (I recognize those are two big ifs) - fantastic.

I’m very interested in reading others thoughts on this, but it seems like a huge win.

I’m extremely uncomfortable with aspects of the LLMs. The more alternatives the better, particularly if it keeps my data private and doesn’t require a subscription. This is also potentially absolutely something Apple should love, as it further supports their approach to running as much AI on device as possible, which in turn will require the hardware capable of doing so, and which will ultimately translate into more sales for the mothership.
 
Well yeah because the only open source models that are targeting frontier models are from China, Qwen 3.8 Max is very impressive, and if it's run locally why are you concerned that they're Chinese?
Because a marketing statement that it is local does not necessarily mean that it is local.

You should monitor all of your outbound traffic. A surprising amount goes to China. Why?
 
The more I stay away from AI, it creeps slowly into my life via employment and every day personal tasks. As much as I dislike the bad effects to society AI creates, I can't put my head in the sand like an ostrich and believe this will all disappear when the bubble bursts. Some of this stuff will still continue in some form or other. Ugh.
 
Because a marketing statement that it is local does not necessarily mean that it is local.

You should monitor all of your outbound traffic. A surprising amount goes to China. Why?

I turn my network off when I'm running local LLMs. Are you suggesting that when I reconnect my network, all my data is suddenly being exported without my knowledge? How would I monitor that?
 
  • Like
Reactions: lemoncrsh
Because a marketing statement that it is local does not necessarily mean that it is local.

You should monitor all of your outbound traffic. A surprising amount goes to China. Why?
such a non-issue nowadays, just download LuLu or Little Snitch and you can monitor / turn whatever outbound off. "local" becomes local.
 
  • Like
Reactions: nt5672
There are plenty of ways to run local models, you don't need to use this...
How do you know the model is local, all of the major model creators have had their models escape into the wild.

The issue is not running it local, it is exactly how much you trust the program running the model and the OS's security concerning what it can do.
 
  • Like
Reactions: amartinez1660
I turn my network off when I'm running local LLMs. Are you suggesting that when I reconnect my network, all my data is suddenly being exported without my knowledge? How would I monitor that?
Nope If you turn your network off, then I think you are good. I would however reboot before connecting the network back to make sure there are no queued network actions.

You monitor outbound connections using your firewall. In mine I added a rule to log all outbound connections.
 
This is - IF it’s as advertised and if it works well (I recognize those are two big ifs) - fantastic.

I’m very interested in reading others thoughts on this, but it seems like a huge win.

I’m extremely uncomfortable with aspects of the LLMs. The more alternatives the better, particularly if it keeps my data private and doesn’t require a subscription. This is also potentially absolutely something Apple should love, as it further supports their approach to running as much AI on device as possible, which in turn will require the hardware capable of doing so, and which will ultimately translate into more sales for the mothership.
I fully agree. AI has its plus’s and minus’s but overall one of the big pain points is privacy and data ownership. We have these powerful “AI chips” in most modern computers, we should be doing a lot more AI on device.

Prior methods of running local LLMs work well enough but local AI will never gain the footing it needs unless software makes it easy for average users to use local models. I’ll definitely be testing this out.
 
Nice except DeepSeek is Chinese, and I've not heard of Qwen but I suspect it is, too.

Why not the Meta one? And what other models can reasonably be run locally?
Because Meta's one isn't very good. Google's ones are decent but the ones from Qwen have been a step ahead for a while now. They're truly fantastic for the size. Not sure what the issue is with running a Chinese model to you but the alternatives are models from US companies that have cozied up to that nonce in the US White House so it's not like they can be 'trusted'.

Because a marketing statement that it is local does not necessarily mean that it is local.

You should monitor all of your outbound traffic. A surprising amount goes to China. Why?
I'm not sure what you're saying. A surprising amount of what data goes to China? Unless you specifically connect these models to the internet, they cannot communicate outside and even then, they don't 'phone home'. That's just not how they function. Now sure, the developer of this software could add in some kind of phone home ability but it's not the models doing that. And you can monitor that if you're paranoid with the likes of Little Snitch.

How do you know the model is local, all of the major model creators have had their models escape into the wild.

The issue is not running it local, it is exactly how much you trust the program running the model and the OS's security concerning what it can do.
I think you're misunderstanding how these models work and run locally. They don't 'escape'. They don't leave your computer. It's just a bit of software that runs on your machine. These models are not sentient or alive.
 
I fully agree. AI has its plus’s and minus’s but overall one of the big pain points is privacy and data ownership. We have these powerful “AI chips” in most modern computers, we should be doing a lot more AI on device.

Prior methods of running local LLMs work well enough but local AI will never gain the footing it needs unless software makes it easy for average users to use local models. I’ll definitely be testing this out.

It is getting easier by each development in the end the query I did as shown failed as did not have the draw model, asked for it to draw apple ecosystem and took it off the net .. but this is only on an M4 MacBook Air 16gb memory... now imagine the bigger beasts etc
Screenshot 2026-10-30 at 2.42.32 PM.png
 
Nice except DeepSeek is Chinese, and I've not heard of Qwen but I suspect it is, too.

Why not the Meta one? And what other models can reasonably be run locally?
Why do you care that it's Chinese (and, yes, Qwen models are also from China)? Models can't spy on you, you know! And if you suspect that any code it might produce has "back doors" or other such tin-foil-hat concerns, you can always examine said code before you do anything with it.
 
I currently use Ollama + Qwen Model (qwen2.5-coder:32b) + Aider on my Mac. It's not great with large HTML/Javascript creation/updates when compared to Gemini, but for smaller changes it's great. And it's free.

It looks like this tool is basically just a front-end integration of the above? Maybe not even Aider (since it mentions not being able to modify local files due to sandboxing)?
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.