• Hacker News
  • new|
  • comments|
  • show|
  • ask|
  • jobs|
  • fastball 20 hours

    This isn't a CLI, so not really like Claude Code. Looks more like Cursor or Conductor.

  • hdz 17 hours

    When the harnesses commoditize, it will be the dynamic things like skills that will be the most valuable, useful thing you can bring to a harness. That seems like a long ways away though. There are still meaningful performance differences between agent harnesses.

  • jFriedensreich 7 hours

    separation of model and tooling is as important as legislative and judicative, and just ignore any tooling or harness not true open source. they will all slowly creep into your life and choke you trying to lock you in.

  • finnjohnsen2 4 hours

    no ACP support it seems :( Of all the AI buzzwords I love ACP because of the separation of concern. Let the editor be an editor, the harness be the ai code agent, and the llm be the llm

  • Artoooooor 8 hours

    I could use them as a provider if they shown concrete price per token. Or concrete number of tokens in each plan. Now I don't know what I would rent from them. If I were to buy hell knows what, I would go to Anthropic.

  • guybedo 21 hours

    if you're going to try this one out, don't be surprised to get this message repeatedly, like 4 out of 5 prompts you're trying to send, 24/7, this is gonna be your new friend, then you'll learn to write the only prompt that matters: "retry", "retry", "retry"

    Here's the message: "Cannot connect to API: write EPIPE"

  • hsyvy 2 hours

    is there cli version available for this harness?

  • 11 hours

  • oxedom 11 hours

    Closed source? No Thanks

  • 19 hours

  • luoshi 16 hours

    Coding plans are often out of stock, it's miraculous

  • 19 hours

  • Aeroi 21 hours

    sweet! i'm heaviliy using glm 5.2 in mouse.dev which is great for mobile. the ui looks really good, similar to cursor agents window ect.

  • linzhangrun 16 hours

    eager for zcode-cli. and their coding plan is always selled out.

  • denct 13 hours

    Does it support Azure openai and aws bedrock models as well?

  • ra 18 hours

    I've been using this for a few weeks and it's a real workhorse.

  • shayankh 22 hours

    how is this cheaper?

  • WhitneyLand 19 hours

    What’s with the 3 subscription plans that are suggestive of being mapped to plans from Anthropic and Open AI?

    Do they really correspond roughly? Seems like they’re trying to suggest a discount while still being worth a significant amount of monthly spend.

  • speedping 10 hours

    First-party harnesses are great, but i'd really wish this was a CLI and not a GUI

  • daft_pink 16 hours

    I couldn’t find if it is soc 2 etc

  • MarceloHenry 19 hours

    Is there a CLI version of it?

  • roguedemon 12 hours

    cool to see how fast they are catching up

  • esafak 22 hours

    I tried it but went back to OC, which feels smarter.

    It does have a 1.5x usage promotion for GLM 5.2 on the coding plan so now is a good time to test it...

  • 7e 22 hours

    GLM-5.2 seems capable. It’s just much slower than Opus.

  • asasidh 11 hours

    OpenRouter + Current IDE for me. Cant be buying a new plan and change IDE every time a new model drops beyond testing for curiosity.

  • jedisct1 19 hours

    GLM-5.2 is a great model!

    But it already works really well with existing harnesses, I'm not sure why a dedicated one is needed?

    I use it with https://swival.dev and everything works perfectly, no tool calling issues and it works fine with long sessions.

  • soni_anuj 16 hours

    what is then VS code with GitHub Copilot ? It primarily does the similar things.

  • elAhmo 9 hours

    With Musk buying Cursor, it is good to have more alternatives on the market.

  • NamlchakKhandro 19 hours

    For those that want something based on Pi Mono:

    - https://igorwarzocha.github.io/howcode/

    - https://github.com/ruuxi/stella

    - https://www.pi-gui.com/

    Not using Pi, but based on PI (no extensions possible)

    - https://twotimespi.dev/

  • kerlenton 9 hours

    [flagged]

  • spudlyo 22 hours

    [dead]

  • mosbyllc 16 hours

    There are now more and more Harness clients. I hope we can have the best open-source client and the best open-source models, as this would greatly facilitate our work and operations. However, this seems unlikely in the short term.

  • vanshitahuja 15 hours

    [dead]

  • sosojustdo 15 hours

    [flagged]

  • nttylock 15 hours

    [flagged]

  • Nekorosu 18 hours

    How about no? I'd rather use something open source and local. We have enough of 3rd party controlled AI tools.

  • myshapeprotocol 4 hours

    [flagged]

  • aziis98 22 hours

    Is this GUI only?

    InsideOutSanta 22 hours

    Yes.

  • pl04351820 20 hours

    Try to understand the token usage/cost with subscription plan comparing with Claude Pro. Is there benchmark somewhere for such info?

    andai 19 hours

    I think they market is as 3x the usage for the same price. Although, the prices are not the same, and Anthropic's usage constantly changes, so...

  • sourdecor 18 hours

    Those are some odd hours though, why would evening time be peak hours? Usually (in the western world anyway), 9AM - 12PM would be peak hours.

    brianjking 18 hours

    Z.ai is based in China and serves out of Singapore, that's surely why.

  • dizhn 22 hours

    This comes with a little bit of free credits. (after login)

    dizhn 4 hours

    It did last week. Wow. That didn't last long.

  • adithyassekhar 14 hours

    The plans on first glance is the same as Anthropic’s. I thought GLM was supposed to be cheaper. Am I missing something?

    colelyman 14 hours

    The plans may have comparable prices, but the API rates are much cheaper. Especially because it is open weights, so there is competition on places like OpenRouter.

    wmedrano 13 hours

    I haven't tried Z.ai, but both Ollama ($20) and OpencodeGo ($10) seem to give me more generous limits than the Claude $20

    msh 5 hours

    They give you much better quotas, on the 20USD plan using opus you will quickly run into limits.

  • swe_dima 21 hours

    Is it possible to use their subscription pricing with Opencode?

    qaz_plm 21 hours

    I use the coding subscription in both Pi and OpenCode without issue.

  • ahmedehab_01 19 hours

    I don't get why not open source it? You are already open-sourcing your weights!

    oathvz 19 hours

    Because a harness can more easily stop backdoors of a model. A packaged app on the other hand ... let's say I'll skip this until I can compile and package it.

    spudlyo 19 hours

    One of these is not like the other.

  • brcmthrowaway 22 hours

    Telemetry enabled?

    22 hours

    22 hours

  • sourdecor 19 hours

    The original submission was to [0] which I feel must be mentioned.

    [0]: https://zcode.z.ai/cn

    dang 19 hours

    You're referring to https://news.ycombinator.com/item?id=48751752, which was the third submission of this. The original submission was in fact to https://zcode.z.ai/en, so I took that one and re-upped it in order to have a place to merge the thread. Seemed fairest!

  • emersoftware 14 hours

    literally I paid in the morning for the pro plan and then they launched this. currently are my fav lab after Anthropic.

    taytus 13 hours

    Lucky you! I'm considering switching from Kimi 2.7. What's your experience so far?

  • teravor 21 hours

    it's an electron app, it highlights wrong spelling but doesn't suggest corrections. how does someone exhibit so much incompetence?

    hadlock 21 hours

    Welcome to using v1.0.0 of any product

    angst 15 hours

    v3.2.2 as of today

  • MangoCoffee 20 hours

    i like Chinese open weight model that offer cheap token but i only use it for my personal project.

    China have a history of stealing IPs/trade secrets and Chinese court favored its own local companies. while US have a robust court that can enforce IPs. if you want to risk your company's IPs/trade secrets/data for some cheap token. Go ahead and use Z.ai's services.

    rurban 13 hours

    The US of A ditto

    brcmthrowaway 13 hours

    What's your top secret project?

    kingjimmy 19 hours

    FYI you can use Z.AI models on infra not in China...

    snemvalts 12 hours

    But this harness app is chinese?

  • unleaded 21 hours

    As someone who doesnt use these tools, why does every AI company need their own version of Claude Code? Is there more to it than vendor lock-in?

    computerex 15 hours

    Why not? They are relatively easy to make so why not. Even I made one: https://github.com/computerex/z

    ambicapter 21 hours

    "Quality" of the harness matters a lot to the user experience, and the construction of the harness will depend on the behavior/quirks of the underlying model. So, if you're using Claude Code, you can expect it to work best with Anthropic models, and expect other model-makers to want you to use the harness they've developed.

    But mostly vendor lock-in, I imagine.

    cheesecakegood 14 hours

    There are different grades of vendor lock-in. There's mechanical lock-in (which is a thing, like .claude folders) and economic lock-in but then we don't pay enough attention to behavioral lock-in. Habit is powerful, and if you can habituate users into a certain flow, change feels bad and they are more likely to stay.

    theredleft 21 hours

    implementing their own version of steganographic monitoring lol

    dcre 21 hours

    A joke but also not a joke.

  • gck1 21 hours

    It's sad to see that the teams that have the most resources that can contribute to development of next-gen harnesses are essentially copying the same exact thing from each other, with no meaningful changes.

    And most of the advancement and experimentation happens in some random 0-star github repos.

    nadermx 21 hours

    There the ones with most to prove

    gtirloni 21 hours

    Could you share some of these 0-star github repos?

    gck1 21 hours

    I've been working on my own private harness for the past 8 months, and I've been collecting ideas from such repos I've stumbled upon.

    pi-tmux is one such example (seems to be archived now) which inspired me to use tmux as communication layer and provide visibility of subagents of multiple models in their native harnesses [1].

    There's also herdr, which is not 0-stars, but is super interesting but lesser known project [2]. This also has interesting substrates to allow agent coordination.

    None of these are harnesses per se, but they're pointing towards clear gaps in existing harnesses. For example, we've known for a while now that compounding knowledge of different class of models achieves better performance. Why is there no harness where this is a native functionality? And there's no harness where subagents are first class citizens both in terms of capabilities and UX.

    [1] https://github.com/offline-ant/pi-tmux

    [2] https://github.com/ogulcancelik/herdr

  • razfar 11 hours

    For anyone who uses GPT-5.5/Codex as their daily driver, how does GLM-5.2/ZCode compare, esp in a codebase already set up for agentic coding?

    jastuk 4 hours

    I tried it for a couple of hours this morning and yeah, it's a bit slow, and I needed it in peak hours so it also often can't reach the server so that makes it even slower. And I'm not even sure it's just the model, it could very much be the harness. Stalled for 40 minutes on trivial tool calls like `find`, two times...

    It shows potential, answer/code quality was solid, but I would need more time with it.

    ramon156 11 hours

    TLDR GLM will take a lot longer to do a task, and maybe spend more tokens depending how complex it is

    Its a hell of a lot cheaper though, so for me its worth it. I have more claude experience though, and I would say its almost en par with Opus 4.1

    redox99 11 hours

    It's cheaper if you pay API prices. If you pay a gpt sub then codex is much much cheaper.

    gpt5 11 hours

    GLM 5.2 is in an uncanny valley where it's too big to run at home, too expensive and slow in comparison to similarly capable model (a good chart here - https://deepswe.datacurve.ai/), and that's just comparing API prices.

    When looking at subscription offering by Anthropic and OpenAI, it's not even comparable, as a Codex $200 subscription can easily use a billion tokens per week on GPT 5.5 high/xhigh.

    It's an interesting model from the perspective of being the most capable open weight model. But it doesn't have a solid place in this marketplace right now.

    razfar 10 hours

    Thanks, that DeepSWE comparison is really useful. Yeah the Codex $100 plan with xHigh reasoning is very practical and cost efficient.

  • ernsheong 17 hours

    Is there any desktop coding app that can be used with local LLM?

    dv35z 11 hours

    OpenCode (TUI and desktop app) can use Qwen local

    burgerzzz 17 hours

    I built vibn.dev for this purpose, it’s very rough around the edges tho

    17 hours

    17 hours

  • Art9681 21 hours

    Yea not touching this with an any-foot pole. They are just keeping up with the Joneses now. There is no reason for this to exist but there IS a reason it is not open source. ;)

    TurdF3rguson 21 hours

    Isn't competition and open markets a reason for this to exist?

    scotty79 20 hours

    Funny, I think the same about Claude.

    aniviacat 20 hours

    Didn't Claude Code pioneer this style of agent?

    casion 19 hours

    They said Claude, not Claude Code.

  • d3Xt3r 21 hours

       For GLM Coding Plan subscribers, quota consumed via Coding Plan for GLM-5.2 in ZCode is discounted by the coefficients below — the same usage draws down less quota, roughly 1.5x the effective allowance.
       
       Peak hours (14:00–18:00 daily)  3x -> 2x
       Off-peak (remaining 20 hours)   1x -> 0.67x
    
    I wonder whether that is referring to local time, or CST (UTC+8)?

    dadoum 21 hours

    From https://z.ai/subscribe#code-plans-container:

    > Explanation and Recommendations Regarding Usage for Plan-Supported Models

    > Note: Peak hours are from 14:00 to 18:00 daily (UTC+8).

    qaz_plm 21 hours

    Peak hours are 14:00–18:00 (UTC+8)

    https://docs.z.ai/devpack/overview

    d3Xt3r 21 hours

    Thanks. Those are some odd hours though, why would evening time be peak hours? Usually (in the western world anyway), 9AM - 12PM would be peak hours. Things normally slow down post-lunch, and be its slowest at close-of-business.

    kgeist 17 hours

    I run a corporate AI server and coding peak hours here are 1PM-5PM judging by AI usage stats. My guess is that people spend 9AM-12PM in meetings and at lunch, and the actual coding starts around 1 PM.

    VulgarExigency 19 hours

    They're peak hours in Beijing

    TurdF3rguson 20 hours

    Because westerners are using it is my guess and for them that's right in your window

  • paxys 22 hours

    UI-wise this looks a lot closer to Codex than Claude Code. It's basically an exact copy of Codex.

    hazelnut 21 hours

    I would very much agree. Even the hand icon, the usage in the text field, and the sidebar style are 1:1 identical to Codex. It's a misleading title - it's not close the Claude Code.

    scotty79 20 hours

    Which makes keeping Codex closed source look even sillier. Software is no longer anyone's moat. Just let it go.

    subarctic 19 hours

    I thought codex was open source https://github.com/openai/codex

    tekacs 18 hours

    The CLI / engine is, the desktop app and its plugins (e.g. computer use) are not.

    19 hours

  • toddmorey 22 hours

    Does anyone use an agnostic TUI or harness for development tasks that can fairly seamlessly switch between providers?

    I'm wanting local context in the spirit of "here are 3 AI providers available, for coding tasks use this one... and for writing prose use this one... and for generating images use this one..." etc.

    skzo 9 hours

    I use Kilo Code for that it's based in OpenCode and it's OpenSource.

    I prefer having a GUI for diffs and session history,but if you prefer TUI you can just use OoenCode

    alexfortin 11 hours

    If you haven't yet you should give a chance to https://pi.dev

    I've been using it exclusively (and extending it, see https://a.l3x.in/ai) for months with mainly GLM-4.7 then 5.1 and now 5.2 and I could hardly be any happier.

    I'm still working on a "Github/Forgejo first" based workflow but also quite happy with it already, basically most of my sessions run as a ci/cd job (triggered by "/pi" comments) and generate PRs or push commits to PRs, see https://github.com/shaftoe/pi-coding-agent-action

    l00sed 21 hours

    https://opencode.ai/

    OpenCode was the first agent harness I used, and I have always like it. You can configure a wide variety of providers, but it's open source and has a number of core contributors.

    The other opinionated option is Pi (the Pi agent harness). This is a great lightweight option and also supports a number of providers. You can also use local model servers.

    wolttam 21 hours

    I use the one that I've been developing since 2023. It's intended to be used in exactly this spirit! Written in Go, has image support (which has yet to be fleshed out).

    It supports MCP (unlike Pi), sandboxing (with user-mode networking), and runs efficiently at huge contexts.

    https://codeberg.org/mlow/lmcli

    (The screenshot in the folder is a little bit out of date, but is still representative of the overall look)

    deathmonger5000 18 hours

    Circus Chief allows you to do this: https://github.com/ferrislucas/Circus-Chief

    (Full disclosure: it’s my project)

    jbonatakis 21 hours

    I’ve been using Crush with Openrouter and have good success lately

    https://github.com/charmbracelet/crush

    maxloh 21 hours

    Also Goose from the Agentic AI Foundation (AAIF) (subsidy of the Linux Foundation).

    https://goose-docs.ai/

    try-working 12 hours

    You can do this with role-model, the model router I've built. It routes based on roles and tasks among other things. It has an extension for Pi that lets your coding agent specify request metadata for roles and capabilities etc.

    https://github.com/try-works/role-model

    bredren 21 hours

    I’ve written a skill for codex and Claude code that designates an orchestrator on the primary worktree and is agnostic about what type of AI workers are on the N supporting worktrees.

    The orchestrator knows which AI client is running in any given worktree, so it would be fairly easy to designate which AI should receive what kind of tasks.

    You run either Claude or Codex in tabs for each work tree. I do have some AI TUI specific instructions, for instance codex is primitive at monitoring compared to CC. So, there are additional notes for Codex workers on how to properly monitor for new "mail."

    You work with the orchestrator on the primary worktree and allow it to delegates tasks to the workers and answer their smaller questions.

    It surfaces results and assisting them with context clearing when needed.

    The orchestrator and workers communicate using a simple shared file system under tmp/* and together they can handle a big and varied workload.

    I use iterm2, so I’ve also added iterm2 specific python that allows the orchestrator to “kick” a worker or perform tasks otherwise veto'd by the TUIs (ie /clear) by modifying the input and submitting it.

    dev_l1x_be 11 hours

    Is this open source?

    himata4113 19 hours

    I stumbled upon https://omp.sh and haven't really felt the need to ever use anything different.

    esafak 18 hours

    "omp is a fork of Pi by Mario Zechner, rewritten as a coding-first surface: sessions, subagents, slash commands, extensions — all TypeScript..."

    daytonix 22 hours

    have used both pi and opencode for the last 6 months, haven't opened a proprietary harness (cc, codex, cursor) in that same amount of time. right now i'm on pi and i can switch seamlessly between any model across any provider i want, even mid session. can even point them at locally running models.

    i think people don't realize how much better life is over on this side, cc and codex rely entirely on vendor lock in imo.

    try-working 12 hours

    Try the role-model Pi extension I built, to let Pi determine when to switch to a different model in your pool.

    https://github.com/try-works/role-model

    FergusArgyll 19 hours

    codex is open source https://github.com/openai/codex/ it's definitely geared towards openai but it is completely open source

    notshore 18 hours

    [dead]

    l00sed 21 hours

    Haha I pretty much commented the same thing one minute apart.

    mr_mitm 21 hours

    You can use Claude Code with a self hosted model no problem. I don't believe you can switch during a session though.

    jcmfernandes 17 hours

    Are you using openrouter or something else?

    fcarraldo 20 hours

    Does a mid-session provider switch result in loading the entire context into the new model, inflating session cost?

    I don't think I understand the token/cost implications of this feature

    gunalx 19 hours

    Its nice if you used local, but needed å beefier modell, or more context Window. It will eat input tokens, but you do that all the time unless you have input caching.

    resonious 13 hours

    Yes you pay a big burst right after switching. After that, everything is cached and it's smooth sailing.

    esafak 21 hours

    why did you switch from oc to pi?

    daytonix 21 hours

    i like the more minimal design of the tui, feels more integrated with my existing terminal workflows. oc always looked a little out of place. i really like pi's extension ecosystem as well.

    alexfortin 11 hours

    Same here. Moving from OC to Pi also taught me one more time that less is more and I don't need most of the features I thought I needed.

  • maxdo 3 hours

    Interesting to see how their harness will show up here. So far, https://cursor.com/evals this even shows still a big gap in performance, and almost no real win in terms of money vs gpt5.5 and sonnet 5.

    Which make me raise a question. Why would I install a close source black box, that will send data to a country that you can't make legally liable for even most crazy miss doings.

    The market of a hosted commercial version of glm is very weird. yeah you can deploy an open source version or run it locally, sure. This.... hm, i don't know why any company would take any risks to use GLM

    orloffm 2 hours

    How is this different from installing Claude Code or Codex? Maybe in the US someone has some hopes about having those makers "legally liable", but in Europe both US and China products seem equally far away and equally closed in all senses.

    maxdo 1 hours

    Yeah that’s why Google lost 4 billion to EU for some elusive non competitive practices. Every single big tech us company is never out of court in eu. Good luck brining any of Chinese companies for distillation . They steal your IP , your data and you have 0 protection .

    kennywinker 52 minutes

    If distillation is stealing, then so is generating code using an ai model. It’s the same thing: prompt a model, use the output to make software.

    Not to mention, claude and gpt only exist because of massive ip theft in the first place.

    maxdo 28 minutes

    yeah, sure, laws are just pointless things.

    Lets move to caves and if I kill you first , i'm right, if not i lost. THat's your logic.

    there is ToS, and every single person who is doing distillation knows it's illegal. Also on IP theft. There were several courts, in different countries they limit certain knowledge bases and thats it. so that entire claim is baseless.

    Again this is the difference. A major book publisher brought ai companies to court and won. You can't doo anything with Chinese companies even if you are book publisher of this world.

  • MarceloHenry 18 hours

    Can anyone tell me if Z.AI's cheapest plan is more or less generous than Claude's cheapest plan? If it is more or less generous, could you describe the extent of the difference?

    (If this comment is too formal, I'm sorry. I used Google Translate to it [this line was NOT translated])

    zackify 18 hours

    I got around 17m tokens on glm 5.2 then blocked for 4 days on the weekly limit on that plan.

    MarceloHenry 18 hours

    17M tokens... I think it is a lot. What were you working on?

    bearjaws 18 hours

    Is that 17M output tokens?

    At 200k context that is only 85 requests for a whole week.

    davikr 17 hours

    That's like 30 minutes of MCP usage.

    computerex 15 hours

    Not really. I have spent 163M deepseek v4 flash tokens in July and it literally just started.

    https://i.postimg.cc/MHhgwsv0/image.png

    MarceloHenry 2 hours

    I definetily cannot spent too much token in a single month

  • cube00 20 hours

    It's impressive all these companies are getting away with "base usage allowance included" [1] or "standard limits" [2], layering the higher plans as a multiplier of that "base" but never disclosing what it is.

    I guess the base is whatever the profit margin needs to be this month.

    [1]: https://zcode.z.ai/en#:~:text=Base%20usage%20allowance%20inc...

    [2]: https://support.google.com/gemini/answer/16275805?hl=en#:~:t...

    nullbio 14 hours

    Yeah, this is why I like the ACCC in Australia. They wouldn't allow this sort of thing to fly if this was an Australian company.

    nucleative 19 hours

    A strategy that can backfire. An unpredictable tool is worse than a bad tool.

    reissbaker 15 hours

    Agreed this sucks. We publish ours here and try to be as transparent as possible: https://synthetic.new/rate-limits

    Sidio 12 hours

    Love both the approach and the transparency. Kudos.

    ranyume 19 hours

    When running the app, it actually tells you what the base usages are, but the name of the plans are different from the page. It reads:

    Start plan: 5 Million tokens a day (GLM-5.2 3M, GLM-5 Turbo 2M)

    For individuals: (+150% quota) $18.00USD+ For individual developers with a dedicated Coding Plan quota.

    overgard 1 hours

    Heh, so it sounds like you have to pay them first to find out what you're going to get for the money? That's an interesting business model..

    SwellJoe 18 hours

    Now, if only we can figure out what all the others are providing as part of their subscriptions we can compare. (Though 3 million tokens of the top model per day seems kinda low. But, I guess that's what the 5x plan is for. I'd still like to be able to compare against all the big providers.)

    ranyume 17 hours

    Note that it says "start plan" without a price tag. The price tag for the other plan is the one on the page. I don't know what it is because I haven't set up an account to use it, I set up a custom provider in the app.

    The app itself is interesting to me. I can see most of the agent trace (I can't see the tool definitions and the tool input args), I can set up skills and make the agent manage them and I can define sub-agents as well.

    The UI itself is a bit weird, but I guess it's not thought to be a general purpose file editor.

    trentor 17 hours

    You can just track the tokens used in Claude Code and codex until you hit the limit?

    SwellJoe 12 hours

    Can you?

  • vinceguidry 16 hours

    Has anyone come up with a decent harness for small local models, say, gemma4 e4b? I'm trying to roll my own but man, the capability gap is real.

    yogthos 15 hours

    This is precisely what I've been working on targeting with https://dirge-code.github.io/

    I've written up an explanation of what trips small models ups and how the harness can address that here https://yogthos.net/posts/2026-06-08-dirge-code.html

    Terretta 15 hours

    This really resonates. Thanks for mentioning.

    vinceguidry 12 hours

    Very interesting work! I put some effort into getting it to work with models my hardware can actually run well and they just fall over immediately. gemma4 12b runs like molasses on my 2080 super but it was the only model able to, with your harness, actually do anything useful. It was the only useful thing I've gotten any model runnable with my hardware with any harness I've tried, very impressive!

    I suspect smaller models need more work than is practical to fit harnesses around. The smaller the model, the more work, and it doesn't carry over to other small models.

    Deepseek r1 7b could not emit tool calls to save its life, gemma4 e4b couldn't get the names of files right, qwen3.5 4b gets stuck in dumb rabbit holes, I pointed it at a ruby script and asked it to run it, it tried running it with bash then got caught in a loop investigating.

    Noble effort though! I guess I'll keep working on my barebones ruby_llm harness, with very tempered expectations. Each of these failure modes can be worked around, but there's too many of them to work around in the general sense.

    yogthos 5 hours

    Thanks, glad to hear the harness is actually doing its job with smaller models on your end. There definitely seems to be a limit of how small a model can get before it can't do any practical work.

    I find I tend to view agentic coding similarly to a genetic algorithm. The model is the mutator function, and the harness along with the tests acts as the selection function. Each round the model generates some plausible code, it gets tested against the constraints, the model gets feedback and iterates on it until it converges on something that's workable. So, the real trick is to make sure the environment is producing correct pressures to guide the model in the needed direction.

    Another interesting project in this space I can recommend checking out is ATLAS https://github.com/itigges22/ATLAS

    polski-g 14 hours

    This is very impressive!

    yogthos 5 hours

    Thanks, it's been a fun and educational experience working on the project.

    quantumleaper 14 hours

    Do you have benchmarks comparing against Pi? The blog post doesn't include any hard numbers.

    For example, so far I haven't seen any evidence that LSP integration improves performance for small models vs using grep via a bash tool.

    yogthos 5 hours

    I haven't really seen anybody come up with a good test to show hard numbers on comparing agentic harnesses. It's a bit tricky to set up a definitive test given the whole non deterministic nature of LLMs. What I've been focusing on is watching the loop and seeing where model does things that it shouldn't have to. For example, I notice models doing stuff like writing python scripts to match parens for Clojure all the time using editors like Pi. So, having a mechanical way to repair parens, and when that fails, to give the model clear error regarding where syntax is broken removes that whole cycle.

    As it stands, it's kind of subjective, you just have to try the harness and see if the model seems to be have better than with the other ones you've been using.

    quantumleaper 3 hours

    How are you iterating on a system prompt and tool descriptions without an eval that gives you hard numbers for improvement or regression?

    yogthos 18 minutes

    I look at what the model is doing in the loop and whether the harness is catching cases such as the model having to write scripts to balance parens, whether it's trying to do the same thing over and over again, and all the other cases I explained in detail in the blog post.

    Even without having hard numbers, it's pretty easy to see from the log whether the model is getting stuck or not.

  • KronisLV 22 hours

    Looks quite pretty! Not sure if I want to try that instead of OpenCode, maybe. OpenCode also has a desktop app, I will admit that I like their TUI one better (and honestly more than Claude Code TUI) but whole the desktop version is kinda more basic, it's nice enough: https://opencode.ai/download

    That said, it's interesting that they're releasing a bunch of stuff: ZCode, OCR.z.ai, Image.z.ai, Audio.z.ai, AutoClaw and some other stuff that https://chat.z.ai/ links to. That's a lot of stuff for one org to pull off.

    Figured I'd try out their Pro coding plan, seems like it doesn't necessarily give me that much quota than Opus (at least given how many tokens are needed for accomplishing a certain task), but GLM 5.2 in of itself seems like a beefier Sonnet model, pretty good.

    shard972 13 hours

    [dead]

    bitlad 22 hours

    Their tui is quite heavy and crashing quite often as compared to claude code.

    altmanaltman 13 hours

    Have not used claude code but have used opencode tui a LOT and it does seem to crash quite a bit. Not like it breaks every session but enough that I have come to expect it but still not bothered enough to change. I don't like switching setups mostly

    dimgl 21 hours

    Which are you talking about? OpenCode or ZCode?

    bitlad 21 hours

    OpenCode

    Computer0 18 hours

    I would agree I cannot bear to use the TUI and I find myself in the terminal quite often. The value is good on the $10 plan so I still get decent usage on the desktop client but I would prefer a better terminal interface.

    real0mar 2 hours

    You can use the opencode subscription plan with other agents if you wish. They allow it

  • seizethecheese 22 hours

    I'm somewhat surprised that this is not open source (from what I can tell). Compare to Mimo Code https://github.com/XiaomiMiMo/MiMo-Code (which is a CLI, while this is a desktop app).

    18 hours

    addozhang 13 hours

    I'd prefer a CLI over a desktop. But then why don't I just use OpenCode?

    maxloh 21 hours

    I don't find a closed-source Chinese agent system trustworthy.

    It is essentially a black box with full user permissions, meaning you are just handing over your entire system to a Chinese-owned server. With OpenCode and its GLM provider, at least I can monitor which files were read, which were edited, and what commands were executed.

    Not to mention that Chinese national security laws legally obligate companies to cooperate with state intelligence and counter-espionage efforts [0]. If you have this installed on a corporate workstation, and your company is large enough, the possibility of them spying on you is not just a risk—it's almost a certainty.

    [0]: https://en.wikipedia.org/wiki/National_Intelligence_Law_of_t...

    sabedevops 21 hours

    You shouldn’t find American ones trustworthy either.

    anderber 18 hours

    That looks to be a copy of OpenCode

    russelg 18 hours

    A fork, yes.

    dizhn 22 hours

    It's only a cli because they yanked out the opencode desktop code. (As well as the opencode go/zen model provider)

    Edit: my theory is they wanted to mimic being the primary provider in a quick way with a lot of string replace. Though they could have added opencode back as a regular provider.

    versteegen 18 hours

    MiMo Code adds a lot of cool orchestration features to OpenCode! It definitely is NOT a quick find-replace job, it's genuinely someone's research project to create a better agent harness building on top of free software, and that's awesome. See https://mimo.xiaomi.com/blog/mimo-code-long-horizon

    dizhn 8 hours

    They did remove the opencode provider though and the desktop and web interfaces. I was trying to be charitable.

    By the way, their repo was a bit weird with no changelogs at all. It seems to be picking up speed now with their communication. I actually read in the changelog just now that their Compose (plan/executre/review etc. something like that) flow is now deterministic with software instead of just prompts. That could be really good.

    cco 20 hours

    You're surprised? I think harnesses are almost as important as the underlying model. Folks have been able to improve benchmark results by nearly 2x based on harness alone.

    Harnesses are quickly becoming critical components of the "model" itself imo. Not shocking to me at all that a company that spots a revenue opportunity is keeping its harness closed source.

    bermudi 16 hours

    Source? The most trusted benchmark right now (deepSWE) scores better or just as well on their minimal harness than when using CC or codex

    MrDrMcCoy 15 hours

    I'm a neophyte. What makes a harness special or all that unique from another? I've had a reasonable experience with Zed and local models, but could be persuaded to put something else in the mix if there is a measurable benefit to be had.

    tl 14 hours

    Simple example: a while back LLMs would trip over questions like "how many Rs are in strawberry". Now, the system prompts have a line like "when a user asks for a count, actually count the value by calling a tool if needed". The LLMs cannot get smarter in this regard, next token predictors will hallucinate here.

    A harness is that covering every blind spot or sub-optimal but probable output people have hit in the wild, and a lot of problems just have better solutions if you say "break problem A into subproblem B and subproblem C, then solve".

    _pdp_ 19 hours

    I am not surprised it is not open source. These harnesses are hard to build - they are not just wrappers - and often they contain business logic that is not suitable for public distribution for all kinds of reasons.

    NamlchakKhandro 19 hours

    hard? wut lol....

    no. they. are. not.

    Some people are just terrible at it.

    _pdp_ 17 hours

    I was thinking the same and I changed my mind.

    Also you don't need to believe me. There is enough evidence in the open source space.

    saghm 21 hours

    Given that there's such severe concern being expressed by Anthropic about Claude being distilled, and the idea that the harness is part of the the moat, it doesn't seem super surprising that the other side of that would try to also make it harder for them to tell how well they're doing and what their approach is.

    JSR_FDED 19 hours

    Unlikely considering they’re publishing the Crown Jewels (GLM 5.2) as open weights.

    lelanthran 11 hours

    > and the idea that the harness is part of the the moat,

    That idea is wrong, though. These same people thinking harnesses are part of a moat are also boasting that s/ware is easily writable now.

    There's no secret sauce in a harness that you can't vibe-code into your own harness.

    saghm 2 hours

    Why don't the major players open source their harnesses then? As far as I'm aware, the only time the source code for the Claude harness became available, it was due to a mistake (which is it's own whole thing).

    I'm not saying you're wrong necessarily, but I do think that when the actions and words of a company conflict, it's a pretty safe bet that the words are just posturing and the actions better reflect their actual belief. In this case, regardless of what they're saying about software being easily writable now, they clearly seem to at least think there's something valuable in the harness if they're not open sourcing it.

    jorisw 8 hours

    > vibe-code into your own

    Except you'd need the knowledge of what to vibe-code, no?

    lelanthran 5 hours

    > Except you'd need the knowledge of what to vibe-code, no?

    What knowledge? If you've used a harness, you know what it is supposed to do for you!

    What further knowledge do you need that can't be extracted from an existing harness?

    LaurensBER 21 hours

    They might be sending some user requests to Anthropic to gather trading data for their own models. If they do so, perhaps they need to add some tracer to request that they prefer to hide.

    fwip 21 hours

    Wireshark would catch that easy-peasy.

    benatkin 19 hours

    The request would need to be done from their service, so as not to expose the API key, and because it just makes sense. They could probably directly proxy it and Wireshark couldn't catch it, due to everything being HTTPS. But people could probably catch it by decompiling, so it would make more sense to have the server make the request as part of a GLM request. Not that I think this is plausible - I'm not sure.

    bermudi 16 hours

    I wonder if you're as cynical and untrustworthy of American companies as well or is it more of a racism kinda thing

    LaurensBER 11 hours

    This is an extremely weird comment that doesn't add anything to the conversation.

    Here on HN we discuss facts, jumping straight into racism has no place here.

    MrDrMcCoy 15 hours

    Everyone should distrust them equally. Only local agents in a detached network namespace are safe from data leaks. It is perfectly reasonable to assume they are using our sessions to train on, since everything else short of nuclear launch codes is already there, and they need to keep feeding it.

    jijji 17 hours

    or more likely, sending it to the CCP

    neonstatic 17 hours

    Californian Communist Party?

    WhyNotHugo 4 hours

    California has had a ban on the Communist Party since the fifties.

    bogdan 21 hours

    Source? Or is it "trust me bro"?

    DonsDiscountGas 20 hours

    "might" means pure speculation

    embedding-shape 21 hours

    Literally just FUD unless someone has code to point at.

    anakaine 21 hours

    Verbally minimising potential threats is not a valid approach to managing risk. We have seen mass misuse of tokens acquired through nefarious means to distill models and enhance training as a way of catching up recently, among other related issues. It is quite appropriate to wonder what else might be going on.

    _aavaa_ 19 hours

    Those nefarious distillers, only we are allowed to freely distill the world’s knowledge into our paid products

    SwellJoe 21 hours

    I don't even know what I would do with a desktop app. I'm running these things in headless VMs, so I can run them with `--dangerously-skip-permissions` or whatever. I don't trust them, even without that flag, on my desktop/laptop.

    ahmadyan 19 hours

    a well-design IDE should abstract that away, i.e. run the agent in the headless VMs while give you an abstraction that you would feel like you are running the agent locally with all the benefits (editor, browser, diffs, debugger, etc)

    knocte 11 hours

    I shared your fear some weeks/months ago so I was always using my harness in the cloud. However, latency started to become an issue when I traveled to other countries where I needed a VPN... so I ended up cooking skynot to be able to trust running my harness in my own computer: https://github.com/tarsgate/skynot (PRs welcome if you want to add support for another harness different than Pi)

    aussieguy1234 15 hours

    I just back up my entire home folder to another device, then let it rip

    Scrounger 10 hours

    > I'm running these things in headless VMs

    What's your setup like and what do you use it for?

    I have a M2 Max MBP with plenty of ram and I use VSCode + Zoo Code plugin with Qwen3-Coder-Next-GGUF:UD-Q4_K_XL to run local agentic coding sessions, but I'm intrigued by being able to run headless as I could probably run multiple instances in parallel to do stuff?

    Like are you using UTM with some pre-built VM and a local LLM?

    Curious.

    InsideOutSanta 21 hours

    Zcode allows you to connect to a Docker container, or to a VM using ssh.

    FergusArgyll 19 hours

    I finally repurposed an old server just for that and for anyone reading who has not had a chance to use --dangerously-etc. it's awesome, do it :)

    nicoty 11 hours

    I've contributed to https://github.com/0xferrous/agent-box which allows you to bind-mount git repositories into containers that agents operate in, preventing the agents from accessing files that aren't bind-mounted. Your usual .gitignore can then be used to also ignore files within the repo to be bind-mounted, which prevents agents from accessing them at all, essentially working as a sandbox.

    I also maintain https://github.com/nothingnesses/agent-images which allows you to use Nix to reproducibly spin up OCI container images containing agents and any other tools you need for development and use these with agent-box.

    I use both at the moment to work on some personal projects with agents, where I set up multiple separate git worktrees for the agents to work in, preventing them from accessing anything outside of the worktrees and from trampling over each other's work.

    raphinou 11 hours

    In case anyone is interested, I'm also using bash scripts to run my agents in containers. It's simple, but has only bash and docker as dependency: https://github.com/asfaload/agents_container

    LuD1161 10 hours

    Might wanna check out https://github.com/LuD1161/agentjail - policy guardrails for coding agents.

    shameless self-plug. I've been dogfooding it for the last 3 weeks now.

    jpeeler 5 hours

    Looks similar to https://github.com/nolabs-ai/nono. Maybe one day you can fill out https://github.com/LuD1161/agentjail/issues/10 with a comparison to that project too.

    teaspoon 21 hours

    Good desktop apps in this category can manage agents across any number of remote SSH hosts.

    TimXare 15 hours

    [dead]

    htrp 15 hours

    Examples here?

    nutjob2 20 hours

    What's stopping a CLI from doing the same?

    I've never used IDEs and never will, why are these things being constantly shoved down our throats?

    mattnewton 16 hours

    But then I close my laptop and it’s not running on the headless host anymore right

    dandaka 10 hours

    Codex, Claude Code, ZAI — they continue work in headless mode, when you close your laptop, if you have connected to remote machine

    anavat 12 hours

    No, it actually continues running headless on the host, and you can reconnect from another laptop or mobile phone, or even ssh to the host and attach to the session. At least Codex desktop app works this way.

    SwellJoe 15 hours

    That's also true if you're running the agent directly on your laptop OS.

    In that case, maybe you want VMs at hosting providers. There are companies building ephemeral VM and container orchestration layers for this kind of thing, I haven't played with them, though. It seems like a reasonable idea, though. One isolated environment per project or repo. Only the secrets needed for that one project and an agent that can't reach outside of it.

    I've considered building something along those lines, and actually do run my security auditing benchmarks in containers automatically (that was originally to prevent the models from cheating, because you can disable network, but it has other pleasant side effects).

    It's actually not that big of a lift these days to spin up containers on-demand and put just what's needed inside it (including the authentication info for the agent). I probably should automate it..right now I just have four permanent VMs setup for my various types of work: My day job, my open source projects, my benchmark and security work, and some side projects. Plus some temporary ones for experiments.

    SwellJoe 20 hours

    But, it's still running on my desktop/laptop. I don't trust them to run on my machine. But, I guess I could run one VM with a desktop to contain the desktop app. Or, just keep using CLI agents.

    ghm2199 19 hours

    For local tasks you can only give agents delegated that execute your deterministic read or write on an allowed set of files(e.g pi does this) and execute rights only on containers with no network access. That should get you 95% unblocked for most tasks you want to do with an LLM pretty safely.

    You can do a brainstorming with web on a remote container prototyping based on that brainstorm on another container with no network access.

    The one thing that is less trustworthy is using local agents for service management, you definitely want to have them scoped to dev/testing. I would never trust an agent to execute any command in production or sensitive data at all

    miroljub 12 hours

    Do you also run your browser in the VM? Why would an agent be less trusted than any other piece of software?

    msh 5 hours

    Seriously, you dont see any difference? A agent is non deterministic and may delete or change you data as a normal matter of operations. A browser, barring bugs or security issues, would not delete or modify the data you have outside the browser.

    SwellJoe 12 hours

    I don't run anything but the agent and the project it's working on and the tools it needs to work on the project in the VM.

    You can't see how the agent having no access to anything other than what it's working on is safer than the agent having access to my home directory with all of my credentials?

    Look, you do whatever you want to do with your agents and your computer. I'm going to...contain them.

    https://venturebeat.com/security/six-exploits-broke-ai-codin...

    csomar 16 hours

    I mean, if the execution happen on the VM then the problem is trust on the programs and then you can't trust any program by that logic? That or you think AI-companies software is serious slop.

    SwellJoe 1 hours

    I do, in fact, think the AI companies software is serious slop. I've read some of the Claude Code source.

    And, we're not talking about hypothetical attacks here. Prompt injection attacks have happened. Supply chain attacks that agents fell for have happened.

    https://venturebeat.com/security/six-exploits-broke-ai-codin...

    I'm going to "security in depth" these gullible little thinky guys in my computer, but you do what makes you happy.

    jen20 15 hours

    Slop is less of a problem than the incentive such companies have to “accidentally” hoover up whatever data is accessible.

    scorpioxy 19 hours

    Is the trust concern for the agent running in any form on your machine? Like in a VM on your machine as well or do you mean on the host itself?

    I have read about people giving an agent full access to their main system saying they have nothing of value. To me, that's a strange opinion to have with the distinction between what's private and what's secret.

    SwellJoe 19 hours

    I don't run agents directly on my desktop/laptop machine. I run them in VMs or containers (sometimes in containers on VMs). There have been too many credentials stealing exploits via prompt injection and the like for me to be willing to let an agent roam around on my personal system.

    I've also started creating new github deploy keys for each repo in use on a VM, so the blast area for any given agent disaster is "a couple/few github repos and whatever credentials were needed for the agent/model".

    I wouldn't let a coworker, even one I know pretty well, log into my personal account on my machines...why would I let an agent that can be tricked into uploading all my credentials to an attackers web server?

    The agents have sandboxes, but those are loose. Not enforced by anything outside of the agent harness itself.

    scorpioxy 18 hours

    Oh yeah, that sounds wise to me. Some people don't run the agents on a VM on their own machine and opt for a VPS somewhere. And I was wondering if privacy and security had anything to do with their decision.

    Avicebron 16 hours

    This is what I do, VMs in proxmox. It works really well.

    chrisweekly 15 hours

    Have you seen smolvm (from smolmachines)?

    edouard-harris 8 hours

    > The agents have sandboxes, but those are loose. Not enforced by anything outside of the agent harness itself.

    You might want to check out Ant's open source srt [0], I use it to contain my local coding agents. It's strict by default and enforced at the OS layer.

    [0] https://github.com/anthropic-experimental/sandbox-runtime

    28304283409234 1 hours

    What benefit does running it locally have over parents solution of running it in a container in a VM?

    I do the same: my agents run in a hardened VM on a hardened Linux machines in a separated network in my basement. The magic of ssh makes this setup transparent for me on my desktop. But extremely hard for my agent to do nasty things.

    notshore 18 hours

    I'm working on a credential broker that would keep credentials vaulted and parcel out access on a per-grant basis. Is that something you'd find useful or is your setup comprehensive enough? We would be allowing people to draft access policies with natural language, I figured it would be useful for things like vercel, stripe access etc.

    0gs 16 hours

    fwiw, i built something simple like this into my harness thing (github.com/0gsd/enough). may not be complicated enough to do per application nowadays vs. needing a modularized outside solution, but it is certainly a good idea that seems to work!

    UnlockedSecrets 14 hours

    Not at all would i ever within the current technology constraints trust a "natural language model" to secure access to my own credentials, i will always keep it as completely isolated from anything at all i would consider 'risky' and pre-define before it begins what it could possibly access through a brand new VM with only the absolute minimal access to any git repo's and completely restrict to the extent that is allowable, it's ability to do anything outside of it's own playground. The playground is disposable, the potential for the LLM to access any of my own accounts and wreak havoc on the trust in my network is unacceptable under any rules....

    drnick1 13 hours

    Do you not find a dedicated UNIX user to be sufficient for the sake of protecting personal files, SSH keys, etc?

    Operyl 13 hours

    It's all fun and games until the model is smart enough to figure out privilege escalation, i.e. a lot of people don't realize Docker enabled on a regular user is enough for privilege escalation if you "follow the tutorials."

    krzyk 12 hours

    Agent that can apt-get is more useful.

    Marauder586 7 hours

    [dead]

    QuantumNomad_ 8 hours

    When I was in university in 2009, the student union I was in had set up their Linux computers with a small program that one of the members wrote, that had the suid bit set and would exec apt-get install passing the arguments along.

    This way, all members of the student union were able to install any software they wanted to on the student union computers without having to give out blanket root access to the members. Only a select few members had full root access.

    There’s other ways to achieve the same too.

    And you can do this exact same sort of thing for the user that your agent runs as too, without having to give it access to do everything that root can.

    ac29 3 hours

    Giving users ability to use apt with root privileges is pretty much game over security wise. Full root is a malicious package away

  • m3h 22 hours

    Z.ai documents integrations with nearly all the popular CLI-based agents: https://docs.z.ai/devpack/tool/others

    If you're already used to your TUI coding agent, you don't need the desktop agent. Although it is nice that it is there for folks who prefer the Codex App/Claude App UI approach.

    Havoc 5 hours

    I believe the incentive here is more tokens. I recall limits being more generous with their inhouse harness

    cpdomina 22 hours

    [dead]

    m3h 22 hours

    Also, kudos to the Z.ai team for adding Linux support from day one.

    InsideOutSanta 22 hours

    Yeah, I use GLM 5.2 in OpenCode, running in a Docker container with CodeNomad as the web-based GUI. It works perfectly; I can access it from anywhere, and it runs all models (except for Anthropic's subscriptions).

    doppp 15 hours

    [dead]

    owentbrown 21 hours

    From your experience, is it comparable to Claude Code with Opus 4.8? How does it feel? How do the two differ?

    InsideOutSanta 21 hours

    It's comparable, but not the same.

    For some tasks, it's better. Opus refuses tasks for me pretty regularly. GLM 5.2 has never refused a task. So for anything security-related or that touches on topics that trigger Opus's safety guardrails, I use GLM 5.2.

    OTOH, for anything related to UI design, I use Opus 4.8. It's much better at taking relatively vague descriptions of user interfaces and a mockup of a related UI and combining them into an immaculate design.

    For anything else, I tend to run tasks in Opus and then have GLM review them and write a Markdown file with anything it finds. Then I have Opus review the markdown file and fix the issues it agrees with. The reason I usually go with Opus 4.8 first is mainly that it's faster. Opus 4.8 is, on average, about twice as fast as GLM 5.2 running on z'ai's infrastructure for the same task. There's a large variance (sometimes GLM 5.2 is pretty fast and Opus 4.8 is pretty slow), but on average it's a very noticeable difference.

    When I run into Anthropic's Quota, I switch to GLM 5.2 rather than Sonnet. I don't think there's much reason to ever use Sonnet for anything if you can use GLM 5.2 instead.

    This is all pretty subjective, of course. On average, I think Opus 4.8 is still a better, more reliable, and faster model, but if it went away tomorrow and I only had GLM 5.2, I wouldn't be too sad about it; I'd get things done with GLM 5.2 just fine.

    sparkling 21 hours

    Thank you, this is the type of hands-on experience report i was looking for.

    andy99 21 hours

    Do you guys use it through open router? Do you have any concerns about how the data you send is being intercepted? Not that I trust Anthropic but it’s widely agreed that it’s kosher to use them for commercial work, I can’t see comfortably sending any customer data to openrouter.

    Edit- I see down-thread you use z.ai directly. Same concern, aren’t you worried about using it for professional stuff.

    InsideOutSanta 20 hours

    I'm worried, but I'm worried about all of these providers. There's a good chance Anthropic and OpenAI will go bankrupt in the next five to ten years, and all of their data will go to the highest bidder.

    There's no customer data sent to anyone, though. I run OpenCode and Claude Code in a Docker container that only has access to a subset of my code base. There are no secrets in there, and I'm vaguely ok with z.ai using this to train their models.

    binarymax 21 hours

    What kinds of tasks does Opus refuse? I’m a light daily user for the past 3 months and Opus has never refused a task for me.

    raesene9 8 hours

    The later Opus models (4.7/4.8), Sonnet 5, and particularly Fable 5 will refuse to do tasks related to offensive security.

    One example I've hit is working on a benchmark of how well LLMs handle Kubernetes security tasks, there's a section on them exploiting security misconfigurations. Opus 4.6 was fine with that section, 4.7 and 4.8 saw some refusals and Fable point blank refused to do any of it.

    The only other model I've seen refuse is OpenAI GPT-5.5, all the open weight models seem fine with it.

    Ofc if you need to do that kind of work a lot you might be able to get on OpenAI/Anthropics allow-list for cyber work.

    InsideOutSanta 20 hours

    One project I have deals with countries, and any time it touches code related to countries, it stops.

    I've also had it refuse security-related tasks, and occasionally it stops without any discernible reason.

    andy99 20 hours

    I’ve never had a refusal coding, and in some areas (AI red teaming specifically) I’ve found it quite good at recognizing and discussing “white hat” stuff that in the past I think would have got refusals.

    But when there was the Hantavirus thing a while back, I asked it if there was a vaccine under development and got a refusal immediately. I’ve had a few like that. It seems they’ve implemented really poor guardrails on certain topics (CBRN and cyber) that have lots of false positives. But if you actually chat with the model itself it’s quite lucid about what is legitimately dangerous and what is just performative “AI Safety” style refusal.

    binarymax 20 hours

    Yeah, I’ve had Opus (and Fable) perform full security audits on my codebases that would run for 30mins. That’s what I think would have tripped it but went just fine.

    vidarh 10 hours

    I had it debug why Firefox crashed on my prototype X11 server and got a refusal when it started digging into what exact payload triggered the crash.

    But that's the only refusal I managed to get.

    InvertedRhodium 19 hours

    Try using it as an agent to perform black box security testing on a live instance of your codebase (assuming it's a hosted service).

    drschwabe 21 hours

    Are you micromanaging your GLM costs? It seems the best bang for buck strategy right now is a Opencode Go subscription to get the subsidized rate and then switch to Openrouter's model above and beyond that + make use of a dual model strategy by having GLM 5.2 do planning and Deepseek V4 Flash for implementation.

    InsideOutSanta 21 hours

    No. I got the yearly highest-end GLM subscription when it was available for a few hundred bucks. I haven't run into quota limits even once.

    drschwabe 21 hours

    Nice, lucky! The Opencode Go GLM 5.2 quota gets used up so fast. It's an expensive model. And while impressive for being open weight, it seems slower than Opus and GPT. So I typically only use it after exhausting quotas of discounted GPT5.5 or Opus 4.6^ paid plans.

    InsideOutSanta 20 hours

    Yeah, it's definitely slower.

  • maxloh 21 hours

    I don't find a closed-source Chinese agent system trustworthy.

    It is essentially a black box with full user permissions, meaning you are just handing over your entire system to a Chinese-owned server. With OpenCode and its GLM provider, at least I can monitor which files were read, which were edited, and what commands were executed.

    Not to mention that Chinese national security laws legally obligate companies to cooperate with state intelligence and counter-espionage efforts [0]. If you have this installed on a corporate workstation, and your company is large enough, the possibility of them spying on you is not just a risk—it's almost a certainty.

    [0]: https://en.wikipedia.org/wiki/National_Intelligence_Law_of_t...

    kordlessagain 20 hours

    Run it in a container under Opencode. It works great, and I even upgraded to their pro plan (~$60/month). If you want it in a container, there's info in my profile under my projects. That code is entirely open source, and it's there simply because I built what I needed for my own work. I'm sure there a zillion other ways to do it. However, I highly advise against running any agent on bare metal, regardless of the company's country of origin. My thesis addresses this directly and repeatedly.

    By the way, some pedant recently asked why anyone would run software with only a few stars. My thoughts on that are minimal: people can practice whatever slop logic they want. I've architected and built systems that handled tens of thousands of users. I'm not fucking around. The way I build isn't typical, and I don't suggest anyone try to mimic my approach, but it works for me and the way my mind processes complex systems.

    To the peanut gallery: use it or don't, but don't give me a hard time unless you're ready to get one back. I've made plenty of mistakes in my career, and accountability is a crucial part of growth. I'm more than willing to work with anyone using my code, provided they bring valid, substantial criticism to the table.

    iberator 10 hours

    NSA can also legally force companies to spy. Secret spy courts and gag orders are a thing.

    Actually there are more such cases against the USA than China in public.

    efficax 20 hours

    yes but the americans are also doing it, and i don’t really work on anything worth spying on

    diego_moita 20 hours

    > It is essentially a black box with full user permissions,

    You mean, like Windows and Android?

    mempko 17 hours

    I'm in the US. The benefit of the Chinese spying on me vs a US company is the Chinese can't come to my door and take me to jail.

    arikrahman 20 hours

    That's why I like to use Reasonix with Deepseek. Hitting cache makes requests basically free and that's through unsubsidized American providers like Digital Ocean or cloudflare.

    d3m0t3p 21 hours

    This is exactly the same with providers from the USA.

    dingdingdang 20 hours

    In a sense it's a clean reminder that all these, especially non-local, llm tools should NEVER run outside a container. I'm currently looking at z-jail specifically for these scenarios; VMs are too heavy & expose too many sec issues of their own for continual integrated use in my case.

    snootypoot 20 hours

    so basically no worse than europe or usa, but they are just more open about it

    tristor 20 hours

    As someone who loves using OpenCode w/ local Chinese open source models, this is basically my take on this as well. There's no way I would ever put a piece of proprietary Chinese software that gets full system control on anything important. This is definitely something I would only ever run sandboxed in a lab environment for toy projects, not for serious work. I feel only marginally better about Codex/Claude Code, hence my strong preference for local LLMs w/ OpenCode, but a proprietary approach to Chinese models is a hard no from me dawg.

    scotty79 20 hours

    How's that different from Codex (gui app) or Claude?

    InvertedRhodium 20 hours

    Codex is open source: https://github.com/openai/codex

    ElFitz 20 hours

    The codex cli too is open source, afaik.

    sejje 20 hours

    Well, it's different from OpenCode

    kachnuv_ocasek 20 hours

    You can always run it in bwrap or rootless podman.

    mrosenbjerg 20 hours

    nono, the sandboxing tool, has been working great for me

    eeasss 21 hours

    If you are not US based that’s not really a big concern.

    ianm218 21 hours

    I think it’s a real concern. Chinese companies are much more closely tied to the state, as in if you decide to go to China one day they might already have all the data on how you have interacted with their models.

    The US is certainly inching in that direction but it’s not like someone from the US government sits at Anthropic’s HQ reading chats from state people of interest.

    saberience 20 hours

    It's interesting how you would say this about China but not about the US, especially given what's happened recently with Anthropic and the US govt.

    Do you really think the US government doesn't get access or couldn't get access to any of your chats with Claude?

    ianm218 14 hours

    Hmm yeah I really think that the US government doesn’t have access to my Claude chats and wouldn’t be able to without jumping through actual legal hoops like a subpoena or other legal order. More than happy to be wrong if you have a source that points in that direction.

    CptFribble 20 hours

    > all the data on how you have interacted with their models

    1) there is a very non-zero chance that the US government also has that data from OpenAI and possibly Anthropic

    2) unless you are asking the chinese models to draw up plans to overthrow the chinese government, it's extremely unlikely they would ever care.

    while china has a track record of harassing it's own dissident citizens abroad, if you're not chinese and not trying to subvert their government (or are a high-ranking government official yourself), it's kind of silly to suppose they would ever care about you or what you do.

    and if you have information they want for their own national development purposes, like EUV engineers, they are much more likely to offer you fabulous amounts of money instead of try to intimidate or threaten it out of you.

    MangoCoffee 20 hours

    to me its more about company's IPs/trade secrets. china have a history of stealing IPs and very poor IPs enforcement while US have an established history of protecting IPs and US court can enforce it but hey, cheap token is more important, right?

    CptFribble 14 hours

    I agree, but considering the age of AI was ushered in with the largest and most complete theft of IP in human history, from inside the good 'ol USA, we shouldn't trust any LLM provider with critical information of any kind, and instead push even harder for better local models.

    even companies that proclaim zero data retention have yet to produce a mechanism that makes me trust that claim

    blitzar 20 hours

    > if you decide to go to China one day they might already have all the data

    PRISM ... XKeyscore ...

    > The US is certainly inching in that direction

    Itching to go in a direction that (publicly known) they have been in for decades now.

    ianm218 14 hours

    The US government is no saint in terms of mass surveillance but there is a gigantic gulf between US governments mass surveillance and China, I think to act otherwise is a bit disingenuous.

    blitzar 1 hours

    Sorry I cant take anyone who keeps a straight face while suggesting one is worse than the other.

    At that point it is not disingenuous, its brain washed.

    LtWorf 11 hours

    At this point i think the china mass surveillance was propaganda while the USA one is for real.

    ahrzb 20 hours

    At least the model weights are open, I’m not American, so to me this is much more trustworthy in every possible way. You’re talking as if US intelligence are the good guys, and to me at least, they are not to any extent.

    galaxyLogic 18 hours

    What can you gain by looking at the weights, whether open source or not? Are they not what determines the model's output, but in an oblique way? We can't really fix the weights ourselves, weight by weight, or can we?

    LeBit 20 hours

    We are talking about an agent harness here, not a model.

    Nevertheless, Americans thinking they are morally superior to China is always quite funny.

    This administration is corrupt, cruel and doesn’t care about human rights.

    And the worst is… Americans have voted for that administration…. twice!

    I digress…

    patrickprunty 20 hours

    How is this an agent harness? It’s the harness and the model if it’s weights

    cheesecakegood 14 hours

    It didn't stop all of Facebook's behavior, far from it, but we did get to see Zuckerberg hauled in front of Senate committees multiple times (who we do vote for).

    This has never happened in China, and will never happen, nor anything like it. Some open oversight is almost always better than possible secret oversight (and do you think that the Chinese government has user privacy on even its top 10 priorities?)

    snootypoot 20 hours

    foolish to blame one administration rather than all administrations since jfk was killed for trying to change things

    dakolli 20 hours

    While Trump is terrible, all the same morally questionable practices existed under Clinton, Bush, Obama, Biden. This administration just likes to brag about it. The US has been controlled by an evil technocracy/intelligence apparatus for 25+ years that gives zero f*ks about democracy or a constitution.

    100721 20 hours

    > all the same morally questionable practices existed under Clinton, Bush, Obama, Biden.

    I’m gonna need a citation on this claim

    dakolli 20 hours

    There's no way to safely use SOTA LLMs if privacy, and IP protection are your concern. Unless you want to spend 100k+ to host a 1T param model. Even if you use OpenCode you're sending all that information to random data centers you know nothing about.

    But yes, US intelligence has killed and ruined the lives of far more people than China has. Not sure how so many people buy into the narrative that they're protecting freedom and democracy.. They're protecting their freedom to kill and crush all their enemies and control every "democracy" on earth.

    andy99 20 hours

    You can run one on a cloud provider. You’re correct that intelligence orgs probably still can access them, but if you’re that high value of a target then you have bigger problems and / or can afford to build an air gapped system or whatever. If you’re just concerned about other companies mining your messages, self hosting in the cloud solves that.

    Reminds me a bit of the old “is your adversary Mossad or not Mossad” decision matrix https://www.usenix.org/system/files/1401_08-12_mickens.pdf

    switchbak 20 hours

    "US intelligence has killed and ruined the lives of far more people than China has" - please provide a strong argument for this statement, with numbers and sources.

    I'm no apologist for the US Intelligence and related organizations (not by a very long shot), but that is a very extreme statement to make.

    LtWorf 11 hours

    You know what's happening in Cuba right now?

    ai_fry_ur_brain 18 hours

    How many Russians, Palestinians, Afghanis, Libyan, Sudanrse, Somalian, Syrians, Iranians and Yemenis people do you think US intelligence has contributed to killing over the last decade?

    Or are those not people to you?

    China doesn't go around the world using it's military to force it's will upon people.

    Every decision the US military, or State Department makes is a product of US intelligence

    The foundation of US Intelligence was built by people who literally cried in the meeting when FDR broke ties with Nazi Germany. They proceeded to pardon and protect the perpetrators of genocide after ww2, then went onto hire them. US intelligence is literally built by Nazis.

    The CCP was founded on the back of a peasent uprusing. The US is the 4th Reich and the most evil government to ever exist. The people of the US are generally good people, but the Empire itself is pure evil that fuels itself with death and destruction.

    seanmcdirmid 17 hours

    > China doesn't go around the world using it's military to force it's will upon people.

    No, they use it on their own people. Come on, the USA is bad, but comparing it to China isn’t going to show the contrast you are looking for.

    LtWorf 11 hours

    I see the USA propaganda is working.

    seanmcdirmid 7 hours

    Thats not propaganda. If you are a Chinese citizen who went through the Chinese Ducati in system, are you telling me they successfully convinced you that nothing happened in 1989? Or more people didnt die in the siege of Changchun than say when Japan invaded nanjing?

    PLA has always been focused on battling other Chinese, it’s literally in its name [the L stands for liberation, it’s still an army aimed at domestic subjugation rather than doing anything abroad).

    Escapado 21 hours

    I agree. I don't find the US competitors trustworthy either. I think open source is the way here.

    simjnd 21 hours

    Thank you. It doesn't make sense to me how much people trust our companies so much more than Chinese ones for no reason. This country has an abysmal track record when it comes to respecting its citizen's rights or privacy. Propaganda working as intended I suppose.

    andy99 20 hours

    It’s not no reason. At a fundamental level I don’t trust the companies any differently. But at a professional level, nobody is going to question my using Claude or OpenAI in a professional capacity - to work on customer projects, analyze their data, etc.

    I also consider Microsoft to be the biggest industrial spy in the world, them and google both are no doubt mining everything you type into office / gsuite, all your emails, etc. But nobody bats an eye when you write a word doc about some sensitive matter.

    If my customers thought I was feeding their data into a Chinese owned LLM API (which to be clear I’m not), I don’t think it would go over well, and I’d be exposed legally to all sorts of things.

    So the reason is risk aversion and desire to participate in US / western commerce. One can debate the actual threat, but why would you ever risk sending your data to a processor perceived as dodgy?

    MaxHoppersGhost 20 hours

    China is still doing horrendous things to its population that the US stopped doing over 100 years ago. Not the same.

    8 hours

    estearum 20 hours

    If you think the US has an "abysmal" track record on this, what words would you use to describe China's track record?

    D2OQZG8l5BI1S06 20 hours

    "abysmal" probably.

    bayarearefugee 20 hours

    Both are abysmal, but as a US citizen bad behavior from Chinese corporations and government is vastly more limited in how negatively it can impact my life in a practical way than bad behavior from US corporations and government.

    Yiin 20 hours

    depends if you look through China citizen point of view or someone in the west

    npongratz 20 hours

    "Abysmal", but that's beside the point.

    Suppose a US citizen, residing and working in the US and never traveling to China, crosses The Powers That Be. Which Power is more likely to do worse things to said citizen? Pretty unlikely they'll be rendered to one of the illegal Chinese jails in Brooklyn, more likely they'll be sent to Gitmo or a black site.

    londons_explore 20 hours

    This. For a typical citizen, your own government is a far bigger threat than a foreign one.

    That's why, all other things equal, I try to keep my own government happy or ignorant, but don't really mind what I share with foreign governments, especially ones who won't forward the info to my own government.

    estearum 20 hours

    That's actually not beside the point as it relates to GP's comment.

    Natfan 20 hours

    also abysmal. two things can be bad at the same time

    pkulak 20 hours

    Yeah, but if you reach for the top shelf every time you need a word, you can't compare things anymore.

    froh42 20 hours

    But really, where is the difference in data misuse from the US and China? Because the US has been "friends" in the past?

    simjnd 8 hours

    It's far from the top shelf, and even then I can totally still compare. I would say the very concept of privacy (at least when it comes to digital presence) does not exist in China. There are no expectations of privacy and if you need it you have to circumvent the rules.

    This is worse don't get me wrong. But doesn't take away anything from the fact that the case here is indeed abysmal.

    Surprises me that on Hacker News of all places, where people are tech-literate and educated, people still seem to trust our companies and governments as if they didn't have an established track record of spying and screwing us over.

    preg_match 20 hours

    It’s just a coincidence that both the US and china have the absolute worst privacy concerns. They are the top shelf IMO. Comparing them I’d say they’re about equal, really, especially once we consider the financial sector and credit.

    estearum 20 hours

    lmfao

    You know you're sitting here on the open Internet complaining about the US government with literally zero fear of any repercussions in any sense whatsoever?

    You should go to an actual authoritarian country and just ask someone their opinion on their government.

    The difference between flippant, hyperbolic complaining (you) and someone who will actually glance over their shoulder and totally clam up in response to that type of question is quite chilling in reality.

    simjnd 8 hours

    The fact that (for now) there are no consequences has no connection to the original point about privacy.

    The fact that China acts punitively with the data they gather on their citizens, and the US does not (yet), doesn't change at all the fact that the US actively harvests that data in a very aggressive way.

    There may or may never be a time where the US starts acting on it, covertly or openly. But still, they're siphoning all of my data, and all of yours too and I don't see why we are downplaying it by saying it's worse elsewhere.

    estearum 4 hours

    Of course it's relevant!

    A country that siphons up data and then arrests you for saying mean things about Dear Leader is a lot, a lot worse than a country that siphons up data and then basically can't do anything with it.

    I don't think it should be downplayed, but it certainly isn't the same. It just isn't. It's ridiculous and counterproductive to describe it as such.

    LtWorf 19 hours

    Perhaps you have not heard of Francesca Albanese?

    USA government does repercussions, severe ones.

    estearum 19 hours

    Wow, is GP afraid of being sanctioned?

    Big if true, but I doubt it.

    LtWorf 11 hours

    Are you afraid of making sense?

    preg_match 19 hours

    The US is not authoritarian. But in terms of surveillance and privacy violations, we’ve really pushed it to the absolute limit. All of your communications are effectively tapped, especially since the US government can coerce private companies without letting you know.

    There are very few exceptions, and of those that exist virtually all are under existential threat constantly.

    estearum 19 hours

    [flagged]

    LtWorf 11 hours

    Which government are these? The ones you just made up?

    estearum 4 hours

    Have you never heard of the Taliban?

    Or, you know, our beloved and enlightened ally Saudi Arabia who hacked a journalist to death for mean words?