WatchDog's comments

On: 245TB Micron 6600 ION Data Center SSD Now Shipping

[WatchDog]

Would like to see what the internals of this look like, how many flash packages and PCBs are in that tiny chassis?

On: DeepSeek V4 – almost on the frontier

[WatchDog]

Yes, you have to use the same session, I guess you could load up a bunch of context, then fork the session into a few different tasks, although I haven't tried it.

On: UAE to leave OPEC

[WatchDog]

Foreign assets are only as good as your alliance with those foreign nations.

When you lose your only bargaining chip(oil), things start to look dicey.

[winter_blue → WatchDog]

You're implying that the U.S. securities worth hundreds of billions held by a nation will be under threat of theft (by the U.S. government itself?) because the nation doesn't "have bargaining chips"?

So the U.S. will begin to rob and plunder the bank accounts of countries that don't have a bargaining chip?

Is that where the U.S. heading? The daylight roberry of the bank accounts of foreigners?

[chii → winter_blue]

The Russian reserves are taken just as you described. The trust is eroded by a bit, despite the general acceptance that it was justified.

On: GitHub Copilot is moving to usage-based billing

[WatchDog]

I'm at an org, where every medium to large company meeting talks about AI in similar breathless non-specific terms, yet m365 copilot is the only approved AI chat, and GH copilot the only AI coding tool.

On: To my students

[WatchDog]

It's that but also the narcissistic injury caused by seeing an LLM practice the craft you have spent your life trying to perfect.

On: I am building a cloud

[WatchDog]

I relate to the points about obscure platform limits, and leaky abstractions, but when I look at the exe.dev platform, it might be the most obscure PaaS I've seen, and has it's own strange abstractions.

The shell command to start a new vm, has a --prompt flag to get an LLM to configure the VM for you.

VM's have no public ipv4 IP, and the ipv6 IP doesn't seem to allow incoming connections.

The only supported inbound connections are via their HTTP proxy.

There is no private networking.

At first I interpreted the complaint about cloud providers not offering nested-virtualization, as something he intends to address by offering it as a feature, but no, instead he means that exe.dev's VM abstraction eschews the need for it.

[neom → WatchDog]

Yeah I had a giggle about that also. He argues: “cloud abstractions are the wrong shape”, then what they actually ship is: a different abstraction, with even more hidden constraints.

I'm very curious how they deal with subscription levels/noisy neighbors.

On: Over-editing refers to a model modifying code beyond what is necessary

[WatchDog]

How do you collect these stats?

Is it by characters human typed vs AI generated, or by commit or something?

[Swizec → WatchDog]

> How do you collect these stats?

Cursor dashboard. I know they're incentivized to over-estimate but feels directionally accurate when I look at recent PRs.

On: Ternary Bonsai: Top Intelligence at 1.58 Bits

[WatchDog]

All of their benchmarks are against 16 bit models right?

Why aren't they comparing to 2/3/4 bit quants?

[himata4113 → WatchDog]

looked at quant versions of these models and they all outperform it so I guess it just doesn't look as good.

On: Do you even need a database?

[WatchDog]

It's also just wrong, their SQLite benchmark is only using a single thread for the SQLite connection. It's much faster with multiple connections.

On: Darkbloom – Private inference on idle Macs

[WatchDog]

I installed two models, but it just always reports:

    Available models (2):
    CohereLabs/cohere-transcribe-03-2026 (4.6 GB)
    flux_2_klein_9b_q8p.ckpt (20.2 GB)
    ...
    Advertising 0 model(s) (only loaded models)

Also the benchmark just doesn't work.

Interesting idea, but needs some work.