I’ve done this (asked a frontier model red team my server), and it just gave me false alarms that I went investigating and weren’t really issues (would’ve been an issue if I had a very specific configuration, but not generally). They produce a lot of noise, so you still have to somewhat understand what you’re looking at/for. It didn’t find any legitimate issues, which is good I guess.

Governments are captured by these companies. Any regulation would undoubtedly benefit these companies at the peoples expense. Right now, the best solution is probably open research and open weight models to keep the field level.

In my experience (of having my office 2-doors down from the CEO of a minor public company), most of his “work” was just meetings with other CEOs and execs over breakfast, lunch, dinner, golf, etc to discuss business deals, acquisitions, and such. Not sure how an AI could do that, as it was mostly a social/class/nepotism thing.

The “best” one I’ve tried is the latest Opus. I don’t trust any of them to use for real work, so I mostly just play around with a local Qwen 3.6 27B or Deepseek v4 Flash. I have heard OpenAI’s latest models produce less bloat than Anthropic’s.

I should say I do find LLMs useful as a kind of search agent (both web and large unfamiliar code bases). And GhidraMCP is pretty cool (maybe just because I don’t have much experience with reverse engineering).

I think they could significantly lower their costs if they turn their focus away from the race to “AGI.” But, their valuations don’t really make sense unless investors believe they will achieve AGI.