Posts

Featured Post

The CPU Tier for Agents and Small Language Models

Image
  Copyright: Sanjay Basu Which Agents and Which Small Models Actually Belong There Treat this as A field guide to running agentic AI on OCI compute without touching a GPU. I published a piece a couple of weeks ago on running inference on the X12 Standard Acceleron shape with Intel Xeon 6 and AMX. Here is the link — https://blogs.oracle.com/cloud-infrastructure/run-ai-inference-without-gpus The response split cleanly into two camps. Half the readers wanted the benchmark methodology. The other half asked a better question — ‘fine, the silicon works, but which agents and which models am I supposed to put on it?’ That is the harder question, and nobody has written it down properly. So here it is. This is not an argument that CPUs replace GPUs. I ran one of the larger GPU fleets in the industry, and I have no interest in pretending otherwise. It is an argument that a large fraction of what enterprises currently route to an NVIDIA H200 or NVIDIA B200 or AMD MI355X has no business being...
Post a Comment
Read more

What Vinge Saw

Image
  Copyright: Sanjay Basu Vernor Vinge died in March 2024, a year after GPT-4 was released and six months before OpenAI released the first widely deployed reasoning model. He was 79. He had spent most of his adult life either writing about the arrival of superhuman intelligence or teaching mathematics to people who would help build it. The timing is worth sitting with. He did not miss the singularity by decades. He missed it by weeks. Most obituaries mentioned the 1993 essay. Some mentioned True Names . A few mentioned Rainbows End . Almost none tried to say what he had actually gotten right, because doing that requires reading four books written across twenty five years and holding them in the same head at once. I want to try. True Names, 1981 True Names is a novella about hackers who meet in a shared virtual space and hide from a government that wants to find them. The word “cyberspace” would not exist for another year. The dominant reading, then and now, is that Vinge predicted ...
Post a Comment
Read more

A Lens With Two Substrates

Image
 What J-Lens Would Have to Become to Read a Hybrid Quantum-Classical Mind A Technocrat's Discernment. July 9, 2026. Third in a series with "The Jacobian in the Mirror" and "Quantum in the Loop." The first piece asked whether Claude is thinking. The second asked whether the substrate matters. This one asks the practical follow-on: if we do end up with hybrid quantum-classical systems, whether in five years or fifteen, how would we look inside them? What would an interpretability tool have to be able to do to answer the same questions the J-lens is answering now? I want to work through this carefully because most of the writing on hybrid interpretability I have seen so far is either a straight port of classical mechanistic tools to a system they were not designed for, or a hand-wave in the direction of quantum tomography without engaging what the classical side would need. Both miss the interesting problem. The interesting problem is what happens at the seam. Let ...
Post a Comment
Read more