Posts

Featured Post

The Coming Split in AI Software Engineering

Image
  Copyright: Sanjay Basu AI Native IDEs versus Agentic Operating Systems I am on my way to NVIDIA GTC 2026. Every year this event marks a kind of geological boundary in computing. The ground shifts. Quietly at first. Then all at once. This year feels different. Not because of one product. Because of what the full arc of NVIDIA’s hardware story is now telling us. From a desktop sitting on your workbench to a rack in a hyperscaler’s facility to a next-generation chip that has not yet shipped, the story is the same. The infrastructure for intelligence is being built at every altitude simultaneously. And the software world has not caught up to what that means. But it is going to change. Lots of amazing announcements from NVIDIA next week at GTC! From the Desk to the Data Center The DGX Spark is the most interesting product NVIDIA has announced in years. Not because of raw performance. Because of what it represents philosophically. A local desktop. With serious AI compute. Sitting next ...
Post a Comment
Read more

Dan Simmons and a review of Song of Kali

Image
  Copyright: Sanjay Basu
Post a Comment
Read more

The Memory Wall Everyone Is Talking About

Image
Copyright: Sanjay Basu HBM3e, CXL, and the Multi-Tier Memory Hierarchies Shaping AI Infrastructure Every year, NVIDIA announces another doubling of tensor core FLOPS and the industry collectively loses its mind. We obsess over peak compute throughput like medieval monks counting angels on pinheads, marveling at the petaflops while ignoring the elephant in the server room. The dirty secret of modern AI infrastructure is that all those magnificent floating point operations spend most of their time waiting for data to show up. This is not a new problem. In 1977, John Backus stood before the ACM to accept his Turing Award and delivered what should have been a prophetic warning. He described the von Neumann bottleneck as a "literal bottleneck for the data traffic of a problem" and, more provocatively, as "an intellectual bottleneck that has kept us tied to word-at-a-time thinking." Nearly fifty years later, we are still fundamentally constrained by how fast we can sho...
Post a Comment
Read more

The Dragon in the Garage and the Age of Infinite Certainty

Image
  Copyright: Sanjay Basu Carl Sagan gave us one of the cleanest mental tools ever built. It looks simple. Almost childish. A person says there is a dragon in the garage. You go to see it. You find nothing. Then the claims begin to shift. The dragon is invisible. It floats. It breathes heatless fire. It leaves no tracks. It cannot be detected by any instrument. Every test fails. Every test is answered with a patch. At first it sounds like a joke. It is not a joke. It is a diagnosis. Sagan was not merely making fun of superstition. He was doing something harder. He was showing how bad thinking survives. He was showing how belief protects itself when reality refuses to cooperate. That little dragon has grown up since Sagan wrote about it. It now has Wi Fi, a ring light, and a premium subscription. It lives on social media. It appears in politics. It appears in health claims. It appears in investment scams. It appears in AI hype. It appears in our family WhatsApp groups before breakfas...
Post a Comment
Read more