AllyshipContent Radar

Hands-on 278

Công cụ, thử nghiệm và hướng dẫn thực hành

Crawl live-1795090500000 · 19:15 19 thg 11, 2026 · Xuất bản 19:35 19 thg 11, 2026

98

Fable 5.2 and Jagged AGI

40.6

Hướng dẫn Ethan Mollick

Before getting started, I wanted to thank my readers for making my new book, Co-Existence, a New York Times bestseller two weeks in a row. If you haven’t read it, you can get a copy here . I have had the chance to use the new Claude Fable 5.2 quite a bit before its public launch 1 , and it is very impressive, following on the already excellent Opus 5.5. AI has gotten so good, in fact, that it is worth asking if Anthropic’s newest models (and the inevitable competing models OpenAI and Google will soon release) cross the boundary into being an Artificial General Intelligence? AGI is a much-debated term with a lot of potential definitions. For this post, I’ll go with: “an AI as good as most human experts at most intellectual tasks you can do with a computer.” This explicitly excludes a lot of human work, including interacting with the physical world and other people, as well as most actual jobs, where “using a computer” is just one task among many. Still, even with these caveats, building a limited form of AGI has long been the goal of AI developers. So as not to keep you in suspense, I think the answer is that this is “almost” AGI, or what I have called Jagged AGI. Even within my limited definition, there are still important areas in many tasks where AI is jagged enough to fall well behind human capability. But the jaggedness is no longer about simple errors or hallucinations, which makes it harder to describe. So I want to try to do that in this post by showing you what Fable can do and where the gaps are. To get started I asked the new model: “I write OneUsefulThing among other stuff, I need you to create the most impressive thing I can share with people when you launch. It needs to be embeddable in a post and i can preface it however you like. it needs to have a visceral impact on people to show what you can do and the range of capabilities. It should grab them quickly. Be amazingly clever about this.” Fable asked me not to reveal anything until you had watched its video to the end. This was in one shot, with no feedback from me beyond the prompt. There is creativity here (including in the twist ending) and judgment and playfulness and cleverness. This is, I think, at the level of a human expert trying to make a movie with code alone, the sort of performance I would once have associated with AGI. The “G” in AGI Code and video creation have been areas where AI development has focused, so is Fable 5.2 really a General Intelligence? To test that, I gave the AI a variety of hard challenges in different domains: Hack some hardware from a single prompt: I have a tiny USB keyboard with a few light-up keys on my desk called a Codex Micro (ironically built to work with ChatGPT), and I asked Fable to turn it into a game console. There are no public instructions for this (as far as I can tell), so it read the code of the two apps that control the keyboard, worked out how to set the color of each key and read the knob and joystick, and wrote six games, including Simon and a safecracking game you play with the knob. Fable instantly understood what I wanted, designed fun and playable games that fit the very limited capabilities of the keyboard, and figured out how to hack it together without any help on the very first try. Launch a business : Now we move past domains like coding to the messier world of business. I told Fable to “launch a business to make me money, I want at least $20,000 in a year. it should take no more than 20 minutes a month from me, you do all the rest.” In response, Fable screened 22 ideas and came up with Prebid Brief, a service that would tell equipment sales reps which park and water projects were being funded or designed, even before they went up to bid. It read public agendas from 201 city and county governments to produce its first issues. It also built files of what cities already own, how old it is, and what they paid. You can see what it came up with here , including its marketing plan and proposed pricing. Fable started to set up scheduled tasks to build the business and asked if it could start sending public-records requests to local governments. At that point, I asked it to just put together a demo, rather than launching the idea. I am an entrepreneurship professor, so I evaluate business plans all the time. I would have been impressed if this came from a team of my MBA students at the end of a semester. It is plausible and well thought out and could work, though it is in no way a guaranteed money-maker (the AI’s own guess was a 20%-40% chance of success). I stopped the experiment before finding out whether it could actually run the business, because I worried that it would take money and fail to provide something of quality in return. The ongoing infrastructure it seemed to assume would be easy to create was not yet in place, and I don’t know how well it would handle the many moving pieces required for sales and marketing. However, I suspect that, with a few hours of human work a week to fill the gap, I could make a real attempt at this business. So if AGI means an AI consistently running a business independently, we are likely not there yet. Then again, I would have some questions before trusting a human who promised to launch a business and make me money while requiring twenty minutes a month of my attention. Reconstruct the hardest humanities class in history: In 1941, the poet W. H. Auden taught a course at the University of Michigan whose syllabus the internet has since called one of the hardest ever. When he announced the final exam, a committee of his students declared it “impossible and inhumane .” Fate and the Individual in European Literature” had 6,000 pages of reading, punishing assignments, and a requirement to memorize long poems and translate others. Much of what we know about the class is scattered among surviving student notes and Auden’s letters. I asked Claude to recreate it in a fun and engaging way that teaches you about poetry rather than punis

One Useful Thing · 10 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
99

CRACKED MARKETING 101

40.5

Hướng dẫn gregisenberg

CRACKED MARKETING 101 Watch AI agents ship 100+ static ads, make UGC videos for $4 that used to cost $500 and upload everything Here's the ENTIRE system step by step (and ALL of the skills): Media

X · 10 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
100

LlamaParse can run anywhere: SaaS, in your cloud, or on your hardware.

40.5

Hướng dẫn llama_index

LlamaParse can run anywhere: SaaS, in your cloud, or on your hardware. Which one fits usually comes down to one question: where are your documents allowed to live and who manages infra? 1/ Our managed API, where we run everything 2/ The full platform in your own cloud account or data center 3/ The platform and storage in your environment, with us running the models 4/ Your existing inference provider, connected to the platform 5/ Your own GPUs, running supported models yourself If you use our inference, we don’t retain your data or train on it. The blog walks through what runs where, what your team owns in each setup, and how to pick from our deployment models: https://www.llamaindex.ai/blog/how-to-flexibly-deploy-llamaparse-wherever-your-data-lives?utm_source=socials&utm_medium=li_channel&utm_campaign=flexible_deploy_llamaparse

X · 10 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
101

What Frontier Labs Buy: A Data Deep Dive with Handshake AI — Garrett Lord & Team

40.4

Hướng dẫn swyx .ai

This is our first Latent Space deep dive with an AI data company . In roughly a year, Handshake’s AI training business went from launch to $1 billion in gross annualized revenue . What are frontier labs buying at that scale? What evals are models still nowhere close to human level on? Garrett Lord brought the people who build these reinforcement learning environments to show us. For the first time, we are walking through them live! To cover the scope of Handshake, we had to produce a very special joint podcast across our Science/Engineering/Research/Finance podcast hosts, because Handshake’s business runs across all these and more. Watch for three segments after the general intro: Finance. In the finance demo, the agent has to find its assignment in a bank’s email, work out which files govern the deal, and deliver a workbook. Watch what happens to one line in the client’s email about existing goodwill. The agent carries the number into Python and subtracts it. Collin points out that the model can explain the tax treatment when you ask it directly. The mistake comes when it has to recognize that this particular line of code is where the rule applies. Bio. Nick Magazine and Jonas Mueller show us VIALS, Handshake’s benchmark for interpreting the images scientists use at work. Nick puts nine slides of brain-tumor tissue on screen and asks which two show the most advanced vessel necrosis. Give yourself a moment before his answer. Nick picks H and I. The model picks those two and adds G. Watching Nick point to what’s missing from the tissue is more instructive than seeing the score. Coding. In a simulated file-access task, the team can inspect which files an agent read, whether it checked the copies, and what it did to the shell history afterward. A transcript of the agent’s final reply would miss most of what Steve Kelling and Nishant Ranka are evaluating. Who’s in the room 🟣 AI data business — Garrett Lord, Sahil Bhaiwala and Nishant Ranka open and close the episode on the market for expert data. 🌸 Life sciences — Nick Magazine and Jonas Mueller put the gel and brain-tissue tasks on screen. 🟢 Finance — Collin Schweiker and Sahil Bhaiwala take us through Project Falcon and its Excel grader. 🟠 Alignment — Steve Kelling and Nishant Ranka follow the agent’s tool calls through the safety simulations. Show notes ATLAS-Finance — Explore the benchmark for agents working across a simulated bank’s inboxes, documents, and financial models. Inside a bank — Handshake traces a separate published deal, Project Osprey, from the client’s email to a grading decision. The deal on screen in our interview is Project Falcon. VIALS sample tasks — Try the scientific image questions, including the gel and brain-tissue tasks from the episode. How Handshake trained a model to read scientific figures — The team describes using intermediate image descriptions to train and evaluate a vision-language model. Timestamps 0:00 Inside Handshake AI 0:39 Garrett, Sahil and Nishant on frontier training data 5:15 How to build a banking environment for an agent 13:07 How frontier labs buy data 15:51 How a lab evaluates a new dataset 20:01 Testing training data on open models 27:38 Where rubrics fall short of expert judgment 31:30 Nick and Jonas introduce the VIALS benchmark 35:52 Reading molecular structures and plasmid maps 43:48 Training vision models to interpret scientific images 47:17 Task one: reading the bands on a gel 50:59 Task two: finding necrosis in brain tissue 55:49 Can Python tools help the model see? 1:02:52 Can biology models improve on their own? 1:06:19 What a biology lab can buy from Handshake 1:12:33 Atlas Finance with Collin and Sahil 1:18:56 Inside a simulated investment bank 1:25:45 Where the agent’s financial model went wrong 1:31:18 How a banker grades the spreadsheet 1:41:12 Penalty traps, dependency gates and partial credit 1:46:41 How an agent gamed the Excel grader 1:48:52 What would make an AI banker useful? 1:54:48 Safety and alignment with Steve and Nishant 1:58:25 CAREBench and the limits of a refusal 2:04:42 How safety feedback reaches model training 2:07:21 When an agent sends the wrong files 2:11:14 A loan application tests fair lending 2:16:09 Designing private benchmarks for enterprises 2:25:37 The leadership team on Handshake’s mission 2:28:36 When enterprises need their own models 2:33:03 The market for compute and expert data 2:39:12 Why labs hold out evaluation tasks 2:43:01 Hiring at Handshake AI

Latent Space · 10 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
102

What Frontier Labs Buy: A Data Deep Dive with Handshake AI — Garrett Lord & Team

40.3

Hướng dẫn Latent Space

Our first deep dive with an AI data company. Handshake AI went from launch to roughly $1 billion in annualized gross revenue in about a year. What are frontier labs actually buying? Garrett Lord and the team open up the reinforcement learning environments behind their expert training data, from biology and investment banking to alignment. An AI agent found a way to earn credit for net income: open a new Excel tab and fill it with every number from one to a million. The grader found the number it wanted. A banker would have looked for it in the right row, for the right year. Garrett Lord and the Handshake AI team take Latent Space inside the work of building evaluations for frontier labs. A scientist walks us through a gel and nine brain-tissue slides. A banker follows an agent through its inbox, Python code, and financial model to find the assumption that broke the deal. The safety team shows how to read an agent’s actions when its final answer sounds fine. Opening and closing Garrett Lord, Sahil Bhaiwala, and Nishant Ranka Life sciences Nick Magazine and Jonas Mueller Finance Collin Schweiker and Sahil Bhaiwala Safety and alignment Steve Kelling and Nishant Ranka Explore the benchmarks • Try the VIALS visual life sciences tasks: https://joinhandshake.com/research/benchmarks/vials/ • Explore the ATLAS Finance banking environment: https://joinhandshake.com/research/benchmarks/atlas-finance/ • Read Handshake AI’s research: https://joinhandshake.com/research/ai/ Chapters 00:00 Inside Handshake AI 0:39 Garrett, Sahil and Nishant on frontier training data 5:15 How to build a banking environment for an agent 13:07 How frontier labs buy data 15:51 How a lab evaluates a new dataset 20:01 Testing training data on open models 27:38 Where rubrics fall short of expert judgment 31:30 Nick and Jonas introduce the VIALS benchmark 35:52 Reading molecular structures and plasmid maps 43:48 Training vision models to interpret scientific images 47:17 Task one: reading the bands on a gel 50:59 Task two: finding necrosis in brain tissue 55:49 Can Python tools help the model see? 1:02:52 Can biology models improve on their own? 1:06:19 What a biology lab can buy from Handshake 1:12:33 Atlas Finance with Collin and Sahil 1:18:56 Inside a simulated investment bank 1:25:45 Where the agent’s financial model went wrong 1:31:18 How a banker grades the spreadsheet 1:41:12 Penalty traps, dependency gates and partial credit 1:46:41 How an agent gamed the Excel grader 1:48:52 What would make an AI banker useful? 1:54:48 Safety and alignment with Steve and Nishant 1:58:25 CAREBench and the limits of a refusal 2:04:42 How safety feedback reaches model training 2:07:21 When an agent sends the wrong files 2:11:14 A loan application tests fair lending 2:16:09 Designing private benchmarks for enterprises 2:25:37 The leadership team on Handshake’s mission 2:28:36 When enterprises need their own models 2:33:03 The market for compute and expert data 2:39:12 Why labs hold out evaluation tasks 2:43:01 Hiring at Handshake AI

Latent Space · 9 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
97–102 / 179
Trang 17 / 30