AllyshipContent Radar

Deep dives 738

Paper và bài viết kỹ thuật

Crawl live-1795068900000 · 13:22 19 thg 11, 2026 · Xuất bản 13:30 19 thg 11, 2026

Kỹ thuật

Elon Is Doing It Again: SpaceX Will Be The World’s Biggest AI Cloud

Câu hỏi For example, did you know TeraFab , Elon’s 100M sqft, 10GW+ chip fab project in Texas, will likely also have a datacenter?

We wrote at length about how SpaceX’s plans for 10GW in 2027 was feasible , paving the way for 300b+ ARR. We received a lot of pushback from folks calling it impossible. Now, just two months later, we’re already seeing 3.6GW under construction across multiple sites, both existing and new . SpaceX has even revised its estimate up to ~13GW in 2027. This would be the largest amount of datacenter capacity ever built by any one company in that timeframe, roughly equivalent to all of Google’s datacenter capacity from 1999-2026 in just 1.5 years. We think it’s possible and have already identified >9GW of capacity. Source: SemiAnalysis Datacenter Industry Model We’ve since written multiple update notes to our Datacenter Industry Model subscribers showing off all the sites that can make this possible. We now believe that SpaceX may be the fastest datacenter builder in the world , even more so than Chinese peers . Watch how Colossus 2 adds nearly two Stargate Abilenes (2GW) in just under one year! Source: SemiAnalysis Datacenter Industry Model These sites now build so fast that the power supply is often identified mid-flight. Looking at our Energy Model , we see that power under Elon’s management (>8GW) is less than our total datacenter power coming online (>9GW). Source: SemiAnalysis Energy Model Datacenter Industry Model subscribers knew all of this before anyone else. On June 23, we sent our customers information on the infamous Elon “10GW in 2027” statement on SpaceX’s first earnings call by six weeks, pointing out a 5-10GW incremental order for 2027 was floating around the supply chain and that a new building was already under construction at Colossus 2, now publicly known as “MiniHard.” On September 14, before a single datahall went vertical, we identified >2GW of fresh sites , both at Colossus 2 and SpaceX’s Starbase campus. Starbase, Texas, October 29th, 2026; Source: SemiAnalysis Datacenter Industry Model The Elon locations have a pioneering track record with us. We called Colossus 2 the first gigawatt datacenter in the world back in September 2025, when onsite gas was called a science experiment . We showed exactly how xAI bypassed the grid (and permitting!) with truck-mounted turbines, why the behind-the-meter playbook was going to spread to 40GW+ of behind-the-meter datacenters by 2028 , and how the Anthropic and Google deals turned SpaceX into the most profitable neocloud on earth . Now, Colossus 2 could soon house the largest BESS deployment in the world, with 5.9GWh already being installed, and more to come. Source: SemiAnalysis Datacenter Industry Model This report unveils our analysis of SpaceX’s “proprietary plan.” From repurposing Starship’s rocket building and launching campuses into datacenter sites, to the gargantuan BESS deployment , buying out homeowners to house construction workers, and relocating mobile turbines, this report covers it all. For example, did you know TeraFab , Elon’s 100M sqft, 10GW+ chip fab project in Texas, will likely also have a datacenter? See the clip below of SpaceX representatives talking to Grimes County officials. Source: Local Filings Keep reading to find out why we think the TeraFab datacenter will be for third party renting! Subscribe now And beyond the paywall, we dive deeper into the likely SpaceX power solutions, another site that may house a datacenter, and potential pricing for future SpaceX contracts, build off our proprietary SpaceX Funding Model as part of our Capital, Compute and Markets model. Fastest Build Times In The World What does building two Stargate Abilenes in one year look like? Let’s talk about the Colossus expansions, where Elon is already trying to buy hundreds of nearby homes to both soothe noise complaints and provide construction worker housing . We’ve already spoken about MiniHard in Memphis finishing construction in just ~5 months, but the newly purchased “Gun Range” plot just south of the state line in Mississippi will take ~4 months! “Gun Range,” Colossus 2, October 28th, 2026; Source: SemiAnalysis Datacenter Industry Model To our knowledge, this would be the fastest greenfield datacenter ever built at scale. While most are fighting for 8-12-month build times, SpaceX has cut them in half. Looking closer at Colossus 2, we see SpaceX trying to break its own record again. SpaceX’s first retrofit at Colossus 1 took 122 days for 150MW, and Colossus 2 took just 91 days for 210MW. Now, SpaceX has taken the building (codenamed Project SPAM) directly in the middle of Colossus 2, and targets December to bring its first tranches online. With a construction start date of October 5, 2026, this could be shorter than the 91-day record, which itself broke the 122-day record; both are held by SpaceX. “Project SPAM,” Colossus 2, Mississippi, October 28th, 2026; Source: SemiAnalysis Datacenter Industry Model ; Note the Megapacks and Chillers already being deployed! Colossus expansions were to be expected, but repurposing sites from Elon’s other ventures was not. For example, many are familiar with Elon’s Starbase in Texas, traditionally used for rocket building and launching. However, as flagged two months ago to Datacenter Industry Model subscribers , this site will now house two datacenters too! The site went from simply clearing ground at the end of August to full vertical construction by the end of September, and we now believe it will actively fit out datahalls in the coming weeks. Starbase, Texas, October 29th, 2026; Source: SemiAnalysis Datacenter Industry Model At this size, and with the knowledge of a 2027 timeline (meaning Vera Rubins), this site could be well over 1GW! Looking at the datacenter on the right, you can see that the steel mainframe is being built, while the roofing is actively following behind it. And on the left, you can see the transition from dirt to full preconstruction. These are multiple construction processes performed simultaneously, a visual representation of speed. Lastly, we have medium-high confi

Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

v0.40.15-rc0

<p>model: add MiMo V2.6 renderer for Qwen3.5 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6112867838" data-permission-text="Title is private" data-url="https://github.com/ollama/ollama/issues/19400" data-hovercard-type="pull_request" data-hovercard-url="/ollama/ollama/pull/19400/hovercard" href="https://github.com/ollama/ollama/pull/19400">#19400</a>)</p>

Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

v0.40.14

<h2>What's Changed</h2> <ul> <li><code>ollama launch claude</code> now applies the model's output token limit for Claude Code, so cloud models no longer run into the 128k default cap</li> <li>Cloud web search responses on <code>/api/chat</code> are now decoded correctly, including compressed responses</li> <li>OpenAI-compatible endpoints no longer override a model's packaged sampler defaults — clients that send no <code>temperature</code>/<code>top_p</code> get the model's own values instead of 1.0, matching <code>/api/chat</code></li> <li><code>/v1/responses</code> now preserves readable input content, including prior assistant refusals, instead of flattening it</li> <li>Ollama's app can now retry ChatGPT disconnect failures instead of leaving the connection in a broken state</li> <li><code>ollama launch codex</code> verifies ChatGPT routing before configuring, and reports a clear error when routing is unavailable</li> <li>Faster top-k sampling on MLX for large vocabularies</li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/ollama/ollama/compare/v0.40.13...v0.40.14"><tt>v0.40.13...v0.40.14</tt></a></p>

Nguyên văn nguồn
Chi tiết nguồn
  • v0.40.14 ollama/ollama releases · 3 thg 11, 2026
Kỹ thuật

v0.40.14-rc0

<p>server: decode cloud web search responses (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6173517878" data-permission-text="Title is private" data-url="https://github.com/ollama/ollama/issues/19476" data-hovercard-type="pull_request" data-hovercard-url="/ollama/ollama/pull/19476/hovercard" href="https://github.com/ollama/ollama/pull/19476">#19476</a>)</p>

Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

Diagnose Distributed AI Workload Failures with NVIDIA Attribution

In distributed AI workloads, a single error can produce a cascade of symptoms. A GPU or fabric event may surface as NCCL errors on other ranks, scheduler state... In distributed AI workloads, a single error can produce a cascade of symptoms. A GPU or fabric event may surface as NCCL errors on other ranks, scheduler state changes, and thousands of downstream messages. The reported exception shows where the workload stopped, not where the failure began. In this post, you’ll learn how to run NVIDIA Attribution on sample workload evidence… Source

Nguyên văn nguồn
Chi tiết nguồn
Huấn luyện

Keep Distributed Training Running with Automated Workload Recovery

As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast, reliable recovery... As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast, reliable recovery essential. A stalled training rank can trigger an NVIDIA Collective Communications Library (NCCL) timeout, a GPU node can stop responding to the scheduler, or a straggler can slow the entire job. Each disruption is manageable on its own… Source

Nguyên văn nguồn
Chi tiết nguồn
Kiến trúc

Building Legal Agents When You Can't See the Data — Jacob Lauritzen, CTO of Legora

Câu hỏi How do you build and test an agent when you can’t see its work?

Legora can’t read a single trace of what its agent does for a lawyer. The data belongs to the law firm’s clients. How do you build and test an agent when you can’t see its work? Jacob Lauritzen is the CTO of Legora, one of the fastest-growing companies in legal tech history. The team started in a Stockholm basement with ChatGPT, Swedish law, and a search tool. Today, a lawyer can use Legora to draft and edit Word documents, review 10,000 contracts in a single table, or run due diligence. The agent also coordinates work between lawyers, clients, and other agents. When Legora made its own acquisitions, the team used it for diligence. What we talked about • Why Legora resisted adding a model picker for years, and why it finally added one • Jacob’s estimate that models already do about 60% of legal work well, and why the rest takes a smarter model • How three engineers and three lawyers build test environments modeled on customers’ work, much like the “worlds” used in reinforcement learning • A citation problem where the model got it right 70% of the time, then 99% after one release. Legora didn’t have to change anything. • Why Legora runs everything on Azure and why it doesn’t use ElevenLabs • Tabular Review, the million-cell spreadsheet the industry copied down to the name • How intake works, how agents create lists, and how a list can start another agent • What legal engineers and forward-deployed engineers each do, and who gets to write code • The 300 Spartans slide Jacob used to argue that 20 engineers would be enough forever. Now there are 100, and he still feels short-handed. • Why Jacob finds Fable and Opus too chatty for drafting and likes Astra’s concise writing • Why drafting a long contract is a search problem • Whether model labs will cut off legal tools the way they cut off coding tools • What happens to law firm partnerships, the billable hour, and jobs for junior lawyers Legora is hiring engineers in New York, Stockholm, and London. Chapters 0:00 Cold open 0:40 Meet Jacob Lauritzen, CTO of Legora 1:05 Starting out as underdogs in a Stockholm basement 1:54 How Legora grew from ChatGPT with Swedish law into a legal agent 4:12 The switch from assistant to agent 5:23 Which models Legora uses and why it added a model picker 7:48 Are today’s models good enough for lawyers? 8:20 What agents couldn’t do nine months ago 9:18 Testing the agent in simulated worlds and a 10,000-file data room 10:07 The evals team and Legora’s 100 legal engineers 11:03 When evals didn’t seem worth it and one release took citations from 70% to 99% 12:18 What legal practice could look like in five to ten years 14:18 Will the law firm partnership model survive? 16:40 What happens to paralegals and junior lawyers? 18:00 The billable hour and why earlier legal tech fell short 19:39 Where the money goes now 22:44 How Legora used its own product for acquisition diligence 23:59 How Swedish and American law firms differ 26:12 Product metrics when you can’t read the traces 27:41 Paraphrasing traces and narrowing failures down to 10 or 20 types 28:42 Why data privacy led Legora to run everything on Azure 30:04 Open-weight models and model arbitrage 30:55 Transcription models and why Legora doesn’t use ElevenLabs 33:33 The agent, Tabular Review, projects, and the Word add-in 34:24 How a lawyer uses Tabular Review 35:51 Why a spreadsheet works and what you learn from the first 10 rows 37:53 How the legal intake bot works in Slack 39:11 How agents create lists and lists start agents 40:15 Building products on those same pieces and acquiring Wexler 42:37 What forward-deployed engineers do at Legora 43:52 How legal engineers and forward-deployed engineers onboard a big client 46:43 What’s next for the forward-deployed team over the coming year 47:24 Why Legora resisted building APIs 49:26 Can the agent be the API? 50:12 The 300 Spartans slide and the plan to stay at 20 engineers 51:32 The bets nobody asked Legora to make 53:05 Post-training open-weight models for legal research 54:05 Search, retrieval, and late interaction 54:51 What makes a good legal agent harness and why drafting depends on search 56:25 Which model writes the best draft? 57:03 Hallucinations and Legora’s citation system 57:41 Do lawyers check the citations? 58:19 MapReduce or one big context window for a million-token contract? 1:00:16 Getting anonymized examples and the idea of buying a law firm for its data 1:01:53 Why Jacob advises against default embeddings 1:02:44 Will lawyers work in Legora or through Claude? 1:03:26 Will the model labs cut Legora off? 1:04:24 Law schools and scholarships for computer science majors 1:05:28 Hiring in New York, Stockholm, and London 1:06:09 Why most work eventually becomes legal work Guest — Jacob Lauritzen, CTO of Legora https://legora.com Co-host — swyx, Latent Space Host — Basil Chatha, Forward Deployed https://forwardeployed.com

Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

Powering up for a pivotal moment

<p>Utilizing waste carbon at scale, assessing public trust in artificial intelligence and data centers, and building a quantum toolkit for critical applications were among the topics energy experts explored at the MIT Energy Initiative (MITEI)’s annual research conference on Sept. 22-23.</p><p>The complexity of the energy transition demands “a truly interdisciplinary and international approach,” said Paula Hammond, Institute Professor and dean of the MIT School of Engineering, kicking off the conference, which was themed “Transitioning energy at a pivotal moment.”&nbsp;</p><p>More than 200 people attended Energizing@MIT: MITEI’s Annual Research Conference in person and online, including faculty, scientists, and researchers; representatives of global energy firms; nonprofit organizations; and academic institutions.</p><p>With the rapid proliferation of artificial intelligence and data centers, the challenge of the energy transition grows ever greater, requiring “researchers who can pursue fundamental questions about materials, chemistry, and energy systems … engineers who can design new technologies and determine how they might function at scale … and experts in economics, policy, human behavior, and sociology who can help us understand how those technologies will interact with communities and with the world around us,” said Hammond.&nbsp;</p><p>From keynote speakers to panelists, seed grant innovators to startup entrepreneurs, the conference featured exemplars in all these categories.</p><p><strong>Deploying today’s technologies</strong></p><p>Eric Toone, chief technical officer and managing partner at Breakthrough Energy, set the tone for day one with a keynote address that was clear-eyed in his assessment. “If energy is prosperity,” he told the audience, “at least today, prosperity is emissions.” Yet, Toone was optimistic when he heralded examples of Breakthrough Energy-funded ventures, from iron-air batteries to vacuum-insulated glass windows, which can reduce the carbon costs of energy.&nbsp;</p><p>“We can absolutely develop new technologies that provide the exact same service, but at zero carbon,” he said.</p><p>The conference made Toone’s claim tangible as it spanned the full arc of decarbonization — from deploying what we know today to uncovering what may be possible tomorrow.&nbsp;</p><p>There are “projects that are actually being developed, companies that are putting steel in the ground now, electrons onto the grid to deliver capacity now, or in the very, very near term,” said John Parsons, deputy director for research at the MIT Center for Energy and Environmental Policy Research. Parsons moderated a panel on the revival of nuclear fission power.&nbsp;</p><p>Highlights included Crane Clean Energy Center’s restoration of the Three Mile Island Unit 1 nuclear plant, set to restart in mid-2027; work by Électricité de France (EDF) to extend and modernize France’s 57-reactor nuclear fleet, adapting plants to climate impacts; and GE Vernova’s development of mature light-water reactor technology, with a new plant under construction in Ontario.</p><p>Carbon utilization offers another path to mitigating carbon dioxide (CO<sub>2</sub>) emissions. “The land and ocean are passively taking up almost 50 percent of anthropogenic CO<sub>2</sub> emissions,” said Carolyn Ruppel, MITEI’s deputy director for science and technology, who moderated the panel. “The idea is to find uses for some of the rest of it.” The session showcased research exploring a host of technologies for making products with captured CO<sub>2</sub>.</p><p>Nicola Ferralis, a research scientist in the MIT Department of Materials Science and Engineering (DMSE), highlighted the importance of large-scale uses for carbon waste, such as structural carbon for vehicles and buildings. “We need to find applications that are actually able to match the supply by mass,” he said.&nbsp;</p><p>Admir Masic, an associate professor in the MIT Department of Civil and Environmental Engineering and DMSE, described self-heating concrete panels used in real-world conditions in Sapporo, Japan, as well as new concrete materials that can store energy.</p><p>“The pace of the transition to a renewable-energy economy will strongly rely on the availability of scalable, bulk energy-storage solutions,” said Masic.</p><p>Kripa K. Varanasi, a professor in the MIT Department of Mechanical Engineering, is working on ways to make technologies such as emissions-plume capture at power plants economically viable.&nbsp;</p><p>In a panel devoted to startups with links to MITEI or MITEI member companies, speakers described moving novel energy technologies from research to commercialization: Alfredo Rivela of Adaion has developed an AI tool for electrical utilities that optimizes their use of the grid; Eddie Obropta of Raptor Maps trains drones to inspect solar farms; Michele Guarnieri’s HiBot has created a robot that detects issues in power lines; and Michael Wang of Lithios is conducting field pilots that use electrochemistry to separate lithium from low-grade brines.</p><p>Successful ventures, the speakers agreed, begin with a clear customer problem that can be validated by industry users and that offers a path to scaled deployment. For industry users, “innovation is not a corporate virtue,” said Steve Hellman, managing partner at Alliance Partners. “It’s an existential requirement.”</p><p><strong>Early-stage research and basic science</strong></p><p>The conference also offered a bounty of promising early research on technologies and approaches for cutting carbon emissions. A panel on MITEI’s Seed Innovation Fund Program projects introduced MIT scientists who are separating and recycling rare earth elements; designing algorithms to decide which power plants should run to meet electricity demand; and modeling the impacts on human and natural systems of development and decarbonization.</p><p>A poster session revealed the next generation of energy researchers in such fie

Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

Making Kubernetes AI-Ready for NVIDIA Vera Rubin on Day One

Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking,... Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking, operators, and schedulers must work together, with settings tuned to the hardware and workload. Small mismatches can prevent workloads from running or limit performance. The NVIDIA AI Cluster Runtime (AICR)—part of the NVIDIA DSX AI Factory… Source

Nguyên văn nguồn
Chi tiết nguồn
Đánh giá

Import AI 479: Spacewar; low-latency tasks versus LLMs; Genie 4

Câu hỏi Read the paper : Realtime-Bench: Can Frontier Models Solve Real-time Interactive Problems?

Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. Subscribe now LLMs are very bad at low-latency tasks: …Realtime-Bench says it’ll be a while till AI systems can play games or do online auctions for you… Researchers have built Realtime-Bench, “a suite of carefully curated dynamic tasks where delayed actions directly affect success”. The test helps evaluate how well modern, general-purpose AI systems can perform tasks where decisions need to be made in real-time. The benchmark consists of 50 interactive game and web tasks, split across 30 web tasks in four categories (travel, e-commerce, service, and security), and 20 game tasks (arcade, puzzle, strategy, and simulation). Who did the research: The benchmark was built by people at the University of Texas at Austin, Ohio State University, University of Illinois at Urbana-Champaign, NVIDIA, Northwestern University, and Steadyworks. What it measures: The test is designed to probe for three qualities: temporal state awareness (”RT-Perceive”), where models can use observations to track changes in the world; adaptive deliberation (”RT-Deliberate”), where models alter their reasoning length and depth according to available time; and time-aware action selection (”RT-Act”) where models need to appropriately time their actions for the situation. “For example, an agent purchasing a ticket must track the sale status and assess whether observed availability is still current (RT-Perceive), limit further deliberation when the purchase window is closing (RT-Deliberate), and choose between waiting for sales to open and purchasing while tickets remain available (RT-Act).” They have three different conditions: Wall clock, which is designed to test out performance under real-world latency. Paused clock, which lets you arbitrarily pause things so you can get a sense of baseline capability, and Token clock, which “advances the environment at a fixed rate per generation token. An action is applied at the simulated time reached when it is committed, so consuming more tokens delays execution regardless of actual inference latency”. How well do models do? The authors tested out models from OpenAI (GPT-6-Astra, GPT-5.6 Sol, GPT-Realtime-2, OpenAI Decisions), Anthropic (Claude Fable 5.1, Claude Opus 5), Google (Gemini 3.8 Flash, Gemini 3.1 Flash Live, Gemini 3.8 Live), Jev 1.13, as well as Chinese models from Deepseek (V4.1) and Moonshot AI (Kimi-K3). GPT-6 Astra (high) got the highest pass rate on the ‘wall clock’ evaluation setting, with 36%. By comparison, with a paused clock, models with high reasoning get closer to 70% or even 80% success. Why this matters: This benchmark is an effective proxy for where AI agents will break - the low scores here point to tasks where AI agents cannot yet be expected to perform well. Check out the leaderboard : Realtime-Bench (official website) . Read the paper : Realtime-Bench: Can Frontier Models Solve Real-time Interactive Problems? (arXiv) . *** The future of spacewar, courtesy of the Defense Intelligence Agency: …Anti-satellite tech, space nukes, and more… Working in AI can be stressful so sometimes to relax myself I like to read about other topics to get a sense for what horrors lie elsewhere. I take the same approach with depression, where if I feel sad I will try and listen to music by people sadder than me in an attempt to cheer myself up (e.g., Radiohead, Neil Young, and in very dark moments Bill Callahan / Smog, etc). So with that in mind I recently read “Challenges to Security in Space”, by the Defense Intelligence Agency. What’s going on in space: As with conflict on Earth, space is defined by conflict between the US versus China, Russia, Iran, and North Korea, with China the most technologically sophisticated, and Russia the most seemingly gung ho. “China and Russia are developing a formidable spectrum of offensive capabilities to degrade or destroy space services of other countries, from kinetic destruction to sophisticated jamming and cyber operations,” the DIA writes. “China has more than tripled its space launches per year in the past decade, with 22 launches in 2016 and 93 launches in 2025… Beijing judges space is central to the United States and its allies’ operations. Beijing also considers space an offensive military domain, which has shaped integral components of PLA military planning and campaigns.” Spacewar: The general vibe you get from reading this 100+ page report is there is a huge amount of ugly, frightening stuff happening in space, or being done to things in space by things on the ground. Some example quotes: “By the late 2020s, China may field space-based directed energy systems and higher-powered ground-based directed energy systems capable of threatening satellites in higher orbits” “China is developing space-based technology, including on-orbit counterspace weapons, capable of holding space systems at risk” “Russia’s Peresvet, a ground-based laser system, is designed to dazzle enemy satellites’ optical systems to mask the movement of Russia’s strategic missile systems” “Russia has launched several satellites over the last few years which conducted test activities on orbit for technologies that could enable attacks on other countries’ satellites and result in temporary or permanent damage” China has a couple of spaceplanes, akin to the US’s hyper-secret X-37B vehicle, and they appear to be getting more sophisticated. In 2023, one of China’s aforementioned vehicles, “released and interacted with an object.” Satellite-on-satellite fights: It’s obvious throughout the report that we’re in a world where rival nations have satellites that try to go up and mess with other satellites from other people. “In 2019, Russia launched satellite Cosmos 2542, which released a second satellite, Cosmos 2543. Cosmos 2543 then began following a U.S. national security satellite and approached it multip

Nguyên văn nguồn
Chi tiết nguồn
Huấn luyện

The Window Before AWS Wakes Up: Nebius CTO on Racing the Hyperscalers

Nebius CTO Danila Shtan joins Jacob Effron to talk about what it takes to run an AI cloud at the frontier, and why he thinks the hyperscalers haven’t won this market yet. Today Nebius is a Nasdaq-listed AI cloud with infrastructure deals with Microsoft and Meta. Danila and Jacob discuss why open-model inference is still far from optimized, why 95% of Nebius customers run modified models instead of vanilla ones, and why prefill/decode disaggregation is more talk than practice. They also cover what’s actually constraining the AI buildout, why chip scarcity has kept AWS and Google from winning AI cloud, whether we’re overbuilding infrastructure, and how Nebius runs a large engineering org with no limits on AI token usage. 0:00 Intro 1:25 What Differentiates AI Clouds 6:16 Nebius’ Origin Story 10:15 Bringing New Nvidia Chips Online 14:55 What Different Customers Want 19:58 Latency vs. Cost 21:53 Disaggregated Prefill & Decode 24:59 Inference’s Low-Hanging Fruit 28:31 What Nebius Should Productize 30:11 The Tavily Acquisition 31:56 How Data Centers Differ 34:29 Bottlenecks in the AI Buildout 37:03 How New Workloads Shape Clusters 39:17 Why Hyperscalers Didn’t Win This Market 43:39 The Future of Neoclouds 45:42 What Gets Absorbed by AI Hyperscalers 49:43 OpenAI x Baseten 52:07 Quickfire Jacob is an AI investor at Redpoint Ventures. He's led Redpoint's investments in companies like Abridge, Physical Intelligence & Legora. Follow Jacob on Twitter: https://x.com/jacobeffron On Unsupervised Learning, we probe the sharpest minds in AI in search for the truth about what's real today, what will be real in the future and what it all means for businesses and the world. If you're a builder, researcher or investor navigating the AI world, this podcast will help you deconstruct and understand the most important breakthroughs and see a clearer picture of reality. Subscribe to this show to stay up to date on our latest episodes.

Unsupervised Learning · Unsupervised Learning: With Jacob Effron Mở bản gốc ↗
Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

v0.33.0

<h1>v0.33.0</h1> <h2>Highlights</h2> <p>This release features 927 commits from 389 contributors (122 new)!</p> <ul> <li><strong>New models</strong>: Reflection Beam-1.0 (501B MoE, 23B active) with its DFlash2 drafter (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5889776852" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/62074" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/62074/hovercard" href="https://github.com/vllm-project/vllm/pull/62074">#62074</a>), Yandex AliceAI-Foundation-80B-A3B (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5528395962" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/57963" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/57963/hovercard" href="https://github.com/vllm-project/vllm/pull/57963">#57963</a>), Recursive Flint (40B MoE, 2.5B active) (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5963973803" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/62938" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/62938/hovercard" href="https://github.com/vllm-project/vllm/pull/62938">#62938</a>), Muse Spark Open (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5870836957" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/61879" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/61879/hovercard" href="https://github.com/vllm-project/vllm/pull/61879">#61879</a>), Step-5 Preview (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5858365579" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/61727" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/61727/hovercard" href="https://github.com/vllm-project/vllm/pull/61727">#61727</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5983333813" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/63147" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/63147/hovercard" href="https://github.com/vllm-project/vllm/pull/63147">#63147</a>), NVIDIA Alpamayo 2 Super (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5966496000" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/62957" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/62957/hovercard" href="https://github.com/vllm-project/vllm/pull/62957">#62957</a>), Nemotron-Labs Dory1.0-4B (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5720865818" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/60149" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/60149/hovercard" href="https://github.com/vllm-project/vllm/pull/60149">#60149</a>), Nemotron Parse 3.5 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5851529141" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/61651" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/61651/hovercard" href="https://github.com/vllm-project/vllm/pull/61651">#61651</a>), MiniCPM-OCR 1.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5977403397" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/63095" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/63095/hovercard" href="https://github.com/vllm-project/vllm/pull/63095">#63095</a>), Domyn Edge (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5929550005" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/62544" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/62544/hovercard" href="https://github.com/vllm-project/vllm/pull/62544">#62544</a>) and the ColUltraVBERT visual document retriever (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5904816806" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/62237" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/62237/hovercard" href="https://github.com/vllm-project/vllm/pull/62237">#62237</a>).</li> <li><strong>PyTorch 2.14</strong>: vLLM is upgraded to PyTorch 2.14.0, with torchvision 0.29.0 and Triton 3.8.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142721768" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/52183" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/52183/hovercard" href="https://github.com/vllm-project/vllm/pull/52183">#52183</a>).</li> <li><strong>CUDA 12.9 dropped</strong>: release wheels and images are CUDA 13.0 only. The CUDA 12.9 wheels and the <code>-cu129</code> / <code>-cu129-ubuntu2404</code> images are no longer published (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5933763258" data-permission-text="Title is private" data-url="https://github.com/vllm-project/vllm/issues/62575" data-hovercard-type="pull_request" data-hovercard-url="/vllm-project/vllm/pull/62575/hovercard" href="https://github.com/vllm-project/vllm/pull/62575">#62575</a>); use the default CUDA 13.0 artifacts instead.</li> <li><strong>libtorch ABI stable CUDA wheel</strong>: the CUDA wheel is now ABI stable with libtorch.

Nguyên văn nguồn
Chi tiết nguồn
  • v0.33.0 vllm-project/vllm releases · 2 thg 11, 2026
Huấn luyện

Regina Barzilay and Jim Collins win Pritzker Prize for AI and Science Research Excellence for work in AI-enabled antibiotic discovery

<p dir="ltr">Regina Barzilay, MIT’s School of Engineering Distinguished Professor of AI and Health, and James Collins, MIT’s Termeer Professor of Medical Engineering and Science, are the recipients of the <a href="https://datascience.uchicago.edu/news/the-university-of-chicago-announces-2026-recipients-of-the-pritzker-prize-for-ai-in-science-research-excellence/">2026 Pritzker Prize for AI in Science Research Excellence</a>.&nbsp;</p><p dir="ltr">The award recognizes their joint work in “pioneering AI-enabled antibiotic discovery, integrating deep learning, bioengineering, and experimental validation to identify novel antibacterial candidates against drug-resistant pathogens.”&nbsp;</p><p dir="ltr">Established in 2024 by the University of Chicago in partnership with Caltech, the Pritzker Prize for AI in Science Research Excellence recognizes contributions that jointly advance AI and the natural sciences or engineering.</p><p dir="ltr">Barzilay and Collins, who are faculty co-leads of the <a href="https://jclinic.mit.edu/">Abdul Latif Jameel Clinic for Machine Learning in Health</a> (Jameel Clinic) and affiliates of the MIT Schwarzman College of Computing and the MIT School of Engineering, published their first <a href="https://www.cell.com/cell/fulltext/S0092-8674(20)30102-1">breakthrough paper</a> together in 2020 with then-MIT postdoc and first author Jonathan Stokes (who worked in the Collins lab from 2017 to 2021) in&nbsp;<em>Cell. </em>The paper described the first artificial intelligence-discovered antibiotic, called <a href="https://news.mit.edu/2020/artificial-intelligence-identifies-new-antibiotic-0220">halicin</a>, named for the fictional AI system HAL 9000 in Stanley Kubrick’s 1968 film&nbsp;<em>2001: A Space Odyssey</em>.</p><p dir="ltr">A broad-spectrum antibiotic that was originally studied as a potential diabetes drug,&nbsp;halicin was identified by a deep learning model trained on 2,500 molecules. Upon testing, the research team found that halicin was able to kill antibiotic-resistant bacteria (i.e., “superbugs”) such as&nbsp;<em>Clostridium difficile</em>,&nbsp;<em>Acinetobacter baumannii</em>, and&nbsp;<em>Mycobacterium tuberculosis</em>. A discovery process that once took years was completed in just a few weeks. Amidst the growing alarm around the global antimicrobial resistance crisis, the results demonstrated that AI could prove to be an effective tool for rapidly identifying new and effective antibiotics.</p><p dir="ltr">Following halicin, Barzilay and Collins worked with Stokes (now an assistant professor at McMaster University) to use machine learning to identify&nbsp;<a href="https://news.mit.edu/2023/using-ai-scientists-combat-drug-resistant-infections-0525">abaucin</a> in 2023, a narrow-spectrum antibiotic demonstrating effectiveness against&nbsp;<em>A. baumannii</em>, an antibiotic-resistant bacteria commonly found on hospital doorknobs and in the wounds of U.S. soldiers stationed in Iraq and Afghanistan. Notably, abaucin’s “narrow spectrum” efficacy against a single species of treatment-resistant bacteria is its main advantage, minimizing the likelihood of bacteria developing resistance and harming beneficial bacteria in the gut.</p><p dir="ltr">“Historically, antibiotic discovery has depended on laborious, trial-and-error strategies,” says Collins. “This process is slow, costly, and unpredictable, often yielding few viable antibiotic candidates. With generative AI, we're now seeing a shift from AI being used as a tool for discovery to AI being used as a design tool. This shift opens new frontiers in antibiotic discovery that could bring us the next generation of lifesaving drugs.”</p><p dir="ltr">In Barzilay’s view, “despite significant progress in molecular modeling, we are still in early stages of drug discovery. With AI, we can only automate parts of the pipeline, rather than totally transforming the discovery process. To make it happen, we need to work really hard to build realistic AI models of human biology.”</p>

MIT News: AI · Alex Ouyang | Abdul Latif Jameel Clinic for Machine Learning in Health Mở bản gốc ↗
Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

Progress on provable inference for large language models

We have made progress on a type of cryptographic proof known as a “zkSNARK.” In this post, we share some of that progress, primarily through a system we call FlashProve.

Anthropic Research (unofficial RSS mirror) · Chưa ghi tác giả Mở bản gốc ↗
Nguyên văn nguồn
Chi tiết nguồn
Kỹ thuật

The Datacenter Backlash Goes Bipartisan: Next Week's Midterms and the 2028 Buildout

The 2027 datacenter boom is already being built, and next week’s midterms won’t stop it now. Roughly three-quarters of the 33.8 GW due across our top 20 states is already under construction, which is why we remain comfortable with the global +50 GW year we laid out in our Oct. 16 article . The campuses are taking shape. The election will change the rules around them, but much of the 2027 pipeline already has a substantial head start. The fight is over 2028. Our model has 62.2 GW of US net additions that year, most of which hasn’t started construction. Much of it sits in states electing a governor on Nov. 3. This piece tracks the 13 states with the largest 2028 net additions in our model, setting aside Virginia and Mississippi, which don’t hold state elections this November. Together they account for 43.5 GW, or 70% of what we expect nationally, and 10 of the 13 elect a governor. Source: SemiAnalysis Datacenter Industry Model That leaves a 2028 pipeline still working through approvals, power projects, and construction schedules as the rules change. In September, we argued that datacenter moratoriums weren’t killing the US buildout : of roughly 20 GW inside local restrictions, we estimated only 1.5 GW faced delay. Most exposed capacity already had protections or did not need the affected approval until after the pause expired. That broad conclusion has held up. What is changing is the reach of the restrictions given the growing anti-datacenter backlash. Three things have worsened since. Texas, the largest US market, froze Texas Commission on Environmental Quality (TCEQ) permits on Sept. 21 on top of the interconnection-queue audit begun Aug. 3, bringing onsite power into the hold. Oregon expanded its earlier state-land freeze to air and water-discharge permits on Oct. 9, through July 1, 2027. And midterm candidates have campaigned on more restrictive positions: nine of the 20 nominees want a pause on new construction and the other 11 want conditions; the split is about even by party. Both parties want developers to accept stricter conditions. The main difference is whether a developer can meet the new terms and keep building or must wait for the state to reopen approvals. The biggest risk to our buildout forecast right now is a prolonged permitting freeze at the TCEQ. Texas alone adds close to 30% of US GW in 2028. A few months of lost time in that market can move the national number. We already flagged to Datacenter Model subscribers which companies are most at risk from the current pause. The question now is how long the pause lasts. Gov. Greg Abbott (R), who is running for re-election in Texas, could reopen permitting once the Electric Reliability Council of Texas (ERCOT), the state’s grid operator, finishes its audit and the Texas Water Development Board completes its water-use review. ERCOT is targeting Dec. 10 to file its report, which does not by itself reopen permitting. A restart around then would leave developers dealing with a relatively short interruption, which some projects can absorb within their schedules. The audit still has to lead to a decision to resume issuance, and each permit still needs approval. By contrast, Gina Hinojosa (D), his challenger, presents a more bearish approach: she would impose a moratorium until legislation is passed that gives communities a voice, protects household utility bills, and ends the tax incentives for datacenters. The regular legislative session in Texas takes place from Jan. 12 to May 31, 2027. If approvals stay on hold throughout that session, the freeze would last about eight months from September. If reopening waits for the new rules to take effect in late summer, the freeze would last close to a year, or five to nine additional months compared with restarting in December. A deal or a special session might happen sooner. However, a campus racing toward delivery in 2027 may not have that much time to spare. Source: SemiAnalysis Datacenter Industry Model This is the risk posed by the pro-moratorium candidates: a project cannot carry out work if it still requires an approval which the state has ceased to issue. If the candidate proposing a datacenter pause won in every state where one is running, those states would together contain roughly 30 GW of planned capacity scheduled for 2028. How much actually slips depends on the permits each project still needs and how long the pause lasts. Source: SemiAnalysis Datacenter Industry Model We are less concerned with the candidates who support conditions only. Most of their demands change the price and terms of development. A developer can fund the grid upgrade, change the cooling design or negotiate the community agreement, and then move forward. That can be expensive and time-consuming, but it gives projects a route to approval. Several of the main conditions were already coming: Submitting thorough water-usage studies: manageable for many projects, but the answer depends on cooling design and the local water supply. Paying the infrastructure costs they create: we expect this to come anyway, with datacenter developers now offering credits toward household electricity bills. More environmental transparency and dropping non-disclosure agreements (NDAs): Amazon Web Services (AWS) and Google have already started down this path. If the less restrictive candidates win, that exposure falls to 5.7 GW, mainly because Ohio and Oregon have proponents of a pause on both sides. That is a much smaller pipeline to test for delays. It would still be a tougher development environment: fewer tax breaks, more upfront commitments and less room to leave infrastructure costs with the utility’s other customers. Source: SemiAnalysis Datacenter Industry Model According to race ratings and available polling as of Oct. 30, from multiple sources ( Cook Political Report , Multistate , and The New York Times ), the conditions-only candidate is favored in Texas, Oklahoma, Pennsylvania and Iowa, and Georgia is a toss-up. Here

Nguyên văn nguồn
Chi tiết nguồn
481–500 / 562
Trang 25 / 29