AllyshipContent Radar

Hands-on 278

Công cụ, thử nghiệm và hướng dẫn thực hành

Crawl live-1795090500000 · 19:15 19 thg 11, 2026 · Xuất bản 19:35 19 thg 11, 2026

151

Introducing the Document Parsing Protocol (DPP)

16.5

Hướng dẫn jerryjliu0

Introducing the Document Parsing Protocol (DPP) There are hundreds of different OCR models and tools, but they might all parse a document in different ways. Some errors are very clear-cut (e.g. hallucinating text, or completely misaligning a table), but many errors are much more ambiguous (e.g. how to represent split tables sharing a header). It's an issue that plagues most parse benchmarks too, because they inherently reward a certain style even if other styles might be semantically correct. We introduce a protocol that proposes a standard way of parsing these documents into a correct format. We've curated a list of 140 rules that cover literally every aspect of doc parsing, for instance: - tables: borderless whitespace tables, header-only tables, horizontal slicing, side-by-side mini tables - forms: key-value regions, checkboxes, checklists, ids and labels, fields outside the form, - charts: standardized chart output, multiple charts, gantt charts, line charts You can use DPP as an evaluation rubric for LLMs when determining the quality of parsing a document. It's not a full evaluation benchmark (yet), but an initial evaluation guide, and meant to encourage a discussion on what are the "best" ways to parse a document. Check it out: https://www.parseprotocol.com/guide/forms-forms-and-key-value-regions Blog: https://www.llamaindex.ai/blog/introducing-the-document-parsing-protocol

X · 29 thg 10, 2026

Nguyên văn nguồn
Chi tiết nguồn
152

I honestly don’t know how to try Gemini in the agentic era, maybe I finally need to fix that. Pretty wild they just have been out of it since December 2025 but look maybe back.

16.4

Hướng dẫn natolambert

I honestly don’t know how to try Gemini in the agentic era, maybe I finally need to fix that. Pretty wild they just have been out of it since December 2025 but look maybe back.

X · 29 thg 10, 2026

Nguyên văn nguồn
Chi tiết nguồn
153

Introducing Samaya Sterling, our new model post-trained for challenging financial research that outperforms the frontier! Sterling started off as a two person research effort to see if we could increa

16.4

Hướng dẫn maithra_raghu

Introducing Samaya Sterling, our new model post-trained for challenging financial research that outperforms the frontier! Sterling started off as a two person research effort to see if we could increase efficiency in agentic orchestration. To our surprise we were able to post-train a much smaller model (Nemotron 3.5 Lightning, a 30B mixture-of-experts model with 3B active parameters) to greater accuracy (58.9% vs 55.9% on FrontierFinance) and 11x lower cost ($0.61 vs $6.89) than Claude Fable 5.1, the best performing frontier model. We did this via a four-stage training process, two stages of SFT where the model first learns to research with our financial tools and how to construct a good agentic research strategy. The second two stages are RL, with an offline GRPO stage where the model further hones its research strategy from eight teachers that provide diverse approaches, and an online GRPO stage where the model can make end to end attempts and learn from its mistakes. We see substantial gains from the co-adaptation of the model and harness through post-training, both through the model learning to effectively use the high-quality financial tools, and better compaction approaches that let even a small model execute on longer and deeper research. We are exploring multiple follow-up directions, from multi-agent research swarms using this small model, to training firm-specific models to encode unique judgement, to training a larger model, where early results show even greater gains from the training process. The full research is linked below!

X · 28 thg 10, 2026

Nguyên văn nguồn
Chi tiết nguồn
154

Artificial Analysis v5 and the benchmarker's dilemma

16.1

Hướng dẫn Nathan Lambert

Hill-climbing is easy, knowing what to hill-climb is hard. Making scores go up is expensive , but we have a much clearer playbook for it than we do for creating meaningful benchmarks at the true frontier of AI today. Independent evaluation of language models is under-appreciated in how hard of a task it is. These groups are not just taking current models and certifying their scores, which is a technically involved task. This is their job if AI progress is slow. When AI progress is as fast as it is, the technical details of the job are the routine work part of trying to put a single number on what makes for a good AI model today. The goal is to have a single number that is representative of current models, matching vibe checks, community sentiment, and scientific analysis, while being forward looking enough so that it’s not outdated in 3 months. Everyone building a benchmark faces a sort of paradox. You need your benchmark to reduce to one single number, so that it is easy to discuss, use in reports, and compare models, but every method of aggregating scores comes with meaningful trade-offs. The best scientists need to do this, everyone does. It’s a matter of creating aggregation metrics that you think are most fair, knowing there will always be imperfections. With the amount of money in the AI ecosystem today, the weight of independent evaluation is even higher – you dictate the winners and losers of a trillion dollar market. You also influence some of the models themselves, steering the shape of progress. This is a lot of pressure! My prompt for this article is Artificial Analysis’s recent update to their Intelligence Index, v5 . The AA index is the most prominent independent intelligence metric for the latest frontier models, followed in a distant second by Epoch AI’s Capabilities Index (ECI) . To date, all of these have been incredibly useful for the community and massively flawed! Interconnects AI is a reader-supported publication. Consider becoming a subscriber. Language models are capable of so much today, and this scope of capabilities is growing quickly. Our era of singular intelligence indices should be phased out soon, but it will take a long time. A summary of AAv5 is below, from their blog post, where they describe it as “reflecting real-world usage today:” Intelligence Index v5 weights: ➤ Knowledge Work (25%): AA-Briefcase (15%), AutomationBench-AA (5%), and GDP.pdf (5%) ➤ Coding (25%): FrontierCode 2.0 (15%) and Terminal-Bench 4.0 (10%) ➤ Science (25%): Terminal-Bench-Science (15%) and CritPt v2 hard subset (10%) ➤ General (25%): AA-Omniscience v1.1 15% (10% accuracy, 5% non-hallucination) and HLE-Diamond (10%) Here’s the new ranking of models: The problem with trying to benchmark real-world usage today is that it is extremely jagged, just like the models. The most proven use-case is coding, where open models are far more competitive and likely to keep up. In knowledge work, I’m less confident in open models. At first glance, in aggregate, their model ranking definitely looks reasonable. Still, it shows signs of strain and confusion, as any benchmark will, with GPT 6.1 Terra beating Claude Fable 5.1 on AAv5. Today, some benchmarks measure the absolute frontier of capabilities, playing nicely in open-ended tasks through your favorite harness, which often does take a large model. Some other benchmarks measure certain skills that will be needed of a model in repetitive agentic tasks. I get the feeling that AA is tuning their benchmark more towards the former, a general agentic collaborator, but all of these behaviors overlap. This takes us to the plot going around that prompted me to write this, where they showed the balance of open vs. closed models on the new benchmark. This plot shows 8 closed models beating the best to-be open-weight model, Kimi K3.1 Pro (which isn’t colored blue). This benchmark is taking the opinion of trying to measure where frontier models are moving into, which grows the gap to open models. This is an okay decision to take, but over time as existing workflows of open models become key factors of the economy, it could become a benchmark that misses where the core economic engine of the industry is. Open models’ demise from this seems greatly exaggerated, but I do think the previous index was flattering the open weight models too strongly. Consider this plot from the Kimi K3.1 Pro launch — yes, the open models are strong and useful in some cases, but the best OpenAI and Anthropic models have been a major step ahead in their flexibility and reliability. Some of the evaluations in AAv5 that open models are most behind on are “science” evals like terminal-bench-science and CritPT v2 . Open models are behind, but the value proposition was never to compete truly at the frontier. The open model economy will be about Reducing domains with high market demand for inference to a commodity price of hardware. Allowing ownership of intelligence, specializing it to internal data, and controlling internal agents across many companies in the economy. Both of these will take a very long time to materialize and are partially represented in benchmarks. The supply of compute is currently so low that open model providers also are raking in solid margins – when this shrinks, we will know the system is starting to work. The same goes for diffusion into enterprises, it’s not clear what the exact ceiling on it is because of the difficult ML expertise that is needed to build evaluations and do post-training today. Share At the next major model cycle, say in 2-3 months with GLM 6 or Kimi 3.5, I expect the leading open model labs to make substantial steps on this index, again surprising many observers. This is a cycle we have been on for years now. I’ve written many times about how open models keep up with the frontier, and a summary is that: The best open models do benchmax a little. The worst open models benchmax a lot (but don’t get a ton of attention anyways). The best open mo

Interconnects · 28 thg 10, 2026

Nguyên văn nguồn
Chi tiết nguồn
155

Marc Andreessen explains why AI might be the end of James Burnham's "managerial society"

16.0

Hướng dẫn startuparchive_

Marc Andreessen explains why AI might be the end of James Burnham's "managerial society" In his book The Managerial Revolution, Burnham divided capitalism into two phases. The first phase was what he called "bourgeois capitalism" "Think of this as name on the door -- it's Ford Motor Company because Henry Ford runs the company. It's a dictatorial model and Henry Ford just tells everyone what to do. He said the problem with bourgeois capitalism is it doesn't scale because Henry Ford can only tell so many people to do so many things." The second phase was what Burnham called "managerial capitalism", which was Marc describes as, "the creation of a professional class of managers that are trained -- not to be car experts or experts in any particular field but to be experts in management. And then that led to business schools and management consultant firms and all these things." Marc continues: "You look at every big company today and most executives at most of the Fortune 500 companies are not domain experts in whatever the company does. And they're certainly not the founders of those companies. They're professional managers. And in fact, over the course of their careers, they'll probably manage many different kinds of businesses. They might work in healthcare for a while and then work in financial services and then go work in something else." "What Burnham said was that transition was absolutely required because the problem with bourgeois capitalism is it doesn't scale... So if you're going to run capitalist enterprises that are going to have millions to billions of customers, they're going to be operating at a level of scale and complexity that will require this professional management class." Burnham acknowledged that this professional management class has its downsides -- they're not as inventive and not going to come up with the next breakthrough. But whether you think that's good or bad, that's what's going to be required. And basically that's what happened. Marc continues: "Managerialism basically took over everything. What I'm describing is basically how all big companies run and how all governments run and how our large-scale non-profits run." Marc believes venture capital is a protest movement to that -- backing founders under the Henry Ford model, and trying to find the next Elon Musk or Steve Jobs who can out-innovate the incumbents. "I've always viewed my entire life as: we're raging against the dying of the light. We're constantly trying to fight off managerialism from swamping everything and everything getting boring, gray, dumb, and old." But AI may now offer a third model. Marc explains: "Maybe the new Henry Ford, Elon Musk, or Steve Jobs + AI is the best of both because it's the spark of genius of the name on the door model but gives that person AI superpowers to do all the managerial stuff... What's the thing these bots are really good at? They're really good at doing paperwork, writing reports, and doing all the managerial work." "The challenge is going to be for the innovators to figure out how to leverage AI to actually do this." "The other challenge is going to be for the incumbents that are managerial to figure out: what does that mean? Because now they're going to be facing a different kind of insurgent competitor that has a different set of capabilities than they're used to." "I think this is going to force a lot of big companies to figure out innovation - figure out innovation or die trying." Ben Horowitz elaborates on this point further in his article Databricks & the Future Firm below. Video: @latentspacepod (Apr 2026) Media

X · 28 thg 10, 2026

Nguyên văn nguồn
Chi tiết nguồn
156

European Defense Sovereignty Starts in the Factory: Stark’s Uwe Horstmann and Johannes Schaback

16.0

Hướng dẫn Sequoia Capital

Two years after its founding, Stark has roughly 700 employees and strike drones in the field in Ukraine. CEO Uwe Horstmann and CTO Johannes Schaback argue that the real lesson of that war is not any single weapon: the innovation ecosystem behind it is the wonder weapon. They explain why Stark designs every system for mass manufacturing from day one, runs 10 to 15 programs like a venture portfolio, and views the staff sergeant who operates a system as just as important as the general who buys it. Johannes recounts the publicly reported failed trial that became a forging moment, as engineers worked around the clock at a freezing test range until they landed three consecutive hits. They discuss NATO’s principles of responsible AI use and the hard-coded constraints in Stark’s autonomy stack. And Uwe lays out his next big idea: defense contracts structured like cloud contracts with surge capacity built in, so production itself becomes deterrence. Hosted by Pat Grady and Luciana Lixandru, Sequoia Capital Chapters 0:00 – Introduction 1:03 – Billions in contracts in 18 months: Stark's four-part playbook 2:28 – The staff sergeant matters as much as the general, and wood beats plastic 7:42 – Why Europe is ready for a neo prime, and why procurement reform will last 11:45 – Startup DNA, venture-style programs, and "as complex as a washing machine" 16:27 – Born out of fire: the failed trial and the round-the-clock comeback 21:13 – Where Stark finds talent, and why defense is no longer off-limits 23:48 – Anatomy of a strike, from the wooden crate to the kill zone 27:22 – Vertical integration, multiple domains, and shifting left on manufacturing 32:53 – After the Hugging Face hack: guardrails on autonomous weapons 35:56 – Matching the primes on R&D and scaling to 700 people in two years 39:24 – Deterrence by contract, and Europe's next chapter with the US

Training Data · 28 thg 10, 2026

Nguyên văn nguồn
Chi tiết nguồn
151–156 / 179
Trang 26 / 30