AllyshipContent Radar

Hands-on 278

Công cụ, thử nghiệm và hướng dẫn thực hành

Crawl live-1795090500000 · 19:15 19 thg 11, 2026 · Xuất bản 19:35 19 thg 11, 2026

7

Show HN: A decent text-to-image model trained for ~$20K (Apache 2.0 Weights)

63.7

Hướng dẫn schopra909

My brother and I run a 2-person lab that trains our own generative video models from scratch. The ultimate goal is a set of creative tools that make it easier for anyone to make animation. Video models today are too slow/expensive and lack sufficient controls. Creativity is an iterative process. You make, you tweak, you get better. In our opinion, they're not usable yet for storytelling. When we set out to build Linum v3 (our next video model) earlier this year, the primary goal was to bring the cost envelope of inference down significantly. If our model is fast and cheap, it's the first step (of many) towards useful creative tools. Typically, you see "latent diffusion models". A VAE (Variational Autoencoder) compresses the input data into a smaller "latent space" and the diffusion model learns how to generate within this subspace. Over the past few months, we've been publishing our work on efficient pixel-space diffusion models. These throw away the VAE, having the diffusion model learn a latent-space optimized for its exact task. This serves 3 purposes: 1) Simplify Architecture (no 2-stage model training) 2) Faster Convergence (11x faster convergence vs. our latent diffusion counterpart) 3) Cheaper Inference (4x more aggressive token reduction in attention context-windows, without significant loss in quality) This past month we were pressure testing our latest architecture (Pyramid-JiT) by training a text-to-image model longer than the typical one-off experiment. Specifically, we trained it for ~$20K on 660M samples. We were surprised by the quality of results, so we thought we'd release it as open weights for the community (Apache 2.0). The research itself is already public, on our website. For us, it's a big stepping stone towards cheaper video models, since pretty much all video models start as image models. We like to say these models have to learn nouns before they learn verbs.

HN: open weights · 4 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
10

我写的《图解 Skill》的英文翻译版本即将发售

59.3

Hướng dẫn dotey

我写的《图解 Skill》的英文翻译版本即将发售 An Illustrated Guide to Agent Skills: Turn everyday repeatable tasks into reusable agentic workflows https://a.co/d/0d9fS6G8 With over 100,000 copies sold, this bestselling illustrated guide shows you how to create, test, combine, and share powerful Agent Skills for Claude Code, Codex, OpenClaw, and other compatible AI agents – all without writing code. Key Features - Learn visually with 85 skill-generated diagrams, 40 practical tables, and 67 field-tested tips - Use three ready-to-adapt skills plus a complete five-skill writing workflow - Follow one skill from first draft to a tested, production-ready data analysis project Book Description AI agents can follow a prompt once. Agent Skills help them repeat your best way of working. This illustrated guide from an early skills adopter shows you how to turn hard-won knowledge, recurring tasks, and proven processes into reusable skills that deliver more consistent results. Start by running your first skill in Claude Code, OpenClaw, or another compatible agent. Clear diagrams explain the six building blocks of an agent, how skills differ from prompts, and how on-demand loading keeps context focused. You will then create practical skills for writing style, meeting minutes, and article illustrations before combining them into a five-skill content workflow using serial, parallel, loop, and sub-agent patterns. The focus stays on outcomes. Learn when a task should become a skill, what the model should handle, when scripts are safer, and how to protect data with practical security gates. Follow a complete skill engineering process from requirements and design to testing, scoring, iteration, release, and team sharing. A three-stage data analysis project takes you from a minimal SKILL.md to a production-ready package that generates professional visual reports. No programming background is required. What you will learn - Run and inspect Agent Skills across compatible AI agents - Turn repeatable tasks and personal expertise into reusable SKILL.md files - Write descriptions that help agents select the right skill - Manage context with on-demand loading for more reliable results - Combine skills in serial, parallel, loop, and sub-agent workflows - Set secure boundaries between models, scripts, and tools - Test, score, debug, version, and share skills for personal or team use Who this book is for For knowledge workers, creators, AI power users, and developers who want agents to handle repeatable work more consistently. It suits readers using Claude Code, Codex, OpenClaw, or similar AI agents, as well as teams building reusable workflows for writing, meetings, visual content, research, and data analysis. No programming experience is required; technical readers will also value the practical guidance on scripts, testing, security, deployment, and multi-agent workflows.

X · 19 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
11

How to own a keyword on YouTube with Grok Bot:

59.1

Hướng dẫn gregisenberg

How to own a keyword on YouTube with Grok Bot: 1. Set up a weekly routine where your Grok Bot finds a keyword in your space that’s rising month over month (Louise connects hers to vidIQ) 2. Have it check whether anyone has made a good video on it yet 3. If they haven’t, record the video this week 4. Let Grok Bot write the title, description and chapters around that keyword, then publish Media

X · 19 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
12

Full Fine-Tuning (FFT) on SageMaker AI Serverless Model Customization

59.0

Hướng dẫn Sandeep Raveesh-Babu

<p>Fine-tuning is the process of continuing to train a pretrained large language model (LLM) on a company’s own data so it adapts to a specific domain, task, or style rather than relying on general-purpose knowledge alone. For businesses, the value is twofold. A fine-tuned model delivers measurably better accuracy on domain-specific work while reducing costs: a smaller specialized model can match or exceed a frontier model on your task at a fraction of the per-token inference price. Those savings compound across millions of requests. Fine-tuning has therefore become an essential process for businesses looking to get more value from LLMs at lower costs.</p> <p>Parameter-efficient fine-tuning (PEFT) methods like Low-Rank Adaptation (LoRA) have emerged as a practical solution for fine-tuning LLMs to downstream tasks, reducing GPU capacity requirements by updating only a small subset of LLM parameters. LoRA aims to strike a balance between efficiency and expressiveness, however, the low-rank nature of the weight update inherently limits the representation power of LoRA fine-tuned models, potentially compromising performance on complex tasks. This trade-off hampers the ability of LoRA methods to capture complex patterns needed for diverse tasks. To address these challenges, Full Fine-Tuning (FFT) updates model parameters simultaneously, overcoming the low-rank limitations so LLMs can fully absorb complex domain-specific knowledge.</p> <p><a href="https://aws.amazon.com/sagemaker/ai/model-customization/" target="_blank" rel="noopener">Amazon SageMaker AI Serverless Model Customization</a> now supports <a href="http://docs.aws.amazon.com/sagemaker/latest/dg/customizing-models-fft.html" target="_blank" rel="noopener">Full Fine-Tuning (FFT)</a>, so you can achieve superior model quality without managing infrastructure. There is no GPU provisioning, cluster setup, or distributed-training configuration required. In this post, we explore when and where FFT consistently outperforms LoRA across key benchmarks, examine the spectral properties of model weight matrices that explain this quality gap, provide practical hyperparameter tuning guidelines backed by controlled experiments using SageMaker AI Serverless Model Customization, and show you how to get started with FFT on SageMaker AI.</p> <h2 id="full-fine-tuning-why-it-matters">Full Fine-Tuning: Why it matters</h2> <p>Model customization types like LoRA reduce trainable parameters by freezing the pre-trained model’s weights and injecting small, separate pairs of replacement matrices (called low-rank matrices) into the model layers. This works well for simple adaptations, but the low-rank structure inherently limits the representation power of the fine-tuned model. As tasks grow more complex and datasets scale beyond tens of thousands of examples, LoRA hits an accuracy plateau where increasing rank (and thus trainable parameters) fails to bridge the accuracy gap with standard fine-tuning. This plateau reveals that the performance gap isn’t simply because of fewer parameters. It’s caused by rank deficiency itself. The low-rank update can’t capture the full complexity of the weight changes needed for deep task adaptation.</p> <p>However, for complex tasks and domains where large, good-quality datasets exist, full-rank fine-tuning excels by updating model parameters simultaneously. FFT modifies the model’s weight matrix uniformly, using the full representational capacity of the model’s weight matrices rather than restricting updates to a small subspace, and without introducing the abrupt, localized distortions characteristic of low-rank methods. The result is stronger model convergence, better activation alignment across model layers, and a model that faithfully captures both the target task distribution and the richness of its pre-trained knowledge. FFT’s quality advantage grows with dataset scale: at 100K+ training examples, FFT achieved 90.0 percent on LLM-as-Judge semantic correctness across code generation tasks, as shown in the following chart.</p> <div style="width: 810px" class="wp-caption alignnone"> <a href="https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/11/16/ML-21644-1.png" target="_blank" rel="noopener"><img src="https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/11/16/ML-21644-1.png" alt="LLM-as-Judge semantic correctness by training method as training data scales to 100K-plus examples" width="800"></a> <p class="wp-caption-text">Figure 1: LLM-as-Judge semantic correctness by training method as training data scales to 100K+ examples</p> </div> <p>Furthermore, the following radar chart provides a holistic view: the base model (inner polygon) shows consistently low scores across all axes. LoRA (middle polygon) shows strong, balanced improvement. FFT (outer polygon) extends further on every dimension, with particularly pronounced leads on BLEU and ROUGE-2 scores. This multi-dimensional quality lead confirms that it isn’t a metric-specific artifact but a fundamental advantage of full-rank optimization.</p> <div style="width: 810px" class="wp-caption alignnone"> <a href="https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/11/16/ML-21644-2.png" target="_blank" rel="noopener"><img src="https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59/2026/11/16/ML-21644-2.png" alt="Radar chart comparing the base model, LoRA, and FFT across BLEU, ROUGE, and correctness metrics" width="800"></a> <p class="wp-caption-text">Figure 2: Radar chart comparing the base model, LoRA, and FFT across quality dimensions</p> </div> <p>The details of how we arrived at these results, the coding datasets used for model customization, and the experimentation process are explained in detail in the following sections.</p> <h2 id="experimentation-and-benchmark-results">Experimentation and benchmark results</h2> <p>In this post we used the <a href="https:/

AWS Machine Learning Blog · 19 thg 11, 2026

Nguyên văn nguồn
Chi tiết nguồn
7–12 / 179
Trang 2 / 30