AllyshipContent Radar

News 2859

Chủ đề cộng đồng đang thảo luận

Crawl live-1795115700000 · 02:15 20 thg 11, 2026 · Xuất bản 02:31 20 thg 11, 2026

206 / 2859 chủ đề đạt ngưỡng 55 trong khoảng này.

1

Orca - chạy một đội các coding agents bằng subscription của bạn

72

2 tiếng nói · chưa gắn nhãn trưởng lab · 2 nền tảng · chưa có số tương tác · Nguồn crawl

stablyai, orca_build 0 bài viết · GitHub discovery: AI agents, X
Biên tập tiếng Việt
Chi tiết nguồn

Orca được mô tả là cho phép chạy một “fleet of coding agents” (ví dụ Claude Code, Codex) với subscription của riêng bạn. Nền tảng có sẵn trên desktop, mobile và remote runtime.

Orca lets you run a fleet of coding agents (e.g. Claude Code, Codex) with your own subscription. Available on desktop, mobile and remote runtime.

  • Orca lets you run a fleet of coding agents (e.g. Claude Code, Codex) with your own subscription.
  • Orca lets you run a fleet of coding agents (e.g. Claude Code, Codex) with your own subscription.
  • Available on desktop, mobile and remote runtime.
2

Archify - biến ý tưởng/plan/codebase thành sơ đồ tương tác

72

2 tiếng nói · chưa gắn nhãn trưởng lab · 2 nền tảng · chưa có số tương tác · Nguồn crawl

tt-a1i, tom_doerr 0 bài viết · GitHub discovery: LLM, X
Biên tập tiếng Việt
Chi tiết nguồn

Archify được mô tả là chuyển mọi ý tưởng, kế hoạch hoặc codebase thành một sơ đồ tương tác “đẹp”. Nó là một agent skill cho Claude Code, Codex và nhiều nền tảng khác.

Turn any idea, plan, or codebase into a beautiful interactive diagram. An agent skill for Claude Code, Codex, and more.

  • Turn any idea, plan, or codebase into a beautiful interactive diagram.
  • Turn any idea, plan, or codebase into a beautiful interactive diagram.
  • An agent skill for Claude Code, Codex, and more.
5

b12549

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

github-actions[bot] 1 bài viết · ggml-org/llama.cpp releases
Nguyên văn nguồn
Chi tiết nguồn

<details open=""> <p>llama: fixes for Inkling 2 attention mask (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6428533227" data-permission-text="Title is private" data-url="https://github.com/ggml-org/llama.cpp/issues/32429" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/32429/hovercard" href="https://github.com/ggml-org/llama.cpp/pull/32429">#32429</a>)</p> <ul> <li>llama : give Inkling2 its own relative-position attention input</li> </ul> <p>The Inkling2 graph built its flash attention mask from the hybrid iswa<br> input and passed it to build_attn through a new kq_mask argument. That<br> argument let a caller pair its own dense mask with the kv_rows of<br> llm_graph_input_attn_kv_iswa, whose mask follows the per-sequence cell<br> lists whenever kv_rows is enabled.</p> <p>Add llm_graph_input_attn_rel_pos instead. It owns dense KQ masks and the<br> query-to-cell distances, fills both from the same cells, and its<br> build_attn overload adds the per-head bias to its own mask and never<br> passes kv_rows. The iswa build_attn is back to its previous signature;<br> its body moves to build_attn_iswa_impl, which both overloads call.</p> <p>Inkling2 now folds the per-query sink into the bias with and without<br> flash attention, so build_attn_mha no longer needs the per-query sink<br> path.</p> <p>Assisted-By: Claude Opus 5.5 <a href="mailto:noreply@anthropic.com">noreply@anthropic.com</a></p> <ul> <li>inkling2 : make the expert weight scale and final logit softcap optional</li> </ul> <p>Load both keys as optional and skip them when they are zero, as other<br> models do, instead of rejecting zero at load.</p> <p>Assisted-By: Claude Opus 5.5 <a href="mailto:noreply@anthropic.com">noreply@anthropic.com</a></p> <ul> <li>llama : build kv_rows masks for the hybrid iswa memory</li> </ul> <p>llm_graph_input_mem_hybrid_iswa checked its masks with<br> can_reuse_attn_mask, which expects kv_rows whenever they are enabled,<br> but built them dense. With a unified cache and flash attention the<br> check always failed, and hybrid iswa models (LFM2, LFM3, Inkling2)<br> never reused a graph. Build the masks with build_attn_inp_attn_mask,<br> like the plain iswa input.</p> <p>Assisted-By: Claude Opus 5.5 <a href="mailto:noreply@anthropic.com">noreply@anthropic.com</a></p> <ul> <li>llama : make the relative-position input a hybrid iswa input</li> </ul> <p>Address review: llm_graph_input_mem_hybrid_iswa_rel derives from<br> llm_graph_input_mem_hybrid_iswa and owns the attention and recurrent<br> inputs, so Inkling2 builds one memory input instead of two. Its<br> attention input is built with dense masks, can_reuse checks them as<br> dense, and its build_attn asserts that the mask has no kv_rows (TODO:<br> a kv_rows variant). build_attn_iswa_impl is now a static helper.</p> <p>Assisted-By: Claude Opus 5.5 <a href="mailto:noreply@anthropic.com">noreply@anthropic.com</a></p> <ul> <li>llama : compose the hybrid iswa rel input, format inkling2</li> </ul> <p>Address review: llm_graph_input_mem_hybrid_iswa_rel owns its attention<br> and recurrent inputs like the other composite inputs instead of deriving<br> from llm_graph_input_mem_hybrid_iswa.</p> <p>Format src/models/inkling2.cpp like the other model sources: grouped<br> and aligned key and tensor loading, descriptive per-layer names, blank<br> lines and section comments between the steps, and cb() names for the<br> intermediate tensors. The graph is unchanged.</p> <p>Assisted-By: Claude Opus 5.5 <a href="mailto:noreply@anthropic.com">noreply@anthropic.com</a></p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> <p><strong>Attestations:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/attestations/69772952">https://github.com/ggml-org/llama.cpp/attestations/69772952</a></li> </ul> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-macos-arm64.tar.gz">macOS Apple Silicon (arm64)</a></li> <li>macOS Apple Silicon (arm64, KleidiAI enabled) <a href="https://github.com/ggml-org/llama.cpp/pull/23780" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/23780/hovercard">DISABLED</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-macos-x64.tar.gz">macOS Intel (x64)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-xcframework.zip">iOS XCFramework</a></li> </ul> <p><strong>Linux:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-x64.tar.gz">Ubuntu x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-arm64.tar.gz">Ubuntu arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-s390x.tar.gz">Ubuntu 24.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-26.04-s390x.tar.gz">Ubuntu 26.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-zdnn-s390x.tar.gz">Ubuntu 26.04 s390x (zDNN)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-vulkan-x64.tar.gz">Ubuntu x64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-vulkan-arm64.tar.gz">Ubuntu arm64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/llama-b12549-bin-ubuntu-cuda-12.8-x64.tar.gz">Ubuntu x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12549/cudart-llama-b12549-bin-ubuntu-cuda-12.8-x64.tar.gz">CUDA 12.8 libraries</a>

  • b12549 ggml-org/llama.cpp releases · 20 thg 11, 2026
6

b12548

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

github-actions[bot] 1 bài viết · ggml-org/llama.cpp releases
Nguyên văn nguồn
Chi tiết nguồn

<details open=""> <p>metal : fix the second argument of NSMakeRange (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6488409917" data-permission-text="Title is private" data-url="https://github.com/ggml-org/llama.cpp/issues/32602" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/32602/hovercard" href="https://github.com/ggml-org/llama.cpp/pull/32602">#32602</a>)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> <p><strong>Attestations:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/attestations/69767057">https://github.com/ggml-org/llama.cpp/attestations/69767057</a></li> </ul> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-macos-arm64.tar.gz">macOS Apple Silicon (arm64)</a></li> <li>macOS Apple Silicon (arm64, KleidiAI enabled) <a href="https://github.com/ggml-org/llama.cpp/pull/23780" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/23780/hovercard">DISABLED</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-macos-x64.tar.gz">macOS Intel (x64)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-xcframework.zip">iOS XCFramework</a></li> </ul> <p><strong>Linux:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-x64.tar.gz">Ubuntu x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-arm64.tar.gz">Ubuntu arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-s390x.tar.gz">Ubuntu 24.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-26.04-s390x.tar.gz">Ubuntu 26.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-zdnn-s390x.tar.gz">Ubuntu 26.04 s390x (zDNN)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-vulkan-x64.tar.gz">Ubuntu x64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-vulkan-arm64.tar.gz">Ubuntu arm64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-cuda-12.8-x64.tar.gz">Ubuntu x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/cudart-llama-b12548-bin-ubuntu-cuda-12.8-x64.tar.gz">CUDA 12.8 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-cuda-13.5-x64.tar.gz">Ubuntu x64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/cudart-llama-b12548-bin-ubuntu-cuda-13.5-x64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-cuda-13.5-arm64.tar.gz">Ubuntu arm64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/cudart-llama-b12548-bin-ubuntu-cuda-13.5-arm64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-rocm-10.0-x64.tar.gz">Ubuntu x64 (ROCm 10.0)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-openvino-2026.4.1-x64.tar.gz">Ubuntu x64 (OpenVINO)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-sycl-fp32-x64.tar.gz">Ubuntu x64 (SYCL FP32)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-ubuntu-sycl-fp16-x64.tar.gz">Ubuntu x64 (SYCL FP16)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-linux-arm64-snapdragon.tar.gz">Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md">setup guide</a></li> </ul> <p><strong>Android:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-android-arm64.tar.gz">Android arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-android-arm64-snapdragon.tar.gz">Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md">setup guide</a></li> </ul> <p><strong>Windows:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-win-cpu-x64.zip">Windows x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-win-cpu-arm64.zip">Windows arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-win-opencl-adreno-arm64.zip">Windows arm64 (OpenCL Adreno)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-win-cuda-12.4-x64.zip">Windows x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/cudart-llama-bin-win-cuda-12.4-x64.zip">CUDA 12.4 DLLs</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-win-cuda-13.5-x64.zip">Windows x64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/cudart-llama-bin-win-cuda-13.5-x64.zip">CUDA 13.5 DLLs</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12548/llama-b12548-bin-win-cuda-13.5-arm

  • b12548 ggml-org/llama.cpp releases · 20 thg 11, 2026
7

Read the process and how we're thinking about it here: https://www.llamaindex.ai/blog/building-toward-a-perfect-document-parsing-benchmark?utm_source=socials&utm_medium=tw_channel&utm_campaign=blogpos

64

2 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

LlamaIndex, jerryjliu0 0 bài viết · X
Nguyên văn nguồn
Chi tiết nguồn

Read the process and how we're thinking about it here: https://www.llamaindex.ai/blog/building-toward-a-perfect-document-parsing-benchmark?utm_source=socials&utm_medium=tw_channel&utm_campaign=blogpost&utm_content=blogperfectbenchmark

8

Claude solves two open problems in the physics of black holes

86

2 tiếng nói · chưa gắn nhãn trưởng lab · 2 nền tảng · 162 tương tác đã đo · Nguồn crawl

Handy-Man, cybermango 1 bài viết · HN: Claude, Anthropic Research (unofficial RSS mirror)
Nguyên văn nguồn
Chi tiết nguồn
9

PolyAI Dialog-RSN-1 is now on Amazon SageMaker JumpStart

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

Helen Greul 1 bài viết · AWS Machine Learning Blog
Nguyên văn nguồn
Chi tiết nguồn

<p>Dialog-RSN-1, a reasoning model built for real-time complex dialog, is available today on AWS Marketplace and Amazon SageMaker JumpStart. It powers frontier dialog: agents that hear a live call, reason about it, and act in real time.</p> <p>As an AWS customer, you can <a href="https://aws.amazon.com/marketplace/pp/prodview-l4qyhvfxnkq7e" target="_blank" rel="noopener">subscribe to Dialog-RSN-1 through AWS Marketplace</a> and deploy it as a SageMaker endpoint inside your own AWS environment. You can also deploy directly from Amazon SageMaker Studio following the steps in <a href="https://aws.amazon.com/blogs/machine-learning/deploy-and-evaluate-models-with-amazon-sagemaker-jumpstart/" target="_blank" rel="noopener">Deploy and evaluate models with Amazon SageMaker JumpStart</a>. That means the model designed to handle your customer conversations can be deployed like other Amazon SageMaker models with an AWS Marketplace subscription.</p> <h2 id="deploying-dialog-rsn-1-inside-aws">Deploying Dialog-RSN-1 inside AWS</h2> <p>Dialog-RSN-1 is the first PolyAI model available through <a href="https://aws.amazon.com/marketplace/pp/prodview-l4qyhvfxnkq7e" target="_blank" rel="noopener">AWS Marketplace</a>. It runs inside your own AWS environment on the same AWS cloud that powers PolyAI’s compute and model training and serving.</p> <p>All in a single pass, Dialog-RSN-1 perceives a caller’s audio directly, reasons about what they need, and responds in real time. On SageMaker, it deploys as an endpoint like other models you run there. It is reachable from your own architecture, billed through your AWS account, and covered by the same virtual private cloud (VPC), AWS Identity and Access Management (IAM) roles, and monitoring you already have in place.</p> <p>You keep ownership of orchestration, telephony integration, and business logic. Dialog-RSN-1 takes off your plate the hardest part to build yourself: understanding a live call and responding to it in real time. The endpoint speaks the OpenAI Realtime protocol, so an existing Realtime client connects through PolyAI’s <a href="https://github.com/polyai/dialog-rsn-1-sagemaker" target="_blank" rel="noopener">bridge</a> by changing its base URL. Audio in is 16-bit PCM mono at 16 or 24 kHz (transcode G.711 or Opus first). Connections last up to 30 minutes, and the model is English-only today.</p> <p>To get started, <a href="https://aws.amazon.com/marketplace/pp/prodview-l4qyhvfxnkq7e" target="_blank" rel="noopener">find Dialog-RSN-1 on AWS Marketplace</a>, then deploy it straight into an Amazon SageMaker endpoint in your own account. Or you can deploy directly from <a href="https://aws.amazon.com/sagemaker/ai/jumpstart/" target="_blank" rel="noopener">Amazon SageMaker JumpStart</a>.</p> <p>With Dialog-RSN-1 now onboarded to SageMaker JumpStart, deploying Dialog-RSN-1 takes one click. From the Amazon SageMaker AI console, open the Model Hub, select Dialog-RSN-1 from the JumpStart catalog, and choose Deploy. SageMaker JumpStart then spins up a real-time inference endpoint on a serving stack it has already tuned for you. No containers to wrangle, no instance types to second-guess, and no manual benchmarking. For automated workflows, the same one-click deployment also runs in a few lines of the SageMaker Python SDK.</p> <p>The Dialog-RSN-1 endpoint runs entirely within your own AWS account. It is deployed in your VPC, accessed through your IAM roles, and monitored with the same Amazon CloudWatch logging and metrics you use for every other workload. Because inference happens inside your account, your callers’ audio and transcripts stay within a boundary you control. For a model handling live customer conversation, this helps support your data residency and auditability requirements.</p> <h2 id="built-for-speed-and-accuracy">Built for speed and accuracy</h2> <p>Models built for live calls may make you choose between speed and understanding. And models built for speed may miss the meaning, and ones built for reasoning may lead to wait time for callers. Dialog-RSN-1 avoids the tradeoff.</p> <p>With PolyAI, you can build dialog agents that hear and handle calls the way your human agents would. These agents catch hesitation, hear frustration before it escalates, and know when to speak.</p> <p>Real-time customer conversation is the job PolyAI’s Dialog-RSN-1 is built for, and it is already handling live calls in production today. Because the model reasons directly over the caller’s audio, it picks up tone, hesitation, and timing, the signals a plain transcript loses, and decides for itself the right moment to respond.</p> <h2 id="a-model-that-hears-calls-the-way-humans-do">A model that hears calls the way humans do</h2> <p>Dialog-RSN-1 is a model focused on real-time conversations. There is no separate speech-to-text step and no reasoning model on the appropriate moment to talk, so thereby no multiple handoffs.</p> <p>In practice, that means the callers get responses faster:</p> <ul> <li>Barge-in keeps working even when call volume spikes, instead of getting switched off to protect performance.</li> <li>Responses keep pace, so the model is not lagging behind the conversation while it reasons through what to say.</li> <li>Transcription is produced from the audio itself, because Dialog-RSN-1 is reading the actual audio, not someone else’s best guess at it.</li> </ul> <h2 id="dialog-rsn-1-on-amazon-sagemaker-jumpstart">Dialog-RSN-1 on Amazon SageMaker JumpStart</h2> <p>Amazon SageMaker JumpStart is the machine learning hub inside Amazon SageMaker AI, and it exists to collapse the distance between choosing a model and running it in production. For Dialog-RSN-1, that means the frontier of real-time dialog is a few clicks away. You can discover it, prove it on your own data, and ship it to a secure endpoint, all in one place. Here is what you get.</p> <div style="width: 810px" class="wp-caption alignnone"> <a href="https://d2908q01vomqb2.cloudfront.net/f1f836cb4ea6efb2a

11

Read more in our launch blog, so excited to see where you all take this: https://blog.google/innovation-and-ai/technology/developers-tools/genie-4-in-gemini-api/

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

officiallogank 0 bài viết · X
Nguyên văn nguồn
Chi tiết nguồn

Read more in our launch blog, so excited to see where you all take this: https://blog.google/innovation-and-ai/technology/developers-tools/genie-4-in-gemini-api/

12

Introducing Genie 4 in the Gemini API + @GoogleAIStudio, our first world model for developers to build with and create new world model experiences 🔮

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

officiallogank 0 bài viết · X
Nguyên văn nguồn
Chi tiết nguồn

Introducing Genie 4 in the Gemini API + @GoogleAIStudio, our first world model for developers to build with and create new world model experiences 🔮 Try it out: https://ai.studio/genie

13

Today we are rolling out Genie 4 on the Gemini API and AI Studio🚀

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

_philschmid 0 bài viết · X
Nguyên văn nguồn
Chi tiết nguồn

Today we are rolling out Genie 4 on the Gemini API and AI Studio🚀 Seed a 720p 24fps world from text or image and steer it live with WASD, prompts, and 48 kHz stereo audio. Stream via WebRTC (browser + ephemeral tokens) or WebSocket. Available on: - Gemini API: https://aistudio.google.com/docs/genie - AI Studio: https://aistudio.google.com/live?model=genie-4

14

b12547

56

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

github-actions[bot] 1 bài viết · ggml-org/llama.cpp releases
Nguyên văn nguồn
Chi tiết nguồn

<details open=""> <p>webgpu: add POOL_2D support (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6387361702" data-permission-text="Title is private" data-url="https://github.com/ggml-org/llama.cpp/issues/32250" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/32250/hovercard" href="https://github.com/ggml-org/llama.cpp/pull/32250">#32250</a>)</p> <ul> <li> <p>Shader, pipeline, and launcher</p> </li> <li> <p>Update docs and add newline to wgsl</p> </li> <li> <p>Formatting fixes</p> </li> </ul> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> <p><strong>Attestations:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/attestations/69756852">https://github.com/ggml-org/llama.cpp/attestations/69756852</a></li> </ul> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-macos-arm64.tar.gz">macOS Apple Silicon (arm64)</a></li> <li>macOS Apple Silicon (arm64, KleidiAI enabled) <a href="https://github.com/ggml-org/llama.cpp/pull/23780" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/23780/hovercard">DISABLED</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-macos-x64.tar.gz">macOS Intel (x64)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-xcframework.zip">iOS XCFramework</a></li> </ul> <p><strong>Linux:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-x64.tar.gz">Ubuntu x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-arm64.tar.gz">Ubuntu arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-s390x.tar.gz">Ubuntu 24.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-26.04-s390x.tar.gz">Ubuntu 26.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-zdnn-s390x.tar.gz">Ubuntu 26.04 s390x (zDNN)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-vulkan-x64.tar.gz">Ubuntu x64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-vulkan-arm64.tar.gz">Ubuntu arm64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-cuda-12.8-x64.tar.gz">Ubuntu x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/cudart-llama-b12547-bin-ubuntu-cuda-12.8-x64.tar.gz">CUDA 12.8 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-cuda-13.5-x64.tar.gz">Ubuntu x64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/cudart-llama-b12547-bin-ubuntu-cuda-13.5-x64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-cuda-13.5-arm64.tar.gz">Ubuntu arm64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/cudart-llama-b12547-bin-ubuntu-cuda-13.5-arm64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-rocm-10.0-x64.tar.gz">Ubuntu x64 (ROCm 10.0)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-openvino-2026.4.1-x64.tar.gz">Ubuntu x64 (OpenVINO)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-sycl-fp32-x64.tar.gz">Ubuntu x64 (SYCL FP32)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-ubuntu-sycl-fp16-x64.tar.gz">Ubuntu x64 (SYCL FP16)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-linux-arm64-snapdragon.tar.gz">Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md">setup guide</a></li> </ul> <p><strong>Android:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-android-arm64.tar.gz">Android arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-android-arm64-snapdragon.tar.gz">Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md">setup guide</a></li> </ul> <p><strong>Windows:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-win-cpu-x64.zip">Windows x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-win-cpu-arm64.zip">Windows arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-win-opencl-adreno-arm64.zip">Windows arm64 (OpenCL Adreno)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-win-cuda-12.4-x64.zip">Windows x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/cudart-llama-bin-win-cuda-12.4-x64.zip">CUDA 12.4 DLLs</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/llama-b12547-bin-win-cuda-13.5-x64.zip">Windows x64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12547/cudart-llama-bin-win-cuda-13.5-x64.zip">CUDA

  • b12547 ggml-org/llama.cpp releases · 20 thg 11, 2026
15

Let's goooo! Super excited to announce our partnership with @Replit & @amasad for our Ramadan Global Buildathon!

55

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

arblauvelt 0 bài viết · X
Nguyên văn nguồn
Chi tiết nguồn

Let's goooo! Super excited to announce our partnership with @Replit & @amasad for our Ramadan Global Buildathon! Limited to 1,000 teams - already past the 100 mark. Learn more & register today: http://Build.LaunchGood.com ps - would it be wrong to participate in my own Buildathon? I have an idea for a physical product 😅 Media

16

Enabling Real-Time AI for Scientific Instruments with GPU-Native Data Acquisition

55

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

Cara Laasch 1 bài viết · NVIDIA Developer Blog
Nguyên văn nguồn
Chi tiết nguồn

In science and industry, analyzing sensor measurements in real time can enable AI to adjust processes, guide experiments, and search for better operating... In science and industry, analyzing sensor measurements in real time can enable AI to adjust processes, guide experiments, and search for better operating conditions. Yet limits on how quickly the measured data can be moved and processed often shape how an instrument is designed, from readout electronics to acquisition timing. What could scientific instrument makers simplify—or make possible—if… Source

17

b12546

55

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

github-actions[bot] 1 bài viết · ggml-org/llama.cpp releases
Nguyên văn nguồn
Chi tiết nguồn

<details open=""> <p>llama : remove redundant fields from llm_graph_params (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="6486857483" data-permission-text="Title is private" data-url="https://github.com/ggml-org/llama.cpp/issues/32596" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/32596/hovercard" href="https://github.com/ggml-org/llama.cpp/pull/32596">#32596</a>)</p> <p>llm_graph_params no longer carries hparams, prec_policy and hdmd, since the model reference already provides them. llm_graph_context sources them from the model and keeps prec_policy as a reference.</p> <p>Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)</p> </details> <p><strong>Website:</strong></p> <ul> <li><a href="https://llama.app" rel="nofollow">https://llama.app</a></li> </ul> <p><strong>Attestations:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/attestations/69749431">https://github.com/ggml-org/llama.cpp/attestations/69749431</a></li> </ul> <p><strong>macOS/iOS:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-macos-arm64.tar.gz">macOS Apple Silicon (arm64)</a></li> <li>macOS Apple Silicon (arm64, KleidiAI enabled) <a href="https://github.com/ggml-org/llama.cpp/pull/23780" data-hovercard-type="pull_request" data-hovercard-url="/ggml-org/llama.cpp/pull/23780/hovercard">DISABLED</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-macos-x64.tar.gz">macOS Intel (x64)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-xcframework.zip">iOS XCFramework</a></li> </ul> <p><strong>Linux:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-x64.tar.gz">Ubuntu x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-arm64.tar.gz">Ubuntu arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-s390x.tar.gz">Ubuntu 24.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-26.04-s390x.tar.gz">Ubuntu 26.04 s390x (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-zdnn-s390x.tar.gz">Ubuntu 26.04 s390x (zDNN)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-vulkan-x64.tar.gz">Ubuntu x64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-vulkan-arm64.tar.gz">Ubuntu arm64 (Vulkan)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-cuda-12.8-x64.tar.gz">Ubuntu x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/cudart-llama-b12546-bin-ubuntu-cuda-12.8-x64.tar.gz">CUDA 12.8 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-cuda-13.5-x64.tar.gz">Ubuntu x64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/cudart-llama-b12546-bin-ubuntu-cuda-13.5-x64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-cuda-13.5-arm64.tar.gz">Ubuntu arm64 (CUDA 13)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/cudart-llama-b12546-bin-ubuntu-cuda-13.5-arm64.tar.gz">CUDA 13.5 libraries</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-rocm-10.0-x64.tar.gz">Ubuntu x64 (ROCm 10.0)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-openvino-2026.4.1-x64.tar.gz">Ubuntu x64 (OpenVINO)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-sycl-fp32-x64.tar.gz">Ubuntu x64 (SYCL FP32)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-ubuntu-sycl-fp16-x64.tar.gz">Ubuntu x64 (SYCL FP16)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-linux-arm64-snapdragon.tar.gz">Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md">setup guide</a></li> </ul> <p><strong>Android:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-android-arm64.tar.gz">Android arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-android-arm64-snapdragon.tar.gz">Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)</a> - <a href="https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md">setup guide</a></li> </ul> <p><strong>Windows:</strong></p> <ul> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-win-cpu-x64.zip">Windows x64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-win-cpu-arm64.zip">Windows arm64 (CPU)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-win-opencl-adreno-arm64.zip">Windows arm64 (OpenCL Adreno)</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/llama-b12546-bin-win-cuda-12.4-x64.zip">Windows x64 (CUDA 12)</a> - <a href="https://github.com/ggml-org/llama.cpp/releases/download/b12546/cudart-llama-bin-win-cuda-12.4-x64.zip">CUDA 12.4 DLLs</a></li> <li><a href="https://github.com/ggml-org/llama.cpp/releases/download/b1254

  • b12546 ggml-org/llama.cpp releases · 19 thg 11, 2026
18

recommendrd viewing, even if i think the amount of unsubstantiated claims and extrapolations is too damn high. still fun to listen to and think why what is claimed may or may not happen.

55

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

badlogicgames 0 bài viết · X
Nguyên văn nguồn
Chi tiết nguồn

recommendrd viewing, even if i think the amount of unsubstantiated claims and extrapolations is too damn high. still fun to listen to and think why what is claimed may or may not happen. https://youtu.be/1NHPDzpfR6Y?is=cGj8ducdmD_Z4FO1

19

Show HN: AgentMall – Let your AI agent buy groceries

64

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · 19 tương tác đã đo · Nguồn crawl

desilva78_ 1 bài viết · HN: GPT
Nguyên văn nguồn
Chi tiết nguồn

Hey HN, we’re Nel and Kosi. We noticed personal agents like Instinct, Muse were terrible at buying stuff. Most of the time the checkout would fail. So we built reliable automations for agents to checkout at 9 leading grocery merchants. We grapple with anti bot, logins, OTP codes, and changing checkout structures. Loved revisiting this stuff given our backgrounds sneaker-botting and building computer use models. Honestly full circle haha. It currently works on these sites with ~70% checkout success rate: - Walmart - Albertsons - Ocado - Wegmans - FreshDirect - Best Buy - Instacart Our goal is to hill climb to 90%+ across each. Test keys are free and run the real flow without placing an order. New accounts get 10 free completed orders. https://docs.getagentmall.com/quickstart

20

Introducing enhanced infrastructure observability in Amazon SageMaker HyperPod

55

1 tiếng nói · chưa gắn nhãn trưởng lab · 1 nền tảng · chưa có số tương tác · Nguồn crawl

Mijanur Palash 1 bài viết · AWS Machine Learning Blog
Nguyên văn nguồn
Chi tiết nguồn

<p>Large-scale model training is one of the most expensive workloads you can run on GPUs, and a single unhealthy accelerator can stall an entire distributed job. When training throughput drops, the hard part is rarely noticing that something is wrong. It is figuring out why and where. Teams often spend hours or days sifting through logs and disconnected dashboards to decide whether a slowdown came from a throttled GPU, a saturated network link, or a stalled data pipeline on the host.</p> <p>Today, we are announcing enhanced observability in Amazon SageMaker HyperPod, a new capability that helps you diagnose GPU training issues faster. It brings together diagnostic and profiling capabilities for training workloads that run on both Amazon Elastic Kubernetes Service (Amazon EKS) and Slurm orchestrators:</p> <p><strong>Diagnostic summary</strong> uses Amazon CloudWatch’s DetectGroupOutliers API to compare each GPU in a training job on utilization, memory, temperature, power, and SM clock, and flags GPUs that deviate from their peers. Static diagnostic rules surface common failure patterns such as GPU hardware faults (XID errors, ECC memory errors), EFA throughput drops, thermal throttling, and overheating, so you catch degradation before it affects training.</p> <h2 id="why-you-need-it">Why you need it</h2> <p>Distributed training is expensive, and small inefficiencies compound into significant wasted GPU hours. Until now, getting visibility into HyperPod infrastructure meant stitching together separate tools, and even then, the metrics told you that performance had degraded without telling you why.</p> <p>Enhanced observability closes three gaps. It isolates a single bad accelerator across hundreds or thousands of GPUs whether through XID errors, ECC memory faults, or thermal throttling, so you spend time on the fix instead of the search.</p> <p>Together, these capabilities reduce troubleshooting time and help you keep expensive accelerators busy.</p> <h2 id="how-it-works">How it works</h2> <p>Each capability targets a different layer of a distributed training job.</p> <h3 id="default-and-advanced-metrics">Default and advanced metrics</h3> <p>Enhanced observability collects telemetry at two levels:</p> <p><strong>Default metrics</strong> (enabled automatically) cover cluster health, CPU/disk/OS-level usage, GPU utilization and temperature, and per-job resource utilization. These metrics are collected every 30 seconds and sent to your chosen metric store with approximately 1–2% CPU overhead and 250–300 MB of memory.</p> <p><strong>Advanced metrics</strong> (opt-in) provide deeper visibility:</p> <ul> <li><strong>Full node exporter suite:</strong> comprehensive host-level metrics.</li> <li><strong>All NVIDIA GPU DCGM and AWS Neuron metrics:</strong> detailed accelerator telemetry including clock speeds, power, PCIe activity, and error indicators.</li> <li><strong>Elastic Fabric Adapter (EFA) metrics:</strong> network interface throughput, drops, retransmissions, and errors.</li> </ul> <p>Advanced metrics are optional because they increase the volume of telemetry sent to your metric store, which has a cost implication. Most customers running small jobs on small clusters may not need them, but they are essential for long-running training jobs on large clusters where patterns emerge over time.</p> <h3 id="metric-stores">Metric stores</h3> <p>You can choose between two metric stores:</p> <ul> <li><strong>Amazon CloudWatch</strong> (new default) provides native monitoring through CloudWatch SageMaker Insights, so you can visualize metrics without leaving the AWS Management Console.</li> <li><strong>Amazon Managed Service for Prometheus</strong> for teams that standardize on Prometheus and Grafana for observability.</li> </ul> <p>Previously, only Prometheus was supported. CloudWatch is now the default, offering lower pricing compared to Amazon Managed Service Prometheus and tighter integration with the SageMaker console.</p> <h3 id="diagnostic-summary">Diagnostic summary</h3> <p>The diagnostic summary uses two complementary approaches to surface issues across your HyperPod cluster.</p> <p><strong>GPU outlier detection</strong> uses CloudWatch’s <em>DetectGroupOutliers</em> API to compare GPUs within a training job across utilization, memory usage, temperature, power draw, and SM clock frequency. When a GPU deviates significantly from its peers, it appears as an outlier card in the diagnostic summary. This works for both EKS and Slurm jobs.</p> <p><strong>Static diagnostic rules</strong> evaluate known failure patterns and organize detected issues by type:</p> <ul> <li><strong>Hardware:</strong> GPU ECC memory errors, XID faults, accelerator failures.</li> <li><strong>Network:</strong> EFA throughput degradation, packet drops, retransmissions.</li> <li><strong>Throttling:</strong> GPU clock throttling because of heat, board, or reliability limits.</li> <li><strong>Overheating:</strong> GPU temperatures exceeding configured limits.</li> </ul> <p>Each detected issue identifies the affected job, cluster, node, accelerator, and rank.</p> <h2 id="how-to-get-started">How to get started</h2> <p>Enhanced observability is delivered as an add-on for EKS-orchestrated clusters and as an extension for Slurm-orchestrated clusters, which means you control who can install or change it through AWS Identity and Access Management (IAM).</p> <h3 id="step-1-create-a-sagemaker-hyperpod-cluster">Step 1: Create a SageMaker HyperPod cluster</h3> <p>If you already have a cluster, you can use it. To create a new SageMaker HyperPod cluster, you can follow the <a href="https://awslabs.github.io/ai-on-sagemaker-hyperpod/" target="_blank" rel="noopener">step-by-step outline</a>. In general, the steps are as follows:</p> <ol type="1"> <li>On the Amazon SageMaker AI console, choose <strong>HyperPod clusters</strong> in the navigation pane.</li> <li>Choose <strong>Create HyperPod</strong> cluster and <strong>Orchestrated on Amazon E

1–20 / 206
Trang 1 / 11