#observability

The last six months in LLMs in five minutes

The last six months in LLMs in five minutes 19th May 2026 I put together these annotated slides from my five minute ligh…

Your doctor’s AI notetaker may be making things up, Ontario audit finds

In recent years, many overworked doctors have turned to so-called AI medical scribes to help automatically summarize pat…

Microsoft’s Edge Copilot update uses AI to pull information from across your tabs

Microsoft Edge is adding a new feature that will allow its Copilot AI chatbot to gather information from all of your ope…

llm 0.32a2

12th May 2026 A bunch of useful stuff in this LLM alpha, but the most important detail is this one: Most reasoning-capab…

Building Blocks for Foundation Model Training and Inference on AWS

Building Blocks for Foundation Model Training and Inference on AWS Figure: Adapted from "AI's Three Scaling Laws, Explai…

Real-Time Performance Monitoring and Faster Debugging with NCCL Inspector and Prometheus

Distributed deep learning depends on fast, reliable GPU-to-GPU communication using the NVIDIA Collective Communication L…

Production AI Playbook: Evaluation and Monitoring

This post is part of a series that explores proven strategies and practical examples for building reliable AI systems. N…

Streamlining generative AI development with MLflow v3.10 on Amazon SageMaker AI

Artificial Intelligence Streamlining generative AI development with MLflow v3.10 on Amazon SageMaker AI Today, we’re exc…

Run custom MCP proxies serverless on Amazon Bedrock AgentCore Runtime

Artificial Intelligence Run custom MCP proxies serverless on Amazon Bedrock AgentCore Runtime When AI agents connect to …

OpenAI available at FedRAMP Moderate

OpenAI has achieved FedRAMP 20x Moderate authorization(opens in a new window) for ChatGPT Enterprise and API Platform, m…

Build Strands Agents with SageMaker AI models and MLflow

Artificial Intelligence Build Strands Agents with SageMaker AI models and MLflow Enterprises building AI agents often re…

Build and deploy an automatic sync solution for Amazon Bedrock Knowledge Bases

Artificial Intelligence Build and deploy an automatic sync solution for Amazon Bedrock Knowledge Bases With Amazon Bedro…

Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron

Higher-order optimization algorithms such as Shampoo have been effectively applied in neural network training for at lea…

End-to-end lineage with DVC and Amazon SageMaker AI MLflow apps

Artificial Intelligence End-to-end lineage with DVC and Amazon SageMaker AI MLflow apps Production machine learning (ML)…

Applications of AI at OpenAI

Applications of AI at OpenAI Explore how OpenAI products and APIs bring AI into real-world use. OpenAI was founded with …

Working with files in ChatGPT

Working with files in ChatGPT Upload and work with files to analyze, edit, and generate content. ChatGPT allows you to u…

Orchestration vs. Choreography: Which One to Choose – or Use Both?

Orchestration vs. choreography isn’t just an architectural choice – it’s a decision about how your system thinks. Orches…

How we monitor internal coding agents for misalignment

How we monitor internal coding agents for misalignment Using our most powerful models to detect and study misaligned beh…

NVIDIA RTX Innovations Are Powering the Next Era of Game Development

NVIDIA RTX ray tracing and AI-powered neural rendering technologies are redefining how games are made, enabling a new st…

Reasoning models struggle to control their chains of thought, and that’s good

Reasoning models struggle to control their chains of thought, and that’s good Why a limitation of frontier models is rea…

Harness engineering: leveraging Codex in an agent-first world

Harness engineering: leveraging Codex in an agent-first world By Ryan Lopopolo, Member of the Technical Staff Over the p…

NVIDIA DLSS 4.5 Delivers Super Resolution Upgrades and New Dynamic Multi Frame Generation

NVIDIA DLSS 4 with Multi Frame Generation has become the fastest-adopted NVIDIA gaming technology ever. Over 250 games a…

Datadog uses Codex for system-level code review

Datadog uses Codex for system-level code review With Codex, Datadog brings system-wide context into every code review to…

Evaluating chain-of-thought monitorability

Evaluating chain-of-thought monitorability We introduce evaluations for chain-of-thought monitorability and study how it…

Tracing Hanging and Complicated GPU Kernels Down To The Source Code Dec 3, 2025 · 13 min read Several months ago, we published a blog post about CUDA Core Dump: An Effective Tool to Debug Memory Access Issues and Beyond, introducing a powerful technique for debugging illegal memory access...

Several months ago, we published a blog post about CUDA Core Dump: An Effective Tool to Debug Memory Access Issues and B…

LLM RAG Daniel Fleischer Research Engineer at Intel Labs Summarize Hacker News Posts with Haystack & OPEA Build a RAG pipeline to fetch live Hacker News posts and summarize them with a local LLM endpoint June 10, 2025

Summarize Hacker News Posts with Haystack & OPEA Build a RAG pipeline to fetch live Hacker News posts and summarize them…

CodeAgents + Structure: A Better Way to Execute Actions

CodeAgents + Structure: A Better Way to Execute Actions Figure 1: Accuracy comparison of three approaches: Structured Co…

Trace & Evaluate your Agent with Arize Phoenix

Trace & Evaluate your Agent with Arize Phoenix Building an agent is one thing; understanding its behavior is another. Th…

Bamba: Inference-Efficient Hybrid Mamba2 Model

Bamba: Inference-Efficient Hybrid Mamba2 Model 🐍 TL;DR We introduce Bamba-9B, an inference-efficient Hybrid Mamba2 mode…

New compliance and administrative tools for ChatGPT Enterprise

New compliance and administrative tools for ChatGPT Enterprise Update on December 11, 2025: The ChatGPT Compliance API i…

Democratic inputs to AI grant program: lessons learned and implementation plans

Democratic inputs to AI grant program: lessons learned and implementation plans We funded 10 teams from around the world…

Our approach to AI safety

Our approach to AI safety Ensuring that AI systems are built, deployed, and used safely is critical to our mission. Open…

Deploying 🤗 ViT on Vertex AI

Deploying 🤗 ViT on Vertex AI This post builds on top of the previous two posts linked above. You’re advised to check th…

Faster Text Generation with TensorFlow and XLA

Faster Text Generation with TensorFlow and XLA transformers using TensorFlow can now be compiled with XLA. It is up to 1…

My Journey to a serverless transformers pipeline on Google Cloud

My Journey to a serverless transformers pipeline on Google Cloud This article will discuss my journey to deploy theA gue…

Learning to summarize with human feedback

Learning to summarize with human feedback We’ve applied reinforcement learning from human feedback to train language mod…

Object Detection for Dummies Part 2: CNN, DPM and Overfeat

Part 1 of the “Object Detection for Dummies” series introduced: (1) the concept of image gradient vector and how HOG alg…

Asymmetric actor critic for image-based robot learning

Abstract Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. Ho…

Equivalence between policy gradients and soft Q-learning

Equivalence between policy gradients and soft Q-learning Abstract Two of the leading approaches for model-free reinforce…

PixelCNN++: Improving the PixelCNN with discretized logistic mixture likelihood and other modifications

PixelCNN++: Improving the PixelCNN with discretized logistic mixture likelihood and other modifications Abstract PixelCN…