Data Center / Cloud

Jul 02, 2025

Advanced NVIDIA CUDA Kernel Optimization Techniques: Handwritten PTX

As accelerated computing continues to drive application performance in all areas of AI and scientific computing, there's a renewed interest in GPU optimization...

11 MIN READ

Jun 27, 2025

Just Released: NVIDIA PhysicsNeMo v25.06

New functionality to curate and train DoMINO at scale and validate against a physics-based benchmark suite.

1 MIN READ

Jun 25, 2025

Powering the Next Frontier of Networking for AI Platforms with NVIDIA DOCA 3.0

The NVIDIA DOCA framework has evolved to become a vital component of next-generation AI infrastructure. From its initial release to the highly anticipated...

12 MIN READ

Jun 24, 2025

NVIDIA Run:ai and Amazon SageMaker HyperPod: Working Together to Manage Complex AI Training

NVIDIA Run:ai and Amazon Web Services have introduced an integration that lets developers seamlessly scale and manage complex AI training workloads. Combining...

5 MIN READ

Jun 24, 2025

Introducing NVFP4 for Efficient and Accurate Low-Precision Inference

To get the most out of AI, optimizations are critical. When developers think about optimizing AI models for inference, model compression techniques—such as...

11 MIN READ

Jun 18, 2025

Improved Performance and Monitoring Capabilities with NVIDIA Collective Communications Library 2.26

The NVIDIA Collective Communications Library (NCCL) implements multi-GPU and multinode communication primitives optimized for NVIDIA GPUs and networking. NCCL...

11 MIN READ

Jun 18, 2025

Compiler Explorer: An Essential Kernel Playground for CUDA Developers

Have you ever wondered exactly what the CUDA compiler generates when you write GPU kernels? Ever wanted to share a minimal CUDA example with a colleague...

7 MIN READ

Jun 18, 2025

Benchmarking LLM Inference Costs for Smarter Scaling and Deployment

This is the third post in the large language model latency-throughput benchmarking series, which aims to instruct developers on how to determine the cost of LLM...

10 MIN READ

AI Virtual Camera video input and output.

Jun 17, 2025

Power Real-Time AI Media Effects with New AI Reference Apps on NVIDIA Holoscan for Media

Live media workflows are increasingly using AI microservices to augment production capabilities. However, advanced AI models are mostly hosted in the cloud,...

4 MIN READ

Jun 12, 2025

Driving Toward Billion-Cell Analysis and Biological Breakthroughs with RAPIDS-singlecell

The future of cell biology and virtual cell models is dependent on measuring and analyzing data at scale. Single-cell experiments have been growing at an...

7 MIN READ

Jun 11, 2025

Introducing NVIDIA DGX Cloud Lepton: A Unified AI Platform Built for Developers

The age of AI-native applications has arrived. Developers are building advanced agentic and physical AI systems—but scaling across geographies and GPU...

6 MIN READ

Jun 10, 2025

How Modern Supercomputers Powered by NVIDIA Are Pushing the Limits of Speed — and Science

Modern high-performance computing (HPC) is enabling more than just quick calculations �� it’s powering AI systems that are unlocking scientific...

6 MIN READ

Jun 09, 2025

A Fine-tuning–Free Approach for Rapidly Recovering LLM Compression Errors with EoRA

Model compression techniques have been extensively explored to reduce the computational resource demands of serving large language models (LLMs) or other...

9 MIN READ

Jun 06, 2025

How NVIDIA GB200 NVL72 and NVIDIA Dynamo Boost Inference Performance for MoE Models

The latest wave of open source large language models (LLMs), like DeepSeek R1, Llama 4, and Qwen3, have embraced Mixture of Experts (MoE) architectures. Unlike...

12 MIN READ

Jun 05, 2025

Vortex Delivers CT-Like Ultrasound to Doctors Offices With NVIDIA Jetson

Despite advances in medical imaging, many medical professionals still lack access to diagnostic imaging in their own offices. Vortex Imaging—a medical imaging...

7 MIN READ

Jun 05, 2025

Analyzing Baseboard Management Controllers to Secure Data Center Infrastructure

Modern data centers depend on Baseboard Management Controllers (BMCs) for remote management. These embedded processors enable administrators to reconfigure...

9 MIN READ