DirectX Is Becoming an ML Platform: What Linear Algebra and Neural Shaders Mean for Future Games

DirectX is moving beyond traditional graphics shaders. Microsoft is adding hardware-accelerated linear algebra directly to HLSL and a separate path for larger ML models, laying the foundation for neural textures, learned materials, neural lighting and other AI-driven rendering techniques.
Published:
Aleksandar Stajic
Updated: September 26, 2026 at 08:45 AM
DirectX Is Becoming an ML Platform: What Linear Algebra and Neural Shaders Mean for Future Games

DirectX is no longer only a graphics API that sends traditional shaders to the GPU. Microsoft is adding machine-learning primitives directly to HLSL and a second path for running larger ML graphs inside the DirectX ecosystem. That changes where neural rendering can live inside future PC games.

Why neural rendering needs new DirectX primitives

Modern GPUs already contain specialized hardware for matrix operations used by machine learning. The problem for a game developer is not only whether that hardware exists, but how to access it efficiently from a real-time graphics pipeline.

Microsoft first explored this with Cooperative Vector support. In 2026, that work evolved into a broader DirectX Linear Algebra design that supports both vector-matrix and matrix-matrix operations.

That matters because different neural-rendering jobs have different shapes. A tiny model evaluating material behavior per pixel is not the same workload as a large super-resolution or denoising graph.

The Two-Level DirectX ML Model

Two ways ML can enter the DirectX graphics pipeline

1
1. Shader-level ML
Small neural or linear-algebra workloads execute directly from HLSL alongside traditional shader code.
2
2. DX Linear Algebra
The shader can request hardware-accelerated vector and matrix operations instead of manually implementing every ML primitive.
3
3. Model-level ML
Larger neural networks are represented as complete computation graphs rather than hand-written shader fragments.
4
4. DirectX Compute Graph Compiler
Microsoft's planned compiler path analyzes and lowers those graphs into optimized GPU workloads integrated with D3D12 queues and command lists.

What DX Linear Algebra actually gives a shader

Traditional HLSL is built around graphics and compute operations. Neural workloads rely heavily on linear algebra: vectors, matrices, multiplication, accumulation and data layouts optimized for those operations.

The Shader Model 6.10 preview adds first-class matrix APIs so developers can express those workloads more directly and let the driver map them to specialized hardware.

Microsoft's April 2026 preview explicitly describes this as a unified path for neural rendering, ML and image-processing workloads rather than a graphics-only feature.

Traditional shader math vs ML-oriented shader math

Traditional shader focusML-oriented focus
Typical work
Hardware path
Developer expression

Why Cooperative Vector was only the beginning

Cooperative Vector allowed shader threads to request vector-matrix work that drivers could map to specialized hardware. That was useful for highly parallel per-pixel workloads.

Microsoft later concluded that many important ML workloads need more than vector-matrix operations. Super resolution, denoising, temporal reconstruction, larger image models and general inference can require matrix-matrix operations and shared work across many threads.

DX Linear Algebra therefore broadens the model instead of treating Cooperative Vector as the final abstraction.

What can actually run inside a shader?

The most interesting shader-level ML workloads are small enough to execute close to the graphics data they operate on.

WorkloadWhy shader-level ML fits
Neural texture compressionA small network can reconstruct texture information near the point where the shader needs it
Neural material evaluationA learned function can replace or augment expensive hand-authored material math
Neural radiance cachingPer-pixel or local inference can estimate lighting information from learned scene behavior
Small denoising/reconstruction kernelsML operations can sit directly beside the rendering stage they improve
Image-processing inferenceMatrix operations can be embedded into GPU processing without a separate external runtime

Why this matters for texture memory

One of Microsoft's recurring examples is neural texture compression.

Instead of storing every texture channel at conventional fidelity, a game can store a more compact representation and use a small neural network to reconstruct detail during rendering.

That trades some GPU inference work for lower storage or memory pressure. The exact benefit depends on the technique and hardware, but the architectural change is important: some visual detail can become computation instead of stored data.

Why full models need a different path

Hand-writing a few matrix operations in HLSL is practical for small neural functions. It becomes much less practical when the workload is a complete modern model with many layers, dependencies and intermediate tensors.

Microsoft's DirectX Compute Graph Compiler is designed for this larger class of workload.

Instead of rewriting the model as custom shader code, the compiler can accept a computation graph, analyze the whole graph, plan memory, fuse operations and lower the result into GPU work that integrates with DirectX 12.

The Shader-or-Graph Boundary

When the ML workload belongs in HLSL vs a model compiler

Shader-level pathModel-level path
Model size
Execution style
Authoring
Optimization scope
Typical use

Why cross-vendor support matters more than another AI feature

AMD, Intel, NVIDIA and Qualcomm expose different GPU architectures and different forms of dedicated matrix acceleration.

A DirectX abstraction gives Microsoft and the driver vendors a place to translate common HLSL or graph-level ML into the correct hardware path.

That does not make every GPU equally fast, but it can reduce the need for a game engine to implement a completely different neural-rendering API for every vendor.

What hardware supports the current preview?

The answer depends on the specific Linear Algebra operation and preview driver.

Microsoft's Agility SDK 1.721 preview support table lists LinAlg VectorAccumulate for AMD Radeon RX 9000 Series hardware, Intel Xe2-or-newer hardware through an upcoming driver, and NVIDIA RTX hardware through the supported preview path.

This is preview-era support, not a universal retail guarantee. Hardware and driver support can change before finalization.

Neural rendering is becoming infrastructure

DLSS, FSR and other neural graphics technologies are often discussed as branded features visible in a game's settings menu.

DirectX Linear Algebra points to a deeper change. The neural operation can become an internal implementation detail inside the renderer rather than a single optional post-processing feature.

A developer could use ML for textures, materials, lighting, reconstruction or other local functions without exposing each one as a consumer-facing AI toggle.

The Neural Rendering Stack is becoming layered

A possible future DirectX game pipeline

1
Traditional engine work
Simulation, geometry, visibility and base rendering remain standard engine responsibilities.
2
Inline neural shaders
Small learned functions reconstruct textures, materials or lighting inside HLSL.
3
Larger ML graphs
Full reconstruction or inference models execute through a graph-level DirectX path.
4
Vendor hardware mapping
Drivers map common DirectX operations onto the GPU's specialized AI and matrix units.
5
PIX visibility
Graphics and ML work can be profiled together instead of living in separate opaque runtimes.

Why unified profiling matters

A neural workload that improves image quality can still damage a game if it unexpectedly consumes frame time, memory bandwidth or VRAM.

Microsoft explicitly includes unified PIX visibility as part of the Compute Graph Compiler direction. That matters because developers need to see graphics and ML work in the same frame capture.

If neural rendering becomes infrastructure, it must be measurable like any other rendering stage.

This does not mean every shader will become a neural network

Traditional shader math remains efficient, deterministic and easy to reason about for many workloads.

A neural function makes sense when it can approximate or reconstruct something expensive more efficiently, compress data, or produce quality that would otherwise require too much conventional compute or memory.

The right architecture will remain hybrid.

The Neural Shader Value Test

When does putting ML into the rendering pipeline actually make sense?

1
1. Identify the expensive traditional operation
What compute, bandwidth, memory or storage cost are you trying to replace?
2
2. Define the neural substitute
What can a small model reconstruct, predict or compress?
3
3. Measure inference cost
The ML model itself consumes GPU time, memory and bandwidth.
4
4. Measure quality stability
Look for temporal artifacts, reconstruction errors and failure cases.
5
5. Measure net savings
The technique is useful only if the avoided traditional cost is worth the added ML cost.
6
6. Test across vendors
A DirectX abstraction helps portability, but real hardware performance still differs.

What this means for gamers

Gamers may never see a “DX Linear Algebra” switch in a graphics menu.

The likely impact is indirect: smaller texture footprints, better lighting reconstruction, more efficient neural graphics, or new visual techniques that become practical because the engine can access matrix acceleration through a standard path.

The feature is more important as infrastructure than as a brand.

What would change this answer?

The biggest uncertainty is the final retail shape of these APIs. DX Linear Algebra remains in preview, and the Compute Graph Compiler has not yet reached broad retail availability.

Final hardware support, API details, compiler behavior and engine adoption may change before these systems become normal shipping-game infrastructure.

If major engines adopt the abstractions directly, neural shaders could become much more common without individual game teams implementing every technique from scratch.

Limitations

This article explains Microsoft's documented DirectX architecture and preview APIs. It does not claim that DX Linear Algebra currently improves performance in every game or that the Compute Graph Compiler is a finished retail product.

Microsoft's examples describe capability and intended use. Real benefits depend on the model, engine integration, GPU architecture, drivers and workload.

Conclusion

The important DirectX change is not another checkbox called AI.

It is that machine-learning math is moving into the graphics programming model itself. Small neural functions can sit inside shaders, larger models can move toward graph-level compilation, and the same DirectX toolchain can expose those workloads across multiple GPU vendors.

That is how neural rendering stops being one branded feature and starts becoming part of the rendering infrastructure.

FAQ

DirectX Linear Algebra and neural shaders

What is DirectX Linear Algebra?

It is a DirectX/HLSL feature set for hardware-accelerated vector and matrix operations used by machine learning, neural rendering and image-processing workloads.

What is a neural shader?

A useful plain-English description is a shader that includes a learned neural function or ML inference step as part of its graphics work.

Is DX Linear Algebra already a normal retail DirectX feature?

As of September 2026 it remains in the Shader Model 6.10 / Agility SDK preview path.

What is the DirectX Compute Graph Compiler?

It is Microsoft's announced model-level ML compiler API intended to take larger computation graphs and lower them into optimized GPU workloads integrated with D3D12.

Why not run every ML model directly in HLSL?

Small functions fit shader-level authoring well, while large models benefit from whole-graph optimization, memory planning and operator fusion.

Will this replace DLSS or FSR?

Not directly. DirectX provides lower-level infrastructure that vendors and developers can use for neural graphics. Branded technologies can still implement their own models and integration strategies.

Glossary

Key DirectX ML terms

DX Linear Algebra
DirectX/HLSL APIs for accelerated vector and matrix operations intended for neural rendering, ML and image-processing workloads.
Cooperative Vector
An earlier DirectX approach for accelerated vector-matrix operations inside shaders that helped establish the shader-level neural-rendering path.
Shader Model 6.10
The preview shader-model generation containing the current DirectX Linear Algebra matrix APIs.
DirectX Compute Graph Compiler
Microsoft's announced compiler API for optimizing and executing larger ML computation graphs as native DirectX GPU workloads.
Neural shader
A practical term for a shader that performs learned inference or neural computation as part of graphics processing.
Shader-or-Graph Boundary
A Figure Rocks model for deciding whether an ML workload belongs as small inline shader math or as a larger model-level computation graph.
Neural Shader Value Test
A Figure Rocks workflow for deciding whether the traditional compute or memory cost avoided by a neural technique is worth its inference cost and quality trade-offs.

Primary sources

Microsoft DirectX — Evolving DirectX for the ML Era on Windows

Official GDC 2026 architecture overview covering shader-level ML, DX Linear Algebra and the DirectX Compute Graph Compiler.

Microsoft DirectX — D3D12 LinAlg Matrix Preview

Official April 2026 preview explaining the unified Linear Algebra APIs, matrix operations and neural-rendering motivation.

Microsoft DirectX — Agility SDK 1.721 Preview

Official May 2026 release documenting Shader Model 6.10 Linear Algebra updates and preview hardware support.

Microsoft Game Dev — GDC 2026: Evolving DirectX for the ML Era

Official Microsoft Game Dev summary explaining shader-level and model-level ML and the role of the Compute Graph Compiler.

Microsoft DirectX — D3D12 Cooperative Vector

Official background on hardware-accelerated vector/matrix operations and neural rendering directly from shader threads.

Related Articles

Cyrus

The Cyrus amiibo belongs to the Animal Crossing amiibo figure line released during the period when Nintendo expanded the series into physical NFC figures. It functions as a bridge between the plastic figure and supported Nintendo games. When scanned, the character stored in the NFC chip becomes accessible inside the game. The practical value of the figure lies in enabling Cyrus related interactions and content that otherwise remain hidden or harder to reach.

Overdrive Tuning: The Clean Way to Reduce Blur Without Ghosting

Overdrive can improve clarity or add ugly halos. Use this simple method to pick the clean middle setting that reduces blur without ghosting artifacts.

Celeste

The Celeste amiibo belongs to the Animal Crossing amiibo figure line released during the first wave of figures dedicated to the Animal Crossing universe. Like other figures in this collection, it functions as a small NFC carrier connected to Nintendo’s amiibo ecosystem. When scanned, the figure links the character Celeste to compatible games. The value of the amiibo lies mostly in enabling character appearances and small gameplay interactions that otherwise appear only under specific circumstances.

Resetti

The Resetti amiibo belongs to the Animal Crossing amiibo figure line released during the early expansion of Nintendo’s NFC-based character figures. Like others in this series, the figure functions as a physical representation of a character combined with a small NFC chip that communicates with compatible Nintendo systems. When scanned, the figure links the character Mr. Resetti to supported games and unlocks small interactions or character appearances tied to his role in the Animal Crossing universe.

Kapp’n

The Kapp’n amiibo belongs to the Animal Crossing amiibo figure line released during the first wave of figures connected to the series. Like other figures in that line, it carries a small NFC chip that links the physical object to several Nintendo games. Scanning the figure activates character-related content. The practical value of the figure sits mostly in the ability to call Kapp’n into supported titles and unlock small pieces of themed content connected to his role in the series.

Isabelle - Winter Outfit

The Isabelle – Winter Outfit amiibo from the Super Smash Bros. Series represents a seasonal version of one of Nintendo’s most recognizable support characters. This figure does not introduce a new character, but it reframes an established one. The added value lies mainly in its functional compatibility across multiple Nintendo systems and in its physical interpretation of Isabelle during a specific seasonal moment in the Animal Crossing world.

AMD FSR Redstone Is Not Just FSR 4: Upscaling, Frame Generation, Ray Regeneration and Radiance Caching Explained

AMD FSR Redstone Is Not Just FSR 4: Upscaling, Frame Generation, Ray Regeneration and Radiance Caching Explained

AMD’s FSR naming changed because FSR is no longer one feature. Redstone is now a neural-rendering suite with separate technologies for upscaling, frame generation, ray-traced reconstruction and learned global illumination.

Motion Clarity: Why Blur Happens and the Fixes That Actually Work

Motion blur is not just a setting — it’s timing plus persistence. Learn the practical order: correct mode, correct refresh, then the few clarity fixes that matter.

Blathers

The Blathers amiibo is part of the Animal Crossing figure series released during the broader rollout of Nintendo’s amiibo platform. Each figure combines a small collectible sculpture with an NFC chip inside the base. When placed on a compatible reader, the console reads the character ID stored in the figure. In practice this allows certain games to reference the character directly. The Blathers amiibo mainly provides access to appearances of the museum curator or small character related features inside supported Animal Crossing titles.

Timmy & Tommy

The Timmy & Tommy amiibo belongs to the Animal Crossing amiibo figure line released during the early wave of the series. Like other figures in this collection, it contains a small NFC chip that links the physical figure with compatible Nintendo games. Scanning the figure does not drastically change gameplay, but it consistently provides character related interactions. The value of this amiibo lies mostly in its ability to summon the twin shopkeepers into supported titles and unlock small themed elements connected to them.

Lottie

The Lottie amiibo belongs to the Animal Crossing amiibo figure line released during the early phase of Nintendo's amiibo program. It represents the small otter character known from the design office in Animal Crossing Happy Home Designer. Like other figures in this series, the object contains a small NFC chip. When scanned by compatible Nintendo systems, the figure links the character to in-game systems and unlocks small pieces of related content.

Rover

The Rover amiibo sits in a familiar part of the Animal Crossing line. It is not a figure that changes a whole game on its own. Its use is smaller than that. It lets Rover appear where Nintendo allowed amiibo support, and that is really the point of it. The value comes from access, recognition, and a direct link to one of the older faces in the series.