4.6 KiB
Memory Layout in WGSL
Alignment of vertex and index buffers
Vertex buffers require defining a VertexBufferLayout
, so the memory alignment is whatever
you tell WebGPU it should be. This can be really convenient for keeping down memory usage
on the GPU.
The Index Buffer use the alignment of whatever primitive type you specify via the IndexFormat
you pass into RenderEncoder::set_index_buffer()
.
Alignment of Uniform and Storage buffers
GPUs are designed to process thousands of pixels in parallel. In order to achieve this, some sacrifices had to be made. Graphics hardware likes to have all the bytes you intend on processing aligned by powers of 2. The exact specifics of why this is are beyond my level of knowledge, but it's important to know so that you can trouble shoot why your shaders aren't working.
Let's take a look at the following table:
Type | Alignment in Bytes | Size in Bytes |
---|---|---|
scalar (i32, u32, f32) | 4 | 4 |
vec2<T> | 8 | 8 |
vec3<T> | 16 | 12 |
vec4<T> | 16 | 16 |
You can see for vec3
the alignment is the next power of 2 from the size, 16. This can
catche beginners (and even veterans) as it's not the most intuitive. This becomes especially
important when we start laying out structs. Take the light struct from the lighting tutorial:
You can see the full table of the alignments in section 4.3.7.1 of the WGSL spec
struct Light {
position: vec3<f32>;
color: vec3<f32>;
};
So what's the alignment of this scruct? Your first guess would be that it's the sum of the alignments of the individual fields. That might make sense if we were in Rust-land, but in shader-land, it's a little more involved. The alignment for a given struct is given by the following equation:
// S is the struct in question
// M is a member of the struct
AlignOf(S) = max(AlignOfMember(S, M1), ... , AlignOfMember(S, Mn))
Basically the alignment of the struct is the maximum of the alignments of the members of the struct. This means that:
AlignOf(Light)
= max(AlignOfMember(Light, position), AlignOfMember(Light, color))
= max(16, 16)
= 16
This is why the LightUniform
has those padding fields. WGPU won't accept it if the data
is not aligned correctly.
How to deal with alignment issues
In general 16, is the max alignment you'll see. In that case you might think that we should be able to do something like the following:
#[repr(C, align(16))]
#[derive(Debug, Copy, Clone, bytemuck::Pod, bytemuck::Zeroable)]
struct LightUniform {
position: [f32; 3],
color: [f32; 3],
}
But this won't compile. The bytemuck crate doesn't work with structs with implicit padding bytes. Rust can't guarantee that the memory between the fields has been initialized properly. The are potential security
In WGPU
To make uniform buffers portable they have to be std140 and not std430. Uniform structs have to be std140. Storage structs have to be std430.
Storage buffers for compute shaders can be std140 or std430.
std140 (since GLSL 1.4, OpenGL 3.1)
Array:
- determine the alignment of the member type and lets name it
align_member
- the alignment of the array is maximum(
align_member
, 16)
Struct:
- determine the member with the largest alignment and lets name it
max_member_align
- the alignment of the array is maximum(
max_member_align
, 16)
crates to make your struct compatible with std140
std430 (since GLSL 4.3, OpenGL 4.3)
more space efficient for structs and arrays
Array
- alignment is the alignment of the element type
Struct
- alignment is the alignment of the member with the largest alignment
crates to make yuor struct compatible with std430
glsl_layout issue crevice issue