Prep: Verlet MandelLeaf
Prep: Verlet MandelLeaf /INFOMOV/ Optimization & - - PowerPoint PPT Presentation
Prep: Verlet MandelLeaf /INFOMOV/ Optimization & - - PowerPoint PPT Presentation
Prep: Verlet MandelLeaf /INFOMOV/ Optimization & Vectorization J. Bikker - Sep-Nov 2019 - Lecture 10: GPGPU (2) Welcome! Todays Agenda: Practical GPGPU: Verlet Fluid (in several steps) INFOMOV Lecture 10
/INFOMOV/ Optimization & Vectorization
- J. Bikker - Sep-Nov 2019 - Lecture 10: “GPGPU (2)”
Welcome!
Today’s Agenda:
▪ Practical GPGPU: Verlet Fluid ▪ (in several steps)
Verlet
INFOMOV – Lecture 10 – “GPGPU (2)” 4
Verlet
INFOMOV – Lecture 10 – “GPGPU (2)” 5
Verlet
INFOMOV – Lecture 10 – “GPGPU (2)” 6
.INGREDIENTS
Verlet
Verlet Physics
Motion along a straight line: 𝑦1 = 𝑦0 + 𝑤∆𝑢 We can also express this without explicit velocities: 𝑦2 = 𝑦1 + (𝑦1 − 𝑦0) ∆𝑢 INFOMOV – Lecture 10 – “GPGPU (2)” 7 Simulation: ▪ Backup current position: 𝑦𝑑𝑣𝑠𝑠𝑓𝑜𝑢 = 𝑦 ▪ Update positions: 𝑦 += 𝑦𝑑𝑣𝑠𝑠𝑓𝑜𝑢 − 𝑦𝑞𝑠𝑓𝑤𝑗𝑝𝑣𝑡 ▪ Apply forces: 𝑦 += 𝑔 ▪ Store last position: 𝑦𝑞𝑠𝑓𝑤𝑗𝑝𝑣𝑡 = 𝑦𝑑𝑣𝑠𝑠𝑓𝑜𝑢 ▪ Apply constraints (e.g. walls) Applying constraints: ▪ e.g. if (x < 0) x = 0; ▪ …
Verlet
Verlet Physics
Cloth: ▪ Using a grid of vertices ▪ Forces on all vertices: gravity ▪ Constraint for top row: fixed position ▪ Constraint for all vertices: maximum distance to neighbors Fluid: ▪ Using large collection of particles ▪ Forces on all particles: gravity ▪ Constraint for all particles: container boundaries ▪ Constraint for all particles: do not intersect
- ther particles
INFOMOV – Lecture 10 – “GPGPU (2)” 8
Verlet
Template
Texture: ▪ To efficiently display OpenCL output using OpenGL Shader: ▪ As an alternative to OpenCL, e.g. for postprocessing Kernel: ▪ Specifying actual device code:
fractal = new Kernel( "programs/program.cl", "TestFunction" );
▪ Setting and changing arguments:
fractal->SetArgument( 0, outputBuffer );
▪ Launching the kernel:
fractal->Run( outputBuffer );
INFOMOV – Lecture 10 – “GPGPU (2)” 9
Verlet
GPU Verlet Fluid
Input: ▪ Array of particle positions ▪ Array of previous particle positions Output: ▪ Visualization of simulation ▪ Array of particle positions (updated) ▪ Array of previous particle positions (updated) INFOMOV – Lecture 10 – “GPGPU (2)” 10
Verlet
GPU Verlet Fluid
Drawing a number of moving particles using OpenCL INFOMOV – Lecture 10 – “GPGPU (2)” 11
.STAGE 1
Idea: Let’s draw 128 balls, brute force. Data: ▪ Screen buffer, 1280x720 ▪ Ball data, 128 records Procedure:
- 1. Clear screen
- 2. Update ball positions
- 3. Draw balls
Drawing balls, options: ➢ Loop over balls ➢ Loop over pixels What if they touch the same pixel? Check 128 balls per pixel
Verlet
GPU Verlet Fluid – Host Code
INFOMOV – Lecture 10 – “GPGPU (2)” 12 // reserve BALLCOUNT * 6 32-bit values Buffer* balls = new Buffer( BALLCOUNT * 6 ); // put initial ball positions in buffer float* fb = (float*)balls->GetHostPtr(); for( int i = 0; i < BALLCOUNT; i++ ) { fb[i * 6] = Rand( 1 ); fb[i * 6 + 1] = Rand( 1 ); fb[i * 6 + 2] = Rand( 0.01f ) - 0.005f; fb[i * 6 + 3] = Rand( 0.01f ) - 0.005f; fb[i * 6 + 4] = fb[i * 6 + 0]; fb[i * 6 + 5] = fb[i * 6 + 1]; } balls->CopyToDevice();
position velocity (for now)
Verlet
GPU Verlet Fluid – Device Code
INFOMOV – Lecture 10 – “GPGPU (2)” 13 __kernel void clear( write_only image2d_t outimg ) { int column = get_global_id( 0 ); int line = get_global_id( 1 ); if ((column >= 800) || (line >= 480)) return; write_imagef( outimg, (int2)(column, line), 0 ); } __kernel void update( global float* balls ) { int idx = get_global_id( 0 ); balls[idx * 6 + 0] += balls[idx * 6 + 2]; balls[idx * 6 + 1] += balls[idx * 6 + 3]; } Task: ▪ write a single black pixel. Workset: ▪ number of pixels. Task: ▪ Update the position of one ball. Workset: ▪ Number of balls.
Verlet
GPU Verlet Fluid – Host Code
INFOMOV – Lecture 10 – “GPGPU (2)” 14 __kernel void render( write_only image2d_t outimg, global float* balls ) { int column = get_global_id( 0 ); int line = get_global_id( 1 ); float2 uv = { (float)column / 800.0, (float)line / 480.0 }; for( int i = 0; i < BALLCOUNT; i++ ) { float2 pos = { balls[i * 6], balls[i * 6 + 1] }; float dist = length( pos - uv ); if (dist > 0.02f) continue; write_imagef( outimg, (int2)(column, 479 - line), (float4)(1,0,0,1) ); break; } }
Verlet
GPU Verlet Fluid – Result
INFOMOV – Lecture 10 – “GPGPU (2)” 15
Verlet
GPU Verlet Fluid
Rendering many particles efficiently INFOMOV – Lecture 10 – “GPGPU (2)” 16
.STAGE 2
Idea: Let’s use a grid to reduce the number of balls we check per pixel. Data: ▪ Grid, custom resolution ▪ Fixed room per cell for N balls Procedure:
- 1. Clear grid
- 2. Add balls to grid
- 3. Render pixels.
Verlet
GPU Verlet Fluid – Grid
INFOMOV – Lecture 10 – “GPGPU (2)” 17 Host: grid = new Buffer( GRIDX * GRIDY * (BALLSPERCELL + 1) ); Device: __kernel void clearGrid( global unsigned int* grid ) { int idx = get_global_id( 0 ); int baseIdx = idx * (BALLSPERCELL + 1); grid[baseIdx] = 0; } Task: ▪ Reset a grid cell by setting ball count to 0. Workset: ▪ Number of cells. Data layout: ▪ [0]: ball count for cell ▪ [1..N]: ball indices
Verlet
GPU Verlet Fluid – Grid
INFOMOV – Lecture 10 – “GPGPU (2)” 18 __kernel void fillGrid( global float* balls, global unsigned int* grid ) { int ballIdx = get_global_id( 0 ); int gx = balls[ballIdx * 6 + 0] * GRIDX; int gy = balls[ballIdx * 6 + 1] * GRIDY; if ((gx < 0) || (gy < 0) || (gx >= GRIDX) || (gy >= GRIDY)) return; int baseIdx = (gx + gy * GRIDX) * (BALLSPERCELL + 1); int count = grid[baseIdx]++; grid[baseIdx + count + 1] = ballIdx; } Task: ▪ Add a single ball to the correct grid cell. Workset: ▪ Number of balls.
Verlet
GPU Verlet Fluid – Grid
INFOMOV – Lecture 10 – “GPGPU (2)” 19 __kernel void fillGrid( global float* balls, global unsigned int* grid ) { int ballIdx = get_global_id( 0 ); int gx = balls[ballIdx * 6 + 0] * GRIDX; int gy = balls[ballIdx * 6 + 1] * GRIDY; if ((gx < 0) || (gy < 0) || (gx >= GRIDX) || (gy >= GRIDY)) return; int baseIdx = (gx + gy * GRIDX) * (BALLSPERCELL + 1); unsigned int count = atomic_inc( grid + baseIdx ); if (count < BALLSPERCELL) grid[baseIdx + count + 1] = idx; }
Verlet
GPU Verlet Fluid – Grid
INFOMOV – Lecture 10 – “GPGPU (2)” 20 __kernel void render( write_only image2d_t outimg, global float* balls, global unsigned int* grid ) { int column = get_global_id( 0 ); int line = get_global_id( 1 ); if ((column >= 800) || (line >= 480)) return; float2 uv = { (float)column / 800.0, (float)line / 480.0 }; // draw balls using grid int gx = uv.x * GRIDX; int gy = uv.y * GRIDY; int gx1 = max( 0, gx - 1 ), gx2 = min( GRIDX - 1, gx + 1 ); int gy1 = max( 0, gy - 1 ), gy2 = min( GRIDY - 1, gy + 1 ); ...
... for( int y = gy1; y <= gy2; y++ ) for( int x = gx1; x <= gx2; x++ ) { unsigned int baseIdx = (x + y * GRIDX) * (BALLSPERCELL + 1); unsigned int count = grid[baseIdx]; for( int i = 0; i < count; i++ ) { unsigned int ballIdx = grid[baseIdx + i + 1]; float2 pos = { balls[ballIdx * 6], balls[ballIdx * 6 + 1] }; float dist = length( pos - uv ); if (dist > 0.01f) continue; write_imagef( outimg, (int2)(column, 479 - line), (float4)(1,0,0,1) ); } } }
Verlet
GPU Verlet Fluid – Grid
INFOMOV – Lecture 10 – “GPGPU (2)” 21
Verlet
GPU Verlet Fluid – Grid - Result
INFOMOV – Lecture 10 – “GPGPU (2)” 22
Verlet
GPU Verlet Fluid
Implementing simulation INFOMOV – Lecture 10 – “GPGPU (2)” 23
.STAGE 3
Idea: Basics work; let’s add some physics. Procedure:
- 1. Move particles
- 2. Satisfy constraints
Verlet
GPU Verlet Fluid – Simulation
INFOMOV – Lecture 10 – “GPGPU (2)” 24 __kernel void simulate1( global float* balls ) { int idx = get_global_id( 0 ); float2 prevPos = { balls[idx * 6 + 0], balls[idx * 6 + 1] }; float2 delta = { balls[idx * 6 + 0] - balls[idx * 6 + 4], balls[idx * 6 + 1] - balls[idx * 6 + 5] + 0.0002 }; float speed = length( delta ); if (speed > 0.01f) delta = 0.01f * normalize( delta ); balls[idx * 6 + 0] += delta.x; balls[idx * 6 + 1] += delta.y; balls[idx * 6 + 4] = prevPos.x; balls[idx * 6 + 5] = prevPos.y; }
Verlet
GPU Verlet Fluid – Simulation
INFOMOV – Lecture 10 – “GPGPU (2)” 25 __kernel void simulate2( global float* balls, global float* balls2, global unsigned int* grid ) { int cellIdx = get_global_id( 0 ); int baseIdx = cellIdx * (BALLSPERCELL + 1); int count = grid[baseIdx]; if (count == 0) return; int gx = idx % GRIDX; int gy = idx / GRIDX; // determine 3x3 block around current cell int gx1 = max( 0, gx - 1 ), gx2 = min( GRIDX - 1, gx + 1 ); int gy1 = max( 0, gy - 1 ), gy2 = min( GRIDY - 1, gy + 1 ); for( int i = 0; i < count; i++ ) {
Verlet
GPU Verlet Fluid – Simulation
INFOMOV – Lecture 10 – “GPGPU (2)” 26 // get active ball int idx1 = grid[baseIdx + i + 1]; float2 ball1Pos = { balls[idx1 * 6 + 0], balls[idx1 * 6 + 1] }; // evade other balls for( int y = gy1; y <= gy2; y++ ) for( int x = gx1; x <= gx2; x++ ) { int baseIdx = (x + y * GRIDX) * (BALLSPERCELL + 1); int count2 = min( (unsigned int)BALLSPERCELL, grid[baseIdx] ); for( int j = 0; j < count2; j++ ) { int idx2 = grid[baseIdx + j + 1]; if (idx2 != idx1) { float2 ball2Pos = { balls2[idx2 * 6 + 0], balls2[idx2 * 6 + 1] }; ...
Verlet
GPU Verlet Fluid – Simulation
INFOMOV – Lecture 10 – “GPGPU (2)” 27
Verlet
GPU Verlet Fluid
What causes the poor performance? INFOMOV – Lecture 10 – “GPGPU (2)” 28
▪ Simulation handles one grid cell per thread ▪ Grid cell workload is highly irregular ▪ Do we even have enough grid cells?
Verlet
GPU Verlet Fluid
Improving performance INFOMOV – Lecture 10 – “GPGPU (2)” 29
.STAGE 4
Idea: Grid cells are filled irregularly; loop
- ver balls for simulation.
Procedure, simulation:
- 1. A ball checks its surroundings
in the grid. Procedure, rendering (new): ▪ For rendering we loop over balls
- too. If two balls fight for the
same pixel, we ignore that.
Verlet
GPU Verlet Fluid - TakeAway
GPGPU is a bit different: ▪ We have ‘host’ and ‘device’ code ▪ We need many small identical tasks ▪ Each task has an ‘identity’ (1D, 2D or 3D index in the workset) ▪ Some tasks may be outside the workset (check for this!) ▪ Ideally, each of those tasks should do a similar amount of work (if, for) ▪ The tasks run in parallel: mind concurrency issues! (atomic) ▪ Data transfer from CPU to GPU is expensive (avoid this) In this example, OpenCL directly plotted to an OpenGL texture (which is then drawn
- n a quad, using a shader). It is probably more efficient to let OpenCL prepare a
vertex buffer for drawing point sprites. INFOMOV – Lecture 10 – “GPGPU (2)” 31
Today’s Agenda:
▪ Practical GPGPU: Verlet Fluid ▪ (in several steps)
/INFOMOV/ END of “GPGPU (2)”
next lecture: GPGPU (3)