PyFR: PastPresentFuture P. E. Vincent Department of Aeronautics, - - PowerPoint PPT Presentation

▶
pyfr past present future
SMART_READER_LITE
LIVE PREVIEW

PyFR: PastPresentFuture P. E. Vincent Department of Aeronautics, - - PowerPoint PPT Presentation

Aug 23, 2023 388 likes •975 views

PyFR: PastPresentFuture P. E. Vincent Department of Aeronautics, Imperial College London 19 th June 2020 Past | Present | Future Past 2009 - Antony Jameson gave me HT Huynhs AIAA paper on Flux Reconstruction [1] - GPUs becoming a

slide-1
SLIDE 1

PyFR: Past—Present—Future

  • P. E. Vincent

Department of Aeronautics, Imperial College London 19th June 2020

slide-2
SLIDE 2

Past

Past | Present | Future

  • 2009
  • Antony Jameson gave me HT Huynh’s AIAA paper on Flux

Reconstruction [1]

  • GPUs becoming a hot topic (magical 100x speedups etc.)
  • Rapid increase in FLOPS relative to memory bandwidth
  • Emergence of massive parallelism

[1] A Flux Reconstruction Approach to High-Order Schemes Including Discontinuous Galerkin Methods. H. T. Huynh. AIAA Paper 2007-4079. 2007

slide-3
SLIDE 3

Past

Past | Present | Future

  • 2012
  • Synergies between Flux Reconstruction [1] and modern

hardware becoming apparent

  • Can this combination be used to efficiently deliver DNS/

ILES/LES of industrial flows in?

  • Can Python help deliver this cross-platform?

[1] A Flux Reconstruction Approach to High-Order Schemes Including Discontinuous Galerkin Methods. H. T. Huynh. AIAA Paper 2007-4079. 2007

slide-4
SLIDE 4

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

slide-5
SLIDE 5

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • 2 x EPSRC PhDs
slide-6
SLIDE 6

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Freddie Witherden and Antony Farrington

(Imperial College)

slide-7
SLIDE 7

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • PyFR running on 64 x M2090 GPUs on Emerald (UK)
slide-8
SLIDE 8

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • EPSRC Fellowship, EPSRC Platform Grant,

EPSRC PhD, Airbus ICASE PhD

slide-9
SLIDE 9

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • George Ntemos and Harry Davis (Imperial

College)

slide-10
SLIDE 10

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Release v0.1 - CUDA and C/OpenMP backends

for quadrilaterals, triangles, and hexahedra

slide-11
SLIDE 11

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Innovate UK Hyperflux Project with Zenotech

and CFMS, BAE Systems ICASE PhD

slide-12
SLIDE 12

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Brian Vermeire (Imperial College)
slide-13
SLIDE 13

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Release v0.2 - added OpenCL backend and

support for tetrahedra and prisms

slide-14
SLIDE 14

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Jin Seok Park (Imperial College)
slide-15
SLIDE 15

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Arvind Iyer (Imperial College)
slide-16
SLIDE 16

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • CPC paper on core features and capabilities -

Witherden, Farrington, Vincent, 2014

slide-17
SLIDE 17

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • European Commission TILDA Project led by

Numeca International

slide-18
SLIDE 18

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Niki Loppi (Imperial College)
slide-19
SLIDE 19

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Release v1.0.0 - released at AIAA Aviation 2015
slide-20
SLIDE 20

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • PyFR running on 100’s x K20X GPUs on Piz

Daint (Switzerland)

slide-21
SLIDE 21

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • C&F paper on heterogeneous computing - Witherden,

Vermeire, Vincent, 2015

slide-22
SLIDE 22

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • PyFR running on 10,000s x K20X GPUs on Titan

(USA)

slide-23
SLIDE 23

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • CPC paper on GiMMiK - Wozniak, Witherden, Russel,

Vincent, Kelly, 2016

slide-24
SLIDE 24

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Phillip Leverhulme Prize
slide-25
SLIDE 25

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Yoshiaki Abe (Imperial College)
slide-26
SLIDE 26

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Shortlisted for Gordon Bell Prize. INCITE Award from

DOE

slide-27
SLIDE 27

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Supercomputing paper on PyFR at petascale -

Vincent, Witherden, Vermeire, Park, Iyer, 2016

slide-28
SLIDE 28

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Release v1.6.0 - added incompressible solver
slide-29
SLIDE 29

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Marius Koch (Imperial College)
slide-30
SLIDE 30

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • JCP paper on performance comparisons - Vermeire,

Witherden, Vincent, 2017

slide-31
SLIDE 31

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • AIAA Journal paper on NACA 0021 at 60 degree

AoA - Park, Witherden, Vincent, 2017

slide-32
SLIDE 32

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Renewal of INCITE Award from DOE
slide-33
SLIDE 33

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • EPSRC Fellowship, EPSRC Platform Grant
slide-34
SLIDE 34

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Semih Akkurt (Imperial College)
slide-35
SLIDE 35

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Landing gear
slide-36
SLIDE 36

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Giorgio Giangaspero (Imperial College)
slide-37
SLIDE 37

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • CPC paper on incompressible solver - Loppi, Witherden,

Jameson, Vincent, 2018

slide-38
SLIDE 38

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • MTU T161 Low Pressure Turbine Blade
slide-39
SLIDE 39

Results

Overview | Motivation | Modern Hardware | Flux Reconstruction | PyFR | Results | Summary

slide-40
SLIDE 40
slide-41
SLIDE 41
slide-42
SLIDE 42

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • PyFR running on 100’s x V100 GPUs on Summit

(USA)

slide-43
SLIDE 43

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • European Commission HiFiTURB Project led by

Numeca International

slide-44
SLIDE 44

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Tarik Dzanic, Will Trojak, Lai Wang

(Texas A&M)

slide-45
SLIDE 45

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • JFM paper on eigenmodes in channel flow -

Iyer, Witherden, Chernyshenko, Vincent, 2019

slide-46
SLIDE 46

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Xi Deng, Lionel Agostini (Imperial College)
slide-47
SLIDE 47

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • SUBOFF
slide-48
SLIDE 48

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • High-Rise building
slide-49
SLIDE 49

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Lidia Caros Roca (Imperial College)
slide-50
SLIDE 50

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Release v1.10.0 - current release
slide-51
SLIDE 51

Past

Past | Present | Future

2012 2013 2014 2015 2016 2017 2018 2019 2020 Funding People Notable Releases Supercomputing Software Papers Use Cases

  • Running on V100 GPUs on AWS EC2 instances
slide-52
SLIDE 52

Present

Past | Present | Future

slide-53
SLIDE 53

Present

Past | Present | Future Governing Equations

Compressible and Incompressible Navier-Stokes

Spatial Discretisation

Arbitrary order Flux Reconstruction on mixed unstructured grids (tris, quads, hexes, tets, prisms, pyramids)

Temporal Discretisation

Explicit Runge-Kutta schemes and implicit BDF schemes (via dual time stepping with explicit inner iterations)

Precision

single, double

Input

.pyfrm .msh .cgns

Output

.pyfrs .vtu .pvtu

Platforms

CPU clusters (via C/OpenMP-MPI) Nvidia GPU clusters (via CUDA-MPI) AMD GPU clusters (via OpenCL-MPI) Heterogeneous clusters (via a mix of the above)

  • PyFR v1.10.0 (current release)
slide-54
SLIDE 54

Present

Past | Present | Future

slide-55
SLIDE 55

Present

Past | Present | Future

slide-56
SLIDE 56

Present

Past | Present | Future

slide-57
SLIDE 57

Future

Past | Present | Future

  • Performance
  • Mixed precision
  • Kernel fusion
  • Tensor factorisations
  • Numerics
  • Improve pyramid implementation
  • Near-wall line implicit
  • Overset grid capability
  • Physics
  • Turbulent inflow
  • Multiphase capability
  • PANS
  • Data extraction and analysis
  • In-situ visualisation via e.g. ALPINE

Ascent

  • In-situ feature extraction