Henry von Wahl & Thomas Richter & Jan Heiland
Christoph Lehrenfeld & Piotr Minakowski
GAMM CSE -- 21 November 2019
I haven't found a clear definition of what a benchmark is. However, here is what I think makes a numerical example a benchmark
Basically, everything that would motivate a fellow researchers to use the provided setup and data to benchmark their code.
Quantitative assessments, evaluate performance:
We know that this computation correct, but how efficient is it?
Examples:
Qualitive assessments, evaluate confidence:
Are the computations correct?
Example: FEATFLOW CFD Benchmarking project
Note that:
The more complex the model is, the more necessary are benchmarks but the more difficult are benchmark definitions.
(1.) General acceptance as a benchmark may come later.
where \(v_s\) is the solid's velocity at the fluid-solid interface.
with the body's centre of mass \(\mathbf c\).
To assess the truth the reported data should be
Variable | Definition |
---|---|
\(C_L\) | lift coefficient(s) |
\(C_D\) | drag coefficient(s) |
\(C_T\) | torque coefficient(s) |
\(\Delta_p\) | pressure difference at the cylinder |
\({\omega}^{ * }\) | dimensionless rotation |
We used
There were 5 independent implementations using established libraries:
The reported (converged) characteristic outputs ly within certain confidence intervals \(\Delta_I\):
Test case | Relative size of \(\Delta_I\) | Critical value |
---|---|---|
stationary-2D | \(10^{-5}\) | \(C_L\) |
periodic-2D | \(10^{-3}\) | \(C_T\) |
time-dep-2D | \(10^{-3}\) | \(C_L\) |
stationary-3D | (\(1\)), \(10^{-1}\) | \(\omega^ { * }\) |
Full data sets for the results as well as all implementations can be found at
Benchmarks are valuable for the assessment of numerical models.
I learned: Numerical analysis matters.
von Wahl, Henry, Thomas Richter, Christoph Lehrenfeld, Jan Heiland, and Piotr Minakowski. 2019. “Numerical Benchmarking of Fluid-Rigid Body Interactions.” Computers & Fluids. doi:10.1016/j.compfluid.2019.104290.