2020 Work Plan for the Test and Quality Assurance Working Group

Work Plan for 2020

Ongoing regular activities

  • Oversee testing shifts (Gunter)
  • Release management and Q/A monitoring with Valgrind and Coverity (Gabriele)
  • Perform regular profiling benchmarking of G4 development and public releases (Julia, Soon, Krzysztof, Guilherme A.)
  • Grid testing, Reproducibility tests (Alberto, Dmitri)

Support, Maintenance and Developments

  • System testing shifts
    • Maintain and support integration testing (Gunter)
  • Release testing
    • Adapting Geant4 jobs for the planned upgrade of the Jenkins server to a recent version and converting some jenkins jobs to Jenkins pipeline jobs, which allows to version which platforms we test, and in general allows more flexible setups (Gunter)
    • Support of the testing system to follow up on problems, add into testing new compiler versions, etc. (Gunter)
    • General testing/debugging of problems showing up especially during the release periods or development releases (Gabriele)
    • Q/A monitoring with Valgrind and Coverity (Gabriele)
    • Grid testing with simplified calorimeters and other test applications:  monthly running of selected hadronic and em tests of which results are used by hadronic and em groups for regression testing and physics validation(Dmitri, Alberto)
    • Reproducibility tests (Alberto)
  • Performance profiling and benchmarking
    • Regular profiling/benchmarking of Geant4 development and public releases, maintenance and evolution of the profiling infrastructure in response to the changing computing environment (Julia, Soon, Krzysztof, Daniel, Guilherme A.)
    • Adding of the profiling of new applications as needed and possible (Julia, Soon)
    • Development of automation scripts and new tests (Guilherme A.)
    • Optimization work based on profiling results (Guilherme A.)
    • Consulting on the use of performance tools and interpretation of the results as well as evaluating the performance gain of various code improvements/ideas (Canal)
  • Low energy physics profiling using Brachytherapy code (Kiheyon, Insung,  Myeong Hwan)
  • Testing Geant4 on evolving architecture using KISTI-5 supercomputer (Kiheyon, Insung,  Myeong Hwan)
  • Continue to encourage the collaboration to provide more tests and more rigorous tests (All)