2019 Work Plan for the Test and Quality Assurance Working Group

Work Plan for 2019

Ongoing regular activities

  • Oversee testing shifts (Gunter)
  • Release management and Q/A monitoring with Valgrind and Coverity (Gabriele)
  • Perform regular profiling benchmarking of G4 development and public releases (Julia, Soon, Krzysztof)
  • Grid testing, Reproducibility tests (Alberto, Dmitri)

Support, Maintenance and Developments

  • System testing shifts
    • Maintain and support integration testing (Gunter)
  • Release testing
    • Migrating testing to docker containers which replace virtual slc6 machines (Gunter)
    • Adapting Geant4 jobs for the planned upgrade of the Jenkins server to a recent version and converting some jenkins jobs to Jenkins pipeline jobs, which allows to version which platforms we test, and in general allows more flexible setups (Gunter)
    • Support of the testing system to follow up on problems, add into testing new compiler versions, etc. (Gunter)
    • General testing/debugging of problems showing up especially during the release periods or development releases (Gabriele)
    • Q/A monitoring with Valgrind and Coverity (Gabriele)
    • Grid testing with simplified calorimeters:  monthly running of selected hadronic and em tests of which results are used by hadronic and em groups for regression testing and physics validation(Dmitri, Alberto)
    • Reproducibility tests (Alberto)
    • Integration of medical test and running them 3-4 times per year for selected reference releases (Dmitri)
  • Performance profiling and benchmarking
    • Regular profiling/benchmarking of Geant4 development and public releases, maintenance and evolution of the profiling infrastructure in response to the changing computing environment (Julia, Soon, Krzysztof, Daniel)
    • Adding of the profiling of new applications as needed and possible (Julia, Soon)
    • Consulting on the use of performance tools and interpretation of the results as well as evaluating the performance gain of various code improvements/ideas (Canal)
  • Low energy physics profiling using Brachytherapy code (Kiheyon, Insung)
  • Tesing Geant4 on evolving architecture (Kiheyon, Insung)
  • Continue to encourage the collaboration to provide more tests and more rigorous tests (All)