Tests and CI

[phockett]

• Doctests to run and check.
• Set up some proper test routines.
• Further env testing (see /notes/envs and installation notes), esp. for Xarray dependencies.
• Github CI with actions, or external tools including version and env testing. (CircleCI?)

[phockett]

Basic CI with Github actions now in place (currently on testDev branch only, https://github.com/phockett/ePSproc/tree/testDev).

Working with matrix for python and Xarray versions, although only basic badge support (per action, but not per matrix item) implemented in readme, see https://github.com/phockett/ePSproc/blob/testDev/README.rst.

UPDATE 04/11/22: now merged into Dev branch, see #65

• Stable versions (XR<2022.3) https://github.com/phockett/ePSproc/actions/workflows/basic_ci.yaml
• Latest versions https://github.com/phockett/ePSproc/actions/workflows/latest_ci.yaml

TODO:

• full results matrix output? Not sure how to do this for matrix case - can possibly compose from test artifacts, but should also be a neater way to do this (since web UI does show all test/fail results as required).
• cache, may need matrix solution per GitHub Actions cache with multiple images moby/buildkit#2885
• Selective triggering (e.g. ignore docs, certain branches etc), see https://docs.github.com/en/actions/using-workflows/triggering-a-workflow

[phockett]

Tested some functionality, including naming matrix steps and various output strategies (see b6dc8e2 and 32d1224).

Needs work, but now collect test files and display test file list OK (see https://github.com/phockett/ePSproc/actions/runs/3887430285), next step is to also parse these and construct a table (may want pytest specific codebase for this, see also https://github.blog/2022-05-09-supercharging-github-actions-with-job-summaries/).

[phockett]

Revisiting as GH actions have a lot of failures currently.

• Updated requirements-CI.txt for additional imports, plus Numpy and Matplotlib version fixes (27baa65).
• Local runs OK for python 3.10.11, xr 2022.3.0, test these only on GH, 012bb12
  • Runs seem OK for this case.
  • Looks like python/Xr/ePSproc IO change brakes older IO code for some reason, should debug this.
• Updated GH actions for known good cases only, plus Xr current version for testing (5cdd560).
• Update: now running multiple python versions, xr=2022.3.0 only, as of cb6bf84.