Skip to content

Add support for merged netCDF file ingestion#9

Open
divine7022 wants to merge 55 commits into
ccmmf:aggregate-scenariofrom
divine7022:concat_netcdf_ens_out
Open

Add support for merged netCDF file ingestion#9
divine7022 wants to merge 55 commits into
ccmmf:aggregate-scenariofrom
divine7022:concat_netcdf_ens_out

Conversation

@divine7022
Copy link
Copy Markdown
Contributor

Summary

Adds support for reading concatenated netcdf files in 030_extract_sipnet_output.R,

scripts/030_extract_sipnet_output.R

  • added new extraction path that automatically detects merged netCDF files in out/merged_nc/YYYY.nc
  • reads all sites and ensembles from yearly consolidated files
  • falls back to individual ENS-*/YYYY.nc files if merged files are not present

docs/workflow_documentation.md

  • added documentation for merged netCDF output format

Closes #169

Notes

This PR addresses Task 2 of Issue #169. Task 1 (generating merged files) -- is deferred

dlebauer and others added 30 commits September 23, 2025 01:00
…uture.R (set in config); use all outputs in production to aid in development of multi-crop workflow
…add change since start as delta_<variable> to standard output; aggregate output to monthly means
no longer load renv in .Rprofile; hard code path to renv libraries in .Renviron
Revise mixed_system_prototype.qmd for clarity and to fix incorrect labels.
Co-authored-by: Chris Black <chris@ckblack.org>
…on density and stock and mask counties that cumulatively contribute <1% of total (consider this below detection limit given uncertainty)
…y and stock, save variable importance results; add logging and memory tracking
…qmd` from `downscaling_report.qmd`

- Updated `040_downscale.R` to improve naming conventions and ensure training covariate matrices are saved correctly.
- Refactor `041_aggregate_to_county.R` to streamline the aggregation process and improve readability.
- Enhance `042_downscale_analysis.R` to load predictions and covariates, compute variable importance, and generate plots for partial dependence, ALE, and ICE effects using the `iml` package.
- Improved logging.
dlebauer and others added 25 commits September 24, 2025 19:54
…ove masks, re-organize plots for ease of comparison
…entation. Misc updates mostly to formatting.
Co-authored-by: Chris Black <chris@ckblack.org>
Co-authored-by: Chris Black <chris@ckblack.org>
Co-authored-by: Chris Black <chris@ckblack.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants