Evaluation / Benchmarking Tools
Available evaluation tools include: iLAMB, ESMValTool, LVT, Auto-assess and PEcAn (see here for a ppt about these and similar tools). n.b. PALS (Protocol for the Analysis of Land Surface models) has current been withdrawn in anticipation of a relaunch (see here for details).
We at CEH have used ILAMB v2 to evaluate JULESvn4.7 global runs, driven by WFDEI data (see here), for the science configurations detailed here plus a new hydrology configuration developed by CEH for the eartH2Observe project Water Resources Reanalysis 2 (WRR2). We have used a series of hydrological EO benchmarking datasets (FLUXNET, FLUXNET-MTE, GLEAM and MODIS for evapotranspiration; ESA-CCI for soil moisture; IMS and GLOBSNOW for snow cover and snow water equivalent; GRACE for terrestrial water storage anomaly; GRDC for runoff), plus FLUXNET and GBAF for sensible heat.
The complete configurations evaluation is available here.
Previously, JULES vn4.3 was evaluated by CEH together with a range of models as part of the eartH2Observe WRR1 using ILAMB v1 (Schellekens et al., 2017): see here.