Skip to content

Releases: stcorp/harp

1.16

31 Oct 14:25
Compare
Choose a tag to compare

📅 2022-10-31

  • Improved algorithm to calculate center point from latitude/longitude bounds
    polygon.

  • Add derivation of time dependent from time indepent for datetime variables.

  • Updates to product ingestions:

    • GEOMS PANDORA: added systematic/random uncertainty for effective
      temperature, renamed H2CO in harp variable names to HCHO.
    • OCO: added support for ACOS/OCO-2/OCO-3 L2/L3 products.
    • Ozone CCI L3 LP: fixed memory issue when reading
      merged_ozone_concentration.
    • S5P L2 HCHO: added amf=clear_sky ingestion option

1.15.1

18 May 15:35
Compare
Choose a tag to compare

📅 2022-05-18

  • Updates to product ingestions:
    • CLOUDNET L2 classification: fixed fillvalue mapping of values to NaN.
    • GEOMS PANDORA: fixes for template V003 support
    • GEOMS FTIR: allow instrument lat/lon/alt variables to be one-dimensional
      with replicated values.
    • GEOMS UVVIS.BREWER: added random+systematic uncertainty variables.
    • S5P L2 CO: fixed vertical ordering of new apriori profile.

1.15

15 Mar 13:48
Compare
Choose a tag to compare

📅 2022-03-14

  • Fixed issue where bin() operation was removing scalar enumeration variables.

  • Updates to product ingestions:

    • ECMWF GRIB: fixed parameter mapping for CAMS model data that uses
      masterTablesVersion=27 data and added support for new
      masterTablesVersion=28 data
    • GEOMS UVVIS.BREWER: added support for template V001
    • GEOMS PANDORA: added support for template V003
    • S5P L2 AAI: added new 335/367 wavelength pair
    • S5P L2 CO: added new apriori profile and support for new AVK unit
    • S5P L2 O3 Profile: added surface_albedo and cloud_albedo
    • S5P L2 HCHO/O3/SO2: added support for updated NRTI indication attribute.

1.14

20 Oct 14:35
Compare
Choose a tag to compare

📅 2021-10-20

  • Updated embedded udunits2 library to version 2.2.28.

  • Improved CMake build system.

  • Fixed issue when building against HDF5 1.12.

  • Updates to product ingestions:

    • AEOLUS L1B: fixed ingestion of Mie/measurement data; added sensor angles
    • AEOLUS L2B: fixed ingestion of Mie data; added sensor angles
    • CLOUDNET L2 classification: added support for new (netcdf4) format
    • EARTHCARE: added very early support (limited version of ECA_ACM_CAP_2B)
    • ECMWF GRIB: fixed unit of backscatter coefficient 1/(milli sr) -> 1/(m sr),
      added support for new masterTablesVersion=27 data
    • GEOMS UVVIS.DOAS: allow template V007 files to be stored in hdf5 format
    • GHG CCI: added support for TROPOMI WFMD L2
    • OMI L2: added sensor alt/lat/lon and surface altitude/pressure
    • OMI L2 OMAERUV: fix ingestion issues
    • QA4ECV HCHO: added amf=clear_sky ingestion option
    • S5P L2 HCHO: renamed cloud_altitude variable to cloud_height
    • S5P L2 NO2: added retrieval of O2-O2 cloud (O22CLD) data
    • S5P L2 NO2+FRESCO: added scene_albedo and scene_pressure
    • S5P L2 O3 Profile: fixed wrong concentration variables (vmr -> nd)
    • S5P L2 SO2: updated SO2_type enumeration list

1.13

12 Mar 15:28
Compare
Choose a tag to compare

📅 2021-03-12

  • Added rebin() operation.

  • Added harp_product_rebin_with_axis_bounds_variable() function.

  • Added support for datetime_bounds variable.

  • Fixed issue in =& operation (it returned true if any of the bits were 1
    instead of all bits).

  • Updates to product ingestions:

    • GEOMS: renamed all site_name variables to location_name
    • GEOMS FTIR H2CO: fixed issue in determining unit for H2O data (that would
      fail the ingestion)
    • S5P L2 CO: added co=corrected ingestion option
    • SCIAMACHY L2: fixed averaging of cloud fraction for co-added pixels

1.12

29 Oct 16:30
Compare
Choose a tag to compare

📅 2020-10-29

  • The csv output of 'harpdump --dataset' can now be used as content of a .pth
    file. This improves the performance of harpcollocate/harpmerge/etc. as they
    no longer need to open and extract metadata from files themselves anymore.

  • harpcollocate now stores differences as signed values in collocation result
    file (instead of absolute differences).

  • Added harp_dataset_prefilter(). This function is now also called within
    harpmerge and harpcollocate to pre-filter the input dataset(s) for datetime
    and collocate left/right filters that are at the start of the operations
    string.

  • Added format and history fields to harp_product_metadata.

  • Added harp.import_product_metadata() to Python interface.

  • harp_dataset_add_product() now ignores files/directories starting with '.'.

  • Added uncertainty propagation to bin() and bin_spatial() operations
    (using uncorrelated assumption for bin() and correlated for bin_spatial()).

  • Added global option to determine whether uncertainty propagation should
    use a correlated or uncorrelated approach. Currently only used for the bin()
    operation.

  • Added global option to create a collocation_datetime variable when performing
    a collocate_left() or collocate_right() operation.

  • Added wildcard pattern matching ('*'/'?') to keep() and exclude() operations.

  • Added derivation to retrieve angstrom exponent from aerosol optical depth.

  • Added derivation to retrieve tropospheric/stratospheric column avk from
    total column avk and tropopause altitude.

  • Fixed potential memory issues and improved overall code stability.

  • Updates to product ingestions:

    • S5P L2 CLOUD: added cloud_type and cloud_top_temperature
    • S5P L2 O3: added qa_filter=custom ingestion option to set validity based
      on official PRF recommendation for processor V1.x generated products
    • MLS L2: fixed memory issue in reading of validity variable and updated
      validity flag mapping to version 4.x-4.0 of the Data Quality document

1.11

19 May 15:58
Compare
Choose a tag to compare

📅 2020-05-19

  • Added derivations to retrieve column number density from column vmr.

  • Fixed issue in bin_spatial() where the weightfactor could be too high when
    oversampling the input data. Grid cells that intersected with the data
    polygon could end up with a weightfactor >1.0 (but <2.0).

  • Fixed issue where molar mass was incorrectly provided for the species with
    the shortest matching name. e.g. the molar mass of CO was returned for CO2
    and of NO for NO2. This impacts vmr <-> mmr conversions for BrO2, COF2, COS,
    CO2, C2H2O2, H2O2, NOCl, NO2, N2O, N2O5, and all isotopologues (e.g. H2O_161).

  • Removed irrelevant harp_str64() and harp_str64u() functions (HARP does not
    support 64bit integers).

  • Fixed issue where molar mass linked to variables with a 'surface',
    'tropospheric', or 'stratospheric' prefix returned 0.

  • Fixed error/crash in deriving dry air column vmr from dry air column mmr.

  • Updates to product ingestions:

    • GOME-2 L2: added support for SO2 columns at all plume heights
    • OMI L2 CLDO2/CLDRR: added validity variable

1.10

31 Mar 19:36
Compare
Choose a tag to compare

📅 2020-03-31

  • Added support for -ar/--reduce-operations parameter in harpmerge and
    for reduce_operations parameter in harp.import_product() Python function.

  • Fixed incorrect "invalid variable" error on weight variables for angular
    quantities when performing a harpmerge.

  • Fixed issue where the udunits2 library could not be initialized if the
    environment had a LC_NUMERIC locale that did not have '.' as decimal
    separator.

  • Fixed issue in name mangling of embedded expat library.

  • Updates to product ingestions:

    • GOMOS L1 Limb: fixed unit of wavelength_photon_radiance (and uncertainty)
      and documented conversion algorithm
    • S5P L2 O3 PR: support for IODD 12.0.0
    • S5P L2 O3 TPR: removed support (future availability of product uncertain)
    • GEOMS PANDORA: allow for trailing \0 in global attribute values

1.9.2

01 Dec 20:44
Compare
Choose a tag to compare

📅 2019-12-01

  • Fixed issue where using the 'bin()' operation did not correctly create a
    '<variable>_weight' variable from a 'weight' variable when it was missing.

  • Added default units to documention on variable name conventions.

  • Updates to product ingestions:

    • Calipso L2: fixed unit of backscatter coefficient
    • ERS GOME L2: fixed unit of cloud top height
    • S5P L2 AER_LH: fixed unit of aerosol optical depth
    • S5P L2 SO2: add scaled avk for 1km/7km/15km box profiles

1.9.1

01 Nov 13:49
Compare
Choose a tag to compare

📅 2019-11-01

  • Fixed issue where results from deriving partial column densities from vmr and
    pressure were a factor 10 too low.

  • Fixed issue where operation following an index filter operation did not
    get executed.