MetopDatasets.jl

MetopDatasets.jl is a package for reading products from the METOP satellites using the native binary format specified for each product. The METOP satellites are part of the EUMETSAT-POLAR-SYSTEM (EPS) and have produced near real-time, global weather and climate observation since 2007. Learn more METOP and the data access on EUMETSATs user-portal.

MetopDatasets.jl exports the MetopDataset API which is an implementation of the CommonDataModel.jl interface and thus provides data access similar to e.g. NCDatasets.jl and GRIBDatasets.jl.

Only a subset of the METOP native formats are supported currently but we are continuously adding formats. The goal is to support all publicly available native METOP products. See supported formats for more information

MetopDatasets.jl can also be used from Python. The recommend way is to use the MetopPy package which is a python wrapper for MetopDatasets.jl. For other alternatives, see the python section in documentation page.

Copyright and License

This code is licensed under MIT license. See file LICENSE for details on the usage and distribution terms.

Authors

• Simon Kok Lupemba - Maintainer - EUMETSAT
• Jonas Wilzewski - Contributor - EUMETSAT

Installation

MetopDatasets.jl can be installed via Pkg and the url to the GitHub repository.

import Pkg
Pkg.add("MetopDatasets") 

Examples

Open data set and list variables

using MetopDatasets
ds = MetopDataset("ASCA_SZO_1B_M03_20230329063300Z_20230329063556Z_N_C_20230329081417Z");
keys(ds)

REPL output:

("record_start_time", "record_stop_time", "degraded_inst_mdr", "degraded_proc_mdr", "utc_line_nodes", "abs_line_number", "sat_track_azi", "as_des_pass", "swath_indicator", "latitude", "longitude", "sigma0_trip", "kp", "inc_angle_trip", "azi_angle_trip", "num_val_trip", "f_kp", "f_usable", "f_land", 
"lcr", "flagfield")

Display variable information

ds["latitude"]

REPL output:

latitude (42 × 48)
  Datatype:    Union{Missing, Float64} (Int32)
  Dimensions:  xtrack × atrack
  Attributes:
   description          = Latitude (-90 to 90 deg)
   missing_value        = Int32[-2147483648]
   scale_factor         = 1.0e-6

Load the complete variable

ds["latitude"][:,:]

REPL output:

42×48 Matrix{Union{Missing, Float64}}:
 -33.7308  -33.949   …  -43.7545  -43.9721
 -33.6969  -33.9152     -43.7252  -43.9429
 -33.6624  -33.8808     -43.695   -43.9127
 -33.6274  -33.8458     -43.6639  -43.8818
   ⋮                 ⋱                    
 -30.1606  -30.3748     -39.9343  -40.1446
 -30.0909  -30.3049  …  -39.8538  -40.0638
 -30.0206  -30.2344     -39.7726  -39.9823

See documentation page for more information.

SW Bill of Materials (SBoM)

Dependencies

The following dependencies are not included in the package but they are required and will be downloaded at installation: | dependency | version| license | copyright | home_url | comments | |-----------|--------|---------|-----------|----------|----------| | CSV.jl | 0.10 | MIT | 2015: Jacob Quinn, JuliaData contributors, Julia Computing| https://github.com/JuliaData/CSV.jl| CSV utilities | | CommonDataModel.jl | 0.3 | MIT | 2023 JuliaGeo | https://github.com/JuliaGeo/CommonDataModel.jl | Exports the Dataset interface used by MetopDatasets | | Compat.jl | 4.10| MIT | 2014, 2015, 2016, 2017: Stefan Karpinski and other contributors | https://github.com/JuliaLang/Compat.jl | Handle comparability with different julia versions | | DiskArrays.jl | 0.3, 0.4| MIT | 2019: Fabian Gans| https://github.com/JuliaIO/DiskArrays.jl | Interface to read arrays from files | | LazyArtifacts.jl | 1| MIT | 2009-2023: Jeff Bezanson, Stefan Karpinski, Viral B. Shah, and other contributors| https://github.com/JuliaPackaging/LazyArtifacts.jl | Handles test data as lazy artifact | | OrderedCollections.jl | 1| MIT | 2013 Dahua Lin| https://github.com/JuliaCollections/OrderedCollections.jl | Ordered dictionary | | PrecompileTools.jl | 1| MIT | 2023 Tim Holy and contributors | https://github.com/JuliaLang/PrecompileTools.jl | Precompile key methods | | RelocatableFolders.jl | 1| MIT | 2021: Michael Hatherly| https://github.com/JuliaPackaging/RelocatableFolders.jl | Make installation relocatable |

Test dependencies

The following dependencies are only required for testing the software: | dependency | version| license | copyright | home_url | comments | |-----------|--------|---------|-----------|----------|----------| | Aqua.jl | 0.8.9| MIT| 2019 Takafumi Arakaki | https://github.com/JuliaTesting/Aqua.jl | Auto quality assurance | | NCDatasets.jl | 0.14| MIT | 2017-2025: Alexander Barth and contributors | https://github.com/JuliaGeo/NCDatasets.jl | Test conversion to netCDF files | | SafeTestsets.jl | 0.1| MIT | 2018: Yingbo Ma | https://github.com/YingboMa/SafeTestsets.jl | Run test sets with individual scope |