Skip to content

Commit b750ef6

Browse files
committed
Update documentation
1 parent 35942b2 commit b750ef6

35 files changed

+1791
-326
lines changed
41.9 KB
Loading
Binary file not shown.
Binary file not shown.
117 KB
Loading

_sources/ready/03-download.md

Lines changed: 98 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -2,19 +2,25 @@
22

33
All data files used in the lecture are available on [this webserver](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/).
44

5-
## ERA5 data
5+
I provide direct links to the most important files below.
66

7-
### Ready to use, low resolution NetCDF files
87

9-
[ERA5](https://www.ecmwf.int/en/forecasts/dataset/ecmwf-reanalysis-v5) is an atmospheric reanalysis product. We will use it a lot! Note that you can download the data yourself (I provide some sample scripts below), but for a start you can download some files I prepared for you:
8+
9+
(era5-075)=
10+
## ERA5 data (global)
11+
12+
### Ready to use, global low resolution NetCDF files
13+
14+
[ERA5](https://www.ecmwf.int/en/forecasts/dataset/ecmwf-reanalysis-v5) is an atmospheric reanalysis product. Note that you can download the data yourself (I provide some sample scripts below), but for a start you can download some files I prepared for you:
1015

1116
**Invariant (2D) data:**
12-
- [ERA5_LowRes_Invariant.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_LowRes_Invariant.nc)
17+
18+
- [ERA5_LowRes_Invariant.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_LowRes/ERA5_LowRes_Invariant.nc)
1319

1420
**Monthly surface (3D) data:**
1521

16-
- [ERA5_LowRes_Monthly_t2m.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_LowRes_Monthly_t2m.nc): 2m temperature
17-
- [ERA5_LowRes_Monthly_tp.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_LowRes_Monthly_tp.nc): total precipitation
22+
- [ERA5_LowRes_Monthly_t2m.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_LowRes/ERA5_LowRes_Monthly_t2m.nc): 2m temperature
23+
- [ERA5_LowRes_Monthly_tp.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_LowRes/ERA5_LowRes_Monthly_tp.nc): total precipitation
1824

1925
**File naming conventions**:
2026

@@ -31,31 +37,99 @@ You may want to download ERA5 data yourself if:
3137

3238
- you'd like additional variables not listed above
3339
- you'd like to use high resolution data (0.25°) instead of the low resolution (0.75°) that I provided
34-
- you'd like to download hourly or daily
40+
- you'd like to download hourly or daily data instead of monthly data
3541

3642
If you want to go this path (**optional**), you'll need an account at the [Copernicus Data Store](https://cds.climate.copernicus.eu)
3743

38-
You may want to use their online platform to analyze/download the data, or you can use a script. To get you started, [here](https://nbviewer.org/urls/cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/download_era5.ipynb) is the script I use to download all the data listed above.
44+
You may want to use their online platform to analyze/download the data, or you can use a script.
45+
46+
Here are a few example scripts to get you started:
47+
48+
- script I used to download all the data listed above: [download_era5.ipynb](https://nbviewer.org/urls/cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/download_era5.ipynb)
49+
- script I used to download the "ultra low res" data listed in the CMIP6 section - the only change is the grid resolution: [download_era5_lr.ipynb](https://nbviewer.org/urls/cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/download_era5.ipynb)
50+
- script I used to download the high resolution data (0.25°) over West Africa: [download_era5_hr_wa.ipynb](https://nbviewer.org/urls/cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/download_era5_hr_wa.ipynb)
51+
52+
53+
54+
55+
## Monthly CMIP6 data (global)
56+
57+
CMIP6 stands for the [Coupled Model Intercomparison Project Phase 6](https://pcmdi.llnl.gov/CMIP6/). It is a large collection of climate model simulations from many different models and institutions that formed the basis of IPCC AR6. The data is stored on the [ESGF](https://esgf-node.llnl.gov/projects/cmip6/) (Earth System Grid Federation) servers. Here I provide a subset of the data on my webserver for you to download.
58+
59+
The data below is regridded to a common grid (2° and 0.75°) and averaged to monthly values.
60+
61+
### Regridded to 2° resolution
62+
63+
At 2° resolution, all CMIP6 temperature and precipitation files represent **9.2GB** of data.
64+
65+
#### Projected temperature and precipitation
66+
67+
This is the list of Earth System Models (ESMs), sometimes still called Global Circulation Models (GCMs) and scenarios for which I provide temperature data. The data is regridded to a common 2° grid and averaged to monthly values:
68+
69+
```{include} cmip6-list-2deg.md
70+
```
71+
72+
**If you want to avoid having to click on all files and want to download all files at once**, you can use [wget](https://en.wikipedia.org/wiki/Wget). After downloading the list of files provided below, you can use the following command to download all files at once:
73+
74+
```bash
75+
wget -i cmip6-tas-list-2deg.txt
76+
```
77+
78+
- list of temperature files: [cmip6-tas-list-2deg.txt](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/cmip6-tas-list-2deg.txt)
79+
- list of precipitation files: [cmip6-pr-list-2deg.txt](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/cmip6-pr-list-2deg.txt)
80+
81+
#### 2° resolution ERA5 data
82+
83+
This is the same ERA5 data as you've used so far, but at an even lower resolution of 2°. I've coarsened the data even more to match the CMIP6 data available above:
3984

40-
## CMIP6 data
85+
- [ERA5_UltraLowRes_Invariant.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_UltraLowRes/ERA5_UltraLowRes_Invariant.nc): invariant data at 2° resolution
86+
- [ERA5_UltraLowRes_Monthly_t2m.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_UltraLowRes/ERA5_UltraLowRes_Monthly_t2m.nc): 2m temperature data at 2° resolution
87+
- [ERA5_UltraLowRes_Monthly_tp.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_UltraLowRes/ERA5_UltraLowRes_Monthly_tp.nc): precipitation data at 2° resolution
4188

42-
CMIP6 stands for the [Coupled Model Intercomparison Project Phase 6](https://pcmdi.llnl.gov/CMIP6/). It is a large collection of climate model simulations from many different models and institutions that formed the basis of IPCC AR6. The data is stored on the [ESGF](https://esgf-node.llnl.gov/projects/cmip6/) (Earth System Grid Federation) servers. Here I provide a subset of the data on my webserver for you to download. The data is already regridded to a common 2° grid and averaged to monthly values.
89+
### Regridded to 0.75° resolution
4390

44-
### "Ultra" low resolution ERA5 data
91+
At 0.75° resolution, all CMIP6 temperature and precipitation files represent **65GB** of data.
4592

46-
This is the same ERA5 data as you've used so far, but at an even lower resolution of 2°. I've coarsened the data even more to reduce the volume of climate projection data you'll have to manipulate for the assignments. **These datasets should only be used as reference historical data for the CMIP assignments.**
93+
#### Projected temperature and precipitation
4794

48-
- [ERA5_UltraLowRes_Invariant.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_UltraLowRes_Invariant.nc): invariant data at 2° resolution
49-
- [ERA5_UltraLowRes_Monthly_t2m.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_UltraLowRes_Monthly_t2m.nc): 2m temperature data at 2° resolution
50-
- [ERA5_UltraLowRes_Monthly_tp.nc](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ERA5_UltraLowRes_Monthly_tp.nc): precipitation data at 2° resolution
95+
The data is regridded to a common 0.75° grid and averaged to monthly values:
5196

52-
### CMIP6 1979-2100 temperature data
97+
```{include} cmip6-list-075deg.md
98+
```
5399

54-
This is the list of Earth System Models (ESMs), sometimes still called Global Circulation Models (GCMs) and scenarios for which I provide temperature data. The data is already regridded to a common 2° grid and averaged to monthly values.
100+
**If you want to avoid having to click on all files and want to download all files at once**, you can use [wget](https://en.wikipedia.org/wiki/Wget). After downloading the list of files provided below, you can use the following command to download all files at once:
55101

56-
```{include} cmip6-list.md
102+
```bash
103+
wget -i cmip6-tas-list-075deg.txt
57104
```
58105

106+
- list of temperature files: [cmip6-tas-list-075deg.txt](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/cmip6-tas-list-075deg.txt)
107+
- list of precipitation files: [cmip6-pr-list-075deg.txt](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/notebooks/cmip6-pr-list-075deg.txt)
108+
109+
#### 0.75° resolution ERA5 data
110+
111+
See [](era5-075).
112+
113+
### CMIP6 data at their original resolution
114+
115+
See this server for the original resolution files: [OGGM server](https://cluster.klima.uni-bremen.de/~oggm/cmip6/).
116+
117+
118+
119+
## Daily ISIMIP6 data (global)
120+
121+
ISIMIP6 is the [Inter-Sectoral Impact Model Intercomparison Project](https://www.isimip.org/). It is a community-driven modelling effort to understand the impacts of climate change across sectors. It aims at providing a consistent set of climate change projections for impacts assessments, and coordinates the development and application of global and regional impact models.
122+
123+
ISIMIP also provides a set of gridded daily data for a number of climate variables. As explained in Workshop 06, the data consists of a reanalysis dataset ([W5E5](https://www.isimip.org/gettingstarted/input-data-bias-adjustment/details/114/)) and a set of climate model simulations that have been bias corrected to match the reanalysis data.
124+
125+
This represents a lot of data! You will find all of the raw data files on the [ISIMIP6 servers](https://data.isimip.org/search/), but I downloaded a subset of them and mirrored them on [the course's server](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ISIMIP/raw_dl/). This comprises:
126+
127+
- [daily W5E5 data](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ISIMIP/raw_dl/W5E5/) for the years 1979-2019 and the variables `tas` (2m temperature), `pr` (precipitation), `tasmax` (max temperature), `tasmin` (min temperature), and `hurs` (relative humidity).
128+
- [daily GFDL-ESM4 data](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ISIMIP/raw_dl/GFDL/) for the years 1850-2100 and the same variables as above, as well as for the scenarios ssp126, ssp370, and ssp585.
129+
130+
The data volume for one variable and all scenarios is about 115 GB. This is a lot of data, and therefore I did not download any other climate model globally. **If you are interested in a specific region or timeseries (see below), please let me know and I can prepare the data for you.**
131+
132+
59133
## Timeseries data
60134

61135
### Weather station data
@@ -78,7 +152,7 @@ you'll find it [here](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qc
78152

79153
### Daily precipitation and streamflow from the national river flow archive
80154

81-
The [national river flow archive](https://nrfa.ceh.ac.uk) is a great resource for hydrologists. I downloaded the daily streamflow and precipitation data for the Chew river near Bristol ([station 53004](https://nrfa.ceh.ac.uk/data/station/meanflow/53004)) and provide it here:
155+
The [national river flow archive](https://nrfa.ceh.ac.uk) is a great resource for hydrologist. I downloaded the daily streamflow and precipitation data ([search tool](https://nrfa.ceh.ac.uk/data/search)) for the Chew river near Bristol ([station 53004](https://nrfa.ceh.ac.uk/data/station/meanflow/53004)) and provide it here:
82156

83157
- Chew at Compton Dando - Gauged Daily Flow (gdf): [53004_gdf.csv](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/csv/53004_gdf.csv)
84158
- Chew at Compton Dando - Catchment daily rainfall (cdr): [53004_cdr.csv](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/csv/53004_cdr.csv)
@@ -90,18 +164,13 @@ Documentation:
90164

91165
### Daily timeseries from ISIMIP
92166

93-
[ISIMIP](https://www.isimip.org/) stands for the "Inter-Sectoral Impact Model Intercomparison Project".
94-
It is a community-driven modelling effort to understand the impacts of climate change across sectors.
95-
It aims at providing a consistent set of climate change projections for impacts assessments, and coordinates
96-
the development and application of global and regional impact models.
97-
98-
ISIMIP also provides a set of gridded daily data for a number of climate variables. This represents a lot of data, and therefore I provide only a selection of timeseries here. **Do not hesitate to keep in touch if you would like me to prepare more data for you**.
167+
[ISIMIP](https://www.isimip.org/) stands for the "Inter-Sectoral Impact Model Intercomparison Project". I downloaded global daily data for the years 1979-2019 (W5E5) and for 1850-2100 (GFDL-ESM4) for the variables `tas` (2m temperature), `pr` (precipitation), `tasmax` (max temperature), `tasmin` (min temperature), and `hurs` (relative humidity). This alltogether represents a bit more than 0.5TB of data. Therefore, I extracted a number of timeseries for you to download. **Let me know if you need more locations, or perhaps a specific region!**.
99168

100-
The timeseries for precipitation and temperature are available for a number of locations. Visit the following webpage to explore them all:
169+
The timeseries are available for a number of locations. Visit the following webpage to explore them all:
101170

102171
- [ISIMIP Timeseries](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ISIMIP/timeseries/)
103172

104-
#### Data for Workshop 06 (Heathrow)
173+
### Data for Workshop 06 (Heathrow)
105174

106175
For this workshop, we will use the following timeseries at Heathrow airport:
107176
- [W5E5v2.0_tas_lhr_daily.csv](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/ISIMIP/timeseries/lhr/csv/tas/W5E5v2.0_tas_lhr_daily.csv)
@@ -124,6 +193,8 @@ All 75 river basins (see workshop 07, lesson 02) are available in a single folde
124193
- statistics for all glaciers in the world (a csv file): [rgi60_stats.csv](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/glaciers/rgi60_stats.csv)
125194
- the river basins outlines (a shapefile): [glacier_basins.zip](https://cluster.klima.uni-bremen.de/~fmaussion/teaching/qcr/glaciers/glacier_basins.zip)
126195

196+
197+
127198
## Flood workshop data
128199

129200
For the flood workshop, we prepared a set of dataset for you to download. The data is available in a single zip file, on Sharepoint (access for UoB students only):

0 commit comments

Comments
 (0)