Final Report

Latest revision as of 10:49, 13 November 2014

1 Introduction
2 Instruments
3 Products
4 Networks
- 4.1 Operational networks
  - 4.1.1 The European network of wind profilers CWINDE
  - 4.1.2 The Swiss nuclear powerplant meteorological surveillance tool CN-MET
- 4.2 Candidate networks
  - 4.2.1 Ceilometer network
  - 4.2.2 MWRnet
5 NWP Applications
6 References

[edit] 1 Introduction

[edit] 1.1 List of contributors

Editors: A.J. Illingworth, D. Ruffieux, D. Cimini, U. Löhnert, M. Haffelin, V. Lehmann.

Contributors (in alphabetical order): F. Angelini, E. Batchvarova, C. Brandau, D. Cimini, O. Cox, H. Czekala, A. Dabas, D. Donovan, J.C. Dupont, K. Ebell, J. Fernández-Gálvez, M. E. Ferrario, C. Gaffard, G.P. Gobbi, U. Görsdorf, J. Güldner, A. Haefele, M. Haffelin, F. Hurter, A.J. Illingworth, S. Kauczok, H. Klein Baltink, V. Lehmann, R. Lehtinen, D. Leuenberger, U. Löhnert, S. Lolli, F. Madonna, O. Maier, G. Martucci, G. Maschwitz, I. Mattis, D. Nicolae, E. O’Connor, G. Pace, S. Pal, M. Piringer, B. Pospichal, D. Ruffieux, L. Sauvage, B. Thies, L. Thobois, W. Thomas, M. Wiegner.

[edit] 1.2 General Remarks

The advent of high resolution climate models together with high resolution weather forecast models running at global, regional and 1km convection resolving scales requires an integrated composite observing sytem which builds on existing infrastructure.Such a system must be of appropriate quality to meet the requirements of the numerical weather prediction (NWP) and climate coummunity. The goal of the COST action ES0702 is to specify an optimum European network of inexpensive, unmanned ground based profiling stations, which can provide continuous profiles of winds, humidity, temperature, clouds and aerosol properties.

If the data from these networks are to be used, then several conditions must be fulfilled. Firstly a standard calibration, maintenance, and automatic data quality checking system must be developed. Secondly, the format of the data must be the same, so that it can be exchanged efficiently and rapidly in near real time. The model can then be evaluated by comparison with the observations over over a suitably long period. Ideally difficulties with the model can be identified and rectified so we can move to the third stage, and the 'O-B' statistics can be derived. That is to say the statistics of the difference between the observation and the background state. If the absence of bias can be confirmed, the standard deviations of the differences characterised and the spatial representativity of the observations established, then the observations can be considered as candidates for data assimilation and they can be used to improve the initial state of the model so that it better represents the true state of the atmosphere. The density of the network is a balance between the spatial representativity of the observations and the economic costs of deploying the instruments.

This document provides a summary of the major findings and conclusions of the EG-CLIMET action. It highlights four profiling instruments, their synergy, and NWP applications. The instruments provide profiles of aerosol and cloud backscatter, winds, temperature and humidity:

Ceilometers
Doppler lidars,
Wind profilers
Microwave Radiometers
Synergy and NWP applications

[edit] 1.3 Summary of Findings and Recommendations

Ceilometers: EG-CLIMET has

Compiled a list of hundreds of ceilometers deployed in Europe.
Demonstrated they could supply real time backscatter profiles from clouds and aerosols.
Demonstrated simple accurate calibration techniques using atmospheric targets
Demonstrated they can measure the boundary layer height in unstable boundary layers.
Compared the backscatter profiles of clouds and aerosols with NWP models predictions.
Recommended to EUCOS that these instruments be networked to provide real time data.

Doppler Lidars: EG-CLIMET has

Examined the performance of new Doppler lidars; 25 are now deployed in Europe.
Demonstrated that they can provide accurate winds in the boundary layer.
Demonstrated they can measure turbulence and vertical exchange in the boundary layer.
Recommended to EUCOS that these instruments be networked to provide real time data.

Wind Profilers: EG-CLIMET has

Developed algorithms, now implemented operationally, to reject spurious bird echoes.
Improved algorithms, now implemented operationally, for rejecting spurious ground clutter.
Demonstrated the positive impact of well-maintained wind profilers on NWP forecasts.

Microwave Radiometers: EG-CLIMET has

Compiled a list of MWRs in Europe and developed an international network: MWRnet.
Demonstrated the accuracy of temperature and water vapour in retrieved profiles.
Demonstrated the value of MWR in estimating boundary layer depth.
Provided the first comparison of MWR retrievals with NWP model predictions.

Synergy and NWP: EG-CLIMET has shown that

Ceilometer data may be used for evaluation of NWP models and subsequent assimilation.
Doppler Lidars, together with Wind Profilers, can provide winds throughout the troposphere.
Strategically placed wind profilers have a positive impact on NWP forecasts.
Wind profilers are operationally assimilated in several NWP models. Moreover, they can be combined with NWP to provide warnings in case of a nuclear hazard.

Following EG-CLIMET presentations to EUCOS, the body responsible for the European observing system, E-PROFILE has been launched which will run from 2013-2017 and will be responsible for Wind Profiler data quality and for coordinating real time exchange of backscatter profiles from ceilometers and lidars. A new COST action, ES1303, TOPROF, ’Towards Operational ground based PROFiling with ceilometers, Doppler lidars and microwave radiometers for improving weather forecasts’, will address common calibration, retrieval algorithms and data quality issues.

A condensed overview of the EG-CLIMET achievements is available in the EG-CLIMET Executive Summary

[edit] 2 Instruments

[edit] 2.1 Radar Wind Profiler

Radar wind profilers (RWP) are special Doppler radars designed for measuring the vertical profile of the wind vector in the lowest 5 - 20 km of the atmosphere (depending on the operating frequency), on timescales ranging from seconds to years. RWP are also able to provide additional information about the atmospheric state through the profiles of backscattered signal intensity and frequency spread (spectral width) of the echo signal.

For more information: Radar wind profiler

[edit] 2.2 mm-Wavelength Radar

Millimeter wavelength cloud radars measure profiles of the intensity of particle-backscattered signals and their Doppler shift which can be used to derive information about the particle size and concentration as well as about their motion. Because of their short wavelengths, cloud radars have excellent sensitivity to small cloud droplets and ice crystals. Some radars have the capability for polarimetric measurements which contain additional information about the particle shape and orientation. Cloud radars are ideal for continuously monitoring the vertical distribution and structure of various cloud types as well as for studying the role of non-precipitating clouds in the climate system.

For more information: Cloud radar

[edit] 2.3 Lidar Fundamentals

Lidar is one of the most powerful atmospheric profiling techniques for the ground-based monitoring of aerosol, water vapour, clouds and many other atmospheric parameters. The lidar profiling technique is based on the study of the interaction between a laser radiation sent into the atmosphere and the atmospheric constituents.

For more information: Lidar fundamentals

[edit] 2.4 Doppler Lidar

The Doppler Wind Lidar (DWL) have demonstrated their ability to provide wind measurements through the atmosphere. A DWL is a rugged instrument that meets the requirement of unmanned and unattended operation, with a very high spatio-temporal resolution. Some commercial available coeherent systems provide measurements with a temporal resolution of about 10 s and spatial resolution of 50 m measurements of the full wind velocity vector and backscatter within the atmospheric boundary layer.

For more information: Doppler Wind Lidar

[edit] 2.5 Raman Lidar

The Raman lidar uses the scattering properties of molecules and aerosols to derive profiles of water vapor and other species, aerosols and temperature with a high vertical and temporal resolution. Raman lidars can cover an altitude range from a few hundreds of meters to the lower stratosphere. Recent progress in lidar research brought Raman lidars into a nearly operational state and they are becoming suited for meteorological applications.

For more information: Raman Lidar

[edit] 2.6 Ceilometer

Ceilometers are inexpensive single-channel lidars. These instruments are principally employed to automatically identify the height of the cloud base above the instrument. Although the name ceilometer suggests that their sole purpose is to detect cloud-base, modern ceilometers are able to provide continuous accurate and reliable profiles of backscatter from aerosols and clouds. Modern Lidars are becoming more automated and can now contribute efficiently to continuous monitoring of air quality and weather.

For more information: Ceilometer

[edit] 2.7 Microwave Radiometer

Ground-based microwave radiometer (MWR) measurements of atmospheric thermal emission are useful to derive temperature and humidity profiles as well as information on integrated values of water vapor and liquid water. With careful design, MWR can make continuous observations (time scales of seconds to minutes) in a long-term unattended mode in nearly all weather conditions.

MWR are used for a variety of environmental and engineering applications, including meteorological observations and forecasting, communications, astronomy, radio-astronomy, geodesy and long-baseline interferometry, satellite validation, climate, air-sea interaction, and fundamental molecular physics.

For more information: Microwave radiometer

[edit] 3 Products

[edit] 3.1 Temperature profile

In combination with profiles of humidity, accurate temperature profiles are essential for measuring atmospheric stability and thus for determining the onset of convection, precipitation and severe weather in general. State-of-the-art high-resolution NWP models are able to explicitly resolve convective processes leading to precipitation. These typically occur on time scales < 1h and spatial scales < 2 km underlining the need for temporally and spatially highly resolved observations. Continuous and accurate temperature profiles of the boundary layer may also provide valuable information for dispersion calculations of pollutants, i.e. MeteoSwiss has installed a network of 3 combined wind profiler / microwave profiler stations to continuously monitor the atmospheric conditions within the vicinities of nuclear power plants (Calpini et al. 2011).

[edit] 3.1.1 User requirements and benefits

In the context of high-resolution NWP, WMO Observing Requirements Database sets the uncertainty goals for temperature measurements in the lower troposphere to 0.5 K accuracy at 0.1 km vertical and 15 min temporal resolution. Note that the corresponding uncertainty thresholds are set to 3 K accuracy at 1 km vertical and 6 h temporal resolution. Current weather forecast models rely on a) radiosondes, b) polar-orbiting satellites and c) ascending/descending commercial aircrafts at major airline hubs (AMDAR: Aircraft Meteorological DAta Relay) for the lower tropospheric temperature profile. While the vertical resolution and accuracy of radiosondes are high, the temporal resolution is commonly only 12 h at a given launch site. Moreover, the already sparse global coverage of radiosonde sites will be further reduced in the coming years as a result of economic pressure. Polar orbiting satellites provide temperature information of the upper and middle troposphere with a temporal resolution of typically 3-6 h. However, lower tropospheric temperature information is extremely difficult to retrieve due to surface contamination effects. In case commercial air traffic is running operationally, AMDAR measurements provide vertically highly resolved measurements of temperature with an absolute accuracy of better than 1.0 K (Drüe et al. 2008) around major airport hubs of the word. However these measurements are more frequent during daytime and are subject to natural hazards, i.e. volcanic eruptions or extreme weather events. Within this COST action ground-based remote sensing instruments have been identified for atmospheric temperature profiling of the lower troposphere. Advantages of these instruments in comparison to the above-mentioned platforms are continuous measurements with higher temporal resolution, i.e. on the order of minutes. Also the remote sensing systems are typically very sensitive towards the boundary layer temperature profile, complementing polar-orbiting satellite measurements. Next to the temporal aspect, MWR distributed at stations without regular radiosonde launches can add additional information in space. As shown by Löhnert et al. (2007), the optimal combination of available radiosonde data with continuously measuring microwave profilers has the potential to improve the 4D temperature field within a measurement domain.

[edit] 3.1.2 Available techniques

Several ground-based remote sensing techniques for temperature profiling the lower troposphere are available. Due to their suitability for operational measurements and widespread European distribution (i.e. organized within the new international Microwave Radiometer Network MWRnet), microwave profilers have been in the main focus of EG-CLIMET (see Microwave radiometers) and are suited for fulfilling the WMO User Requirements within the next years. Additionally, some of the wind profiler stations within E-WINPROF are also equipped with a Radio Acoustic Sounding System (RASS), which also offers the possibility of operational temperature sounding. Additionally, some of the European Atmospheric Observatories (AO) have been equipped with infrared spectrometers, which can deliver temperature profile information in clear-sky conditions. Raman lidar seems also a promising technology for future applications. The latter three measurement principles are shortly highlighted below, while the potential of microwave radiometers is discussed in detail.

Infrared spectrometer: Passive observations in the infrared can be used to obtain temperature profile information. ”Passive” in this sense means that the instrument only receives natural radiation of the atmosphere without actively emitting any radiation itself. High spectral resolution infrared observations contain information on the vertical profile of temperature due to the spectral absorption features of carbon dioxide. If homogeneous mixing of carbon dioxide is assumed, the changes of the corresponding line shapes can solely be attributed to the vertical temperature structure, e.g. in the spectral region around $14 \mu m$ . Löhnert et al. (2009) demonstrated that an infrared spectrometer can provide more than twice the information on the temperature profile than a zenith-looking microwave profiler during clear-sky cases (Fig. 3.1.1). However their profiling capability during the presence of clouds is limited because measurements are easily saturated in the presence of even very low-liquid water content clouds. Also, in clear-sky conditions infrared spectrometer methods need information on aerosol loading and trace gases in order to infer thermodynamic profiles with sufficient accuracy. Additionally, their calibration requires continuous monitoring and robust all-weather operation currently still proves difficult. Currently, only a few instruments are measuring worldwide for research purposes and no sophisticated network structure has yet been conceived.

Figure 3.1.1: Profiles of temperature for a summer and winter case at Payerne, Switzerland. Shown are radiosonde measurements (black), microwave retrievals using zenith measurements only (green), and infrared spectrometer retrievals (red). Adapted from Löhnert et al. (2009).

RASS: Radio Acoustic Sounding Systems are able to measure the speed of sound waves as a function of height, from which the profile of the atmospheric virtual temperature can be derived (Wilczak et al., 1996). A RASS consists of a wind profiler radar combined with an acoustic source. The transmitted sound waves create artificial inhomogeneities in the refractive index field, which propagate with the speed of sound. Due to its sensitivity to refractive index variations, the wind profiler can measure the speed of sound. Since the speed of sound is dependent on temperature and humidity, the profile of virtual temperature can be retrieved. Depending on the configuration of the system a vertical resolution on the order of 100 to 500 m can be obtained with absolute uncertainties below 1K. The most important source of uncertainty is caused by turbulent vertical air motion. The measured speed of sound is the true speed of sounded added to the background vertical air motion. To compensate for this error most RASS systems measure the acoustic speed and the vertical air speed simultaneously. However, whether this correction is applied in real time depends on the data processing of each specific system. Due to the strong attenuation of the acoustic signals, the vertical range of RASS is generally lower than that of the wind profilers. Depending on system and the atmospheric conditions, RASS can profile virtual temperature up to heights ranging from 0.5 to 4 km. Only a few of the 31 wind profilers within E-WINPROF are currently equipped with RASS technology. These data are processed simultaneously to the wind vector profiles, however are not further injected further into any forecasting system. Currently there are no plans for expanding the spatial coverage of RASS technology within E-WINPROF, nor for assimilating this data into NWP. However, a combination with microwave profiler at the E-WINPROF sites could help deriving an optimized temperature product throughout the full depth boundary layer.

Raman Lidar: Raman Lidar uses the scattering properties of molecules and aerosols to derive profiles of water vapor, aerosols and temperature with a high vertical and temporal resolution. Raman Lidars can cover an altitude range from a few hundreds of meters to the lower stratosphere. In contrast to classical backscatter Lidar that relies on elastic scattering, Raman Lidar makes use of the inelastic scattering where the scattering molecule changes its vibrational and/or rotational energy state and by this changes the wavelength of the scattered photon. The change in wavelength depends on the two involved energy levels and is specific for the scattering molecule. Since the population of the energy states follows a Boltzman distribution, the Raman backscatter coefficient depends on temperature, which states the physics behind the rotational Raman technique to measure atmospheric temperature (Vaughan et al., 1993). Recent progress in Lidar research has brought Raman Lidars into a nearly operational state and they are becoming suited for meteorological applications. However, the number of operational Raman Lidars is still very small and they are still in the focus of active research.

[edit] 3.1.3 Retrieval algorithms and errors

MicroWave Radiometers (MWR) for temperature profiling measure passively at several frequencies along the 60-GHz oxygen absorption complex from the ground as well as from space. A clear advantage of using passive microwave measurements for temperature profiling is the semi-transparency with respect to liquid water clouds. Microwave signals around 50-60 GHz do not saturate due to clouds yielding that profiles of temperature may be derived is cloudy and clear-sky cases. The spectral absorption features of oxygen in the microwave region allow for retrieving information on the vertical structure of temperature. The homogeneous mixing of oxygen within the troposphere results in the fact that changes of the corresponding line shapes can solely be attributed to the vertical temperature structure. From the ground, observations are typically taken in zenith direction at about five to ten frequency channels from 50–60 GHz. Channels in the center of the absorption band are highly opaque and the observed brightness temperature (TB) is close to the environmental temperature. For frequencies further away from the center the atmosphere is less opaque and the signal systematically originates additionally from higher atmospheric layers. For ground-based observations the weighting functions at the different frequencies all decrease continuously with height and limit the vertical resolution rather than the radiometric noise. By observing the atmosphere under different elevation angles, additional information about the temperature of the lowest kilometer can be gained. One-channel systems operating around 60 GHz have been developed (Kadygrov and Pick, 1998), which derive profile information from elevation scanning when assuming horizontal homogeneity of the atmosphere. In this case, the lower the elevation angle measurement, the lower the height from which the temperature information originates. Since these TB vary only slightly with elevation angle, the method requires a highly sensitive MWR that is typically realized by using wide bandwidths up to 2 GHz. Since the use of a single highly opaque channel limits the information content to altitudes below 600 m, combined multi-channel and multi-angle observations can be used (Crewell and Löhnert, 2007) improving the accuracy in the lowest 1500 m. Quantitative retrieval accuracies as well as typical values of vertical resolution for microwave temperature profiling of the lower troposphere are summarized in Tab. 3.1.1. Generally, profiles can be derived up to 4 km height above ground with a high vertical resolution at the surface, which rapidly decreases above 1.5 km height. This implies that close-to-the-surface inversion can be observed very well while elevated or multiple inversions are difficult to capture.

Table 3.1.1: MWR characterization for temperature profiling
Temporal resolution	Height range	Independent pieces of information	Vertical resolution	Accuracy
5-15 minutes	up to 4 km	~4 with elevation scanning	~10m at surface ~150m at 500m ~500m at 1500m	0.5-1.0 K in lowest km 1.0-1.7 K from 1-4 km

The accuracies (Standard DEViation STDEV with respect to radiosonde) shown in Fig. 3.1.2 underline the potential of MWR for temperature profiling during clear and cloudy situations. After the an offset correction, STDEV values are within 0.4 to 1.4 K in the lowest 2 km and increase to 1.7 K at 4 km. Above this height only 5% independent information originates from the radiometer measurement itself. The high accuracies below 1 km are primarily due to the information contained in the elevation scans (Löhnert et al. 2009).

Figure 3.1.2: Temperature profile differences (BIAS and STDEV) during all-sky conditions from August 2006-December 2009 between MWR and radiosonde measurements at Payerne, Switzerland aerological station. Black lines show the retrieval results without using the systematic TB offset correction while green lines show the results applying the systematic TB offset correction (OC). A total number of 2107 matching MWR/radiosonde cases were considered; in 1816 cases the MWR measurements passed the quality control and are evaluated in the plot. Adapted from Löhnert and Maier 2012.

A further way to characterize accuracy and vertical resolution of passive remote sensing methods is to evaluate the degrees of freedom for signal that state the number of independently vertically resolved levels of temperature (or humidity or other) that can be determined from the measurements (Hewison (2007)). This number of independent pieces of information depends to some degree on the number of spectral channels of the observations, the noise levels and the spectral location of the channels, but also depends strongly on the spectral characteristics of the absorption lines observed. As shown in Tab. 3.1.1, microwave radiometers using a multi-frequency, multi-angle approach are able to give 4 independent pieces of temperature information in the lower troposphere (here up to 4 km). Note that temperature profiles measurements can be derived with temporal resolutions of 15 min and smaller. If an operation mode of permanent elevation scanning were chosen, temperature profiles could be derived every 2-3 minutes, however the simultaneous retrieval of integrated water vapor and cloud liquid water path (IWV, LWP) water requires periods of zenith observations in between.

[edit] 3.1.4 Operational performance and technical implementation

Rapid technological development for MWRs in the last two decades has brought forward a generation of commercially available instruments, which can, on long-term time periods, measure autonomously under varying weather conditions. Within MWRnet), which was initiated through EG-CLIMET, a large part of the European and US-American MWR users have linked together under the aspects of harmonization of measurement modes, data formats, meteorological parameter retrieval, advice for operations, etc. Table 3.1.2 gives an overview of the identified advantages, challenges and limitations of the proposed microwave temperature profiling system.

Driven by the demands stated by MWRnet, Löhnert and Maier (2012) have carried out a study to define quality control measures for operational MWR measurements. A critical point to be addressed is the automated detection/removal of liquid of frozen water on the instrument radome to guarantee uninterrupted performance also during precipitation conditions. Also, operational MWR measurements need to be monitored permanently during clear sky conditions using simple non-scattering radiative transfer models as reference for calibration stability. Such monitoring is necessary to identify possible TB offsets. TB offset corrections are essential for providing an optimized temperature profile product. Fig. 3.2.2 shows typical systematic differences that range between -0.6 and +0.3 K in the lowest 4 km if a TB offset correction is not applied. After applying the correction the overall temperature bias is in the range +-0.1 K. With respect to the WMO User Requirements for high-resolution NWP, microwave profilers can fulfill the standards for temperature profiling if operators agree on standardized calibration and operation procedures within a network such as MWRnet.

Table 3.1.2: MWR performance for temperature profiling
Advantages	Challenges	Limitations
Boundary layer profile comparable to radiosonde Operation in clear-sky, cloudy-sky and light precipitation Continuous measurements on the order of minutes Network suitable, remotely steerable MWRnet as an emerging international network	Automated quality control of wet radome, radio frequency interference calibration controll Harmonized data processing: from raw data to quality-controlled temperature profiles (MWRnet goal)	Vertical resolution above 1500m Inversions only detectable < 1.5 km No information above 4 km

[edit] 3.1.5 Summary and recommendations

A network of microwave profilers bears potential for improving short-term weather forecasts as well as nowcasting applications. While the advantages of high temporal resolution and un-manned routine observations must be stressed, a limited vertical resolution (with respect to radiosondes) and corresponding random error inherent within the measurement principle must be kept in mind. Microwave profilers allow the addition of information on the stability development in the boundary layer between two consecutive radiosondes launched typically at 12 hourly intervals. This is particularly important during weather conditions that are triggered by the boundary layer, when timely soundings are crucial for accurate local forecasting.

Microwave profilers state current emerging technology that will be able to provide operational and quality controlled temperature profiles in the near future. Note that most microwave profilers are also capable of providing humidity and cloud liquid water content informatio (see sections 3.2 and 3.7). Within EG-CLIMET MWRnet has been established as a prototype of a worldwide microwave radiometer network setting up common calibration and operation procedures for microwave radiometers to guarantee continuous, unified and quality-controlled temperature profiles. In this respect EG-CLIMET recommends the following:

Further consolidation of MWRnet to be able to provide near-real-time, quality controlled temperature profiles on an openly available platform in the near future.
In an optimum future configuration, the E-WINPROF sites could be equipped additionally with microwave profilers, so that these sites could simultaneously deliver dynamic and thermodynamic information on the atmospheric state. The E-WINPROF sites equipped additionally with RASS technology could then deliver an optimized temperature profile product by merging the boundary layer information from the microwave profiler with the low-mid tropospheric temperature profile obtained from the RASS.

In order to prove the impact of additional measurements on the short-term weather forecast, EG-CLIMET recommends the following:

Evaluation by means of Observation System Simulation Experiments (OSSE) in collaboration with national weather services: in such an experiment a first independent model run is used to simulate the atmospheric state as well as all measurements (including remote sensing), and a second model is used to calculate a forecast initiated by the "model truth" of the first model. Evaluation of forecast accuracy using the additional remote sensing instruments can then be carried out in a straight-forward manner. Of course the validity of this experiment depends on the how well the first model can characterize "reality" and its variability. Such an experiment was carried out by Otkin et al. (2011) and Hartung et al. (2011). Their aim was to characterize the impact of ground-based AERI, MWR, Doppler lidar and water vapor lidar measurements on forecast quality. Improved wind and moisture analyses obtained through assimilation of these observations contributed to more accurate forecasts of moisture flux convergence and the intensity and location of accumulated precipitation due to improved dynamical forcing and meso-scale boundary layer thermodynamic structure. However, these results must be verified during different cases in future and currently lack the inclusion of standard satellite systems.
If real measurements are available, Observation System Experiment (OSE) should be carried out to characterize the forecast impact of different observations by comparing the results of two or more different model runs with standard observations. For ground-based water vapor lidar observations during the LAUNCH 2005 measurement campaign, Grzeschik et al. (2008) could show a downstream impact on forecasted humidity within a four-hour time window after assimilation. Similar impact studies are currently planned within MWRnet in cooperation with the international Hydrological cycle in Mediterranean EXperiment HyMeX project.

[edit] 3.2 Humidity profile

Water vapor is one of the most relevant component of the atmosphere, controlling both weather and climate and playing a central role in atmospheric chemistry. Water vapor is the dominant greenhouse gas in the Earth's atmosphere, contributing for 2/3 of the whole green-house effect. The distribution of water vapour is highly variable, both in time and space, spanning more than 3 orders of magnitude (in terms of ppmv) in the vertical distribution over the troposphere. Water vapour, both at surface and in the upper-air, is indicated as an Essential Climate Variables by GCOS (Global Climate Observing System) For NWP, with the increasing resolution of NWP models from global to local, the knowledge of the 3D humidity field becomes more and more important, as the humidity acts as a trigger for microphysical processes that are usually explicitly resolved at finer scales. Due to the role of water vapor in weather and climate, precise measurements of the vertical distribution of water vapor are essential for the aims of EG-CLIMET.

[edit] 3.2.1 User requirements and benefits

Humidity profiles are currently available from radiosondes over populated land areas; the WMO Statements of Guidance for NWP and Climate state that the vertical resolution is adequate and the accuracy is good or acceptable, but the horizontal and temporal resolution is sometimes marginal, due to the high horizontal variability of the humidity field. Satellite passive observations provide useful information on stratospheric and upper tropospheric humidity with good horizontal resolution and acceptable accuracy. Also, satellite radio-occultation measurements provide high accuracy and high vertical resolution in the stratosphere and upper troposphere. Differently from the AMDAR system providing temperature profiles, currently very few aircraft provide humidity measurements. As a conseguence, the humidity in the lower troposphere (including the planetary boundary layer) is highly under-observed.

The WMO Observing Requirements Database sets the goal, breakthrough, threshold values for the uncertainty, observing cycle, horizontal and vertical resolution for lower tropospheric specific humidity observations, as reported in Table 3.2.1.

Table 3.2.1: WMO Observing Requirements for specific humidity profiling in the lower troposphere
CLIMATE	Goal	Breakthrough	Threshold
Uncertainty	2%	4%	15%
Horizontal resolution	10km	15km	25km
Vertical resolution	n.a.	n.a.	n.a.
Observing cycle	3h	4h	6h
NWP	Goal	Breakthrough	Threshold
Uncertainty	2%	5%	10%
Horizontal resolution	0.5km	5km	20km
Vertical resolution	0.1km	0.2km	1km
Observing cycle	15min	30min	120min

Within this COST action ground-based remote sensing instruments have been identified for atmospheric water vapor profiling of the lower troposphere. Advantages of these instruments in comparison to the above-mentioned platforms are continuous measurements with higher temporal resolution, i.e. on the order of minutes. Next to the temporal aspect, instruments distributed at stations without regular radiosonde launches can add additional information in space. Similarly for temperature (Löhnert et al. (2007)), the optimal combination of available radiosonde data with continuously measuring humidity profilers has the potential to improve the 4D humidity field within a measurement domain.

[edit] 3.2.2 Available Techniques

Tropospheric humidity profiles may be measured by in-situ soundings and several ground-based remote sensing techniques, including the following:

Infrared spectrometer
Raman lidar
Differential Absorption Lidar (DIAL)
GNSS tomography
MWR humidity profilers

Some of the European Atmospheric Observatories (AO) are equipped with infrared spectrometers, which can deliver humidity profile information in clear-sky conditions. Also, most of the lidar stations belonging to the European network EARLINET deploy Raman lidars for humidity profiling, while DIAL systems have still relatively sparse distribution. Microwave radiometer (MWR) profilers have wider distribution in Europe, recently organized within the International Microwave Radiometer Network MWRnet. Water vapor tomography based on Global Navigation Satellite System (GNSS) relies on ground-based GNSS receivers, which have a much higher density with respect to the other instrumentation above, e.g. EUREF. The principles, advantages and limitations of these techniques are shortly introduced below, while the potential of microwave radiometers is discussed in more detail.

Infrared spectrometer: Passive observations in the infrared can be used to obtain humidity profile information, similarly to temperature. High spectral resolution infrared observations contain information on the vertical profile of water vapor due to its spectral absorption features in the spectral region within $8-13 \mu m$ and around $18 \mu m$ . The so-called “onion-peeling” method has been used for over a decade for temperature and humidity profiling from infrared spectrometers (Smith et al., 1999; Feltz et al., 1998). This technique doesn’t yield information on the error covariance matrix of the retrieved profiles, thereby making it difficult to assimilate the data into a numerical model. More recently Optimal Estimation (OE) methods have been used. This iterative technique uses a priori information, together with the sensitivity of the forward model, to retrieve the entire profile of temperature and humidity simultaneously, providing the uncertainty covariance matrix of the retrieved temperature and humidity profiles (Feltz et al., 2005). A long history of infrared spectrometer observations exist, with nearly two dozen systems deployed world-wide, many of which are providing long-term monitoring.

Figure 3.2.1: The distribution of DFS in zenith spectral MWR observations (MZ), elevation scanning MWR observations (ME), and Infrared spectrometer (AE) observations for profiles of temperature (left) and water vapor (right) at a mid-latitude (Payerne, top) and tropical (Darwin, bottom) site. Adapted from Löhnert et al. (2009).

Figure 3.2.2: Simulated humidity profiling performances (left: root-mean-square-error; right: bias) from Microwave radiometer zenith observations (MZ), infrared spectrometer observations (AE), two different combined microwave and infrared retrievals (MZAE and MZAE4), and a priori (APR) at a mid-latitude (Payerne, top) and tropical (Darwin, bottom) site. Adapted from Löhnert et al. (2009).

Performances: An infrared spectrometer can provide more degrees of freedom for signal (DFS), i.e. piece of independent information, on the humidity profile than a zenith-looking microwave profiler, as demonstrated by Löhnert et al. (2009) (Fig. 3.2.1), though the first depends more on the total water vapour content and it is limited to clear-sky only. Simulated results in Figure 3.2.2 (adapted from Löhnert et al., 2009) show that in clear sky, humidity profiles from infrared spectrometer (AE, in red) are 30-50% more accurate than those provided by microwave radiometer (MZ, in green) for a midlatitude site (top), while much less pronounced for a tropical site (bottom), where MZ actually outperforms AE above 2 km. Advantages: Infrared spectrometers offer relatively high information content on the vertical profile of water vapor related to other passive profilers. Due to their calibration approach, both the absolute calibration and the sensitivity of the instrument is monitored, which makes these observations particularly well suited for long-term observations that can be used to develop climatology and trend analyses (Gero and Turner, 2011). Infrared spectrometers can operate day and night. Limitations: One limitation to humidity profiling with ground-based infrared spectrometers is the presence of clouds above the instrument. Also, in clear-sky conditions infrared spectrometer methods need information on aerosol loading and trace gases in order to infer thermodynamic profiles with sufficient accuracy. Retrievals of thermodynamic profiles from ground-based IR observations in precipitating conditions are not possible. Another limitation is the low vertical resolution of the humidity profiles, which is higher than for microwave radiometers, but still much lower than for active sensors (as lidars). Infrared spectrometers need to be housed at laboratory temperatures leaving the front end in the ambient environment, which requires a proper infrastructure. These systems are typically configured to only view the atmosphere in the zenith direction.

Raman LIDAR: Raman lidar is a very powerful method to measure tropospheric water vapor profiles. The measurement principle and the inversion are described in Raman Lidar. The water vapor profile has to be calibrated with an external measurement like radiosonde or other remote sensing measurements like MWR. Only recently, new methods have removed this requirement by using a NIST traceable light source to determine the calibration with less than 3% relative uncertainty (Venable et al., 2011).

Figure 3.2.3: 2D time series of water vapor mixing ratio above Payerne, Switzerland, measured by Raman lidar.

Performances: With a temporal resolution of typically 30 min and a vertical resolution in the order of meters, Raman lidars are able to resolve the extremely high variability of water vapor (Fig.3.2.3). The relative random error is reported in the range of 2 to 10% depending on altitude and background noise level (daylight). Advantages: The Raman lidar system gives very high vertical and temporal resolution profiles of water in the troposphere. Unlike passive remote sensing instruments that require inversion schemes, the Raman lidar technique allows for a direct method of profiling water vapor mixing ratio amounts. Furthermore, for each profile, accurate estimates of the error covariance matrix can be determined in dependence of weather conditions. Limitations: Up to now, no commercial Raman water vapor lidars exist. The exisiting systems for applications in research and operational meteorology are mostly prototypes and require an important maintenance effort to achieve a high data availability. Raman lidar water vapor measurements are only possible under non-precipitating conditions and below clouds. Because of the solar radiation interference, the daytime profiling capability is limited; for most systems this maximum daytime altitude for the water vapor mixing ratio profile is about 4-6 km. These laser systems require temperature controlled housing for optimal operation. Other protective designs from rain and/or hail need to be installed to safeguard the telescope and associated electronics. The incomplete overlap of the laser beam and the receiver telescope field of view limits the first usable range to some 100 meters, depending on the lidar design properties.

DIAL: The Differential Absorption Lidar (DIAL) is a powerful technique to measure water vapor profiles without the need of a external calibration source. In fact, water vapor profiles are retrieved by measuring the differential absorption in the backscatter signals at two close wavelengths: a water vapor DIAL transmit laser pulses at two wavelengths, one on a water vapor absorption line and the other outside the absorption line. The two wavelengths are chosen close enough to consider the scattering by molecules and particles essentially equal at the two wavelengths. Therefore, any difference in the lidar backscatter can be entirely attributed to water vapor absorption. The ratio of the backscatter measured at both wavelengths as a function of range can be directly linked to the profile of water vapor concentration. Ground based DIAL systems have been demonstrated recently for quasi-operational observations. Performances: High-power DIAL systems demonstrated the highest accuracy and resolution of all water-vapor remote sensing technologies yet. The accuracy is mainly determined by laboratory measurements of the water-vapor absorption cross section in the wavelength range of interest. Advantages: Obviously, no calibration of the DIAL system is required. The combination of spatial and temporal resolution up to the upper troposphere (few 100 m and min) fulfills the requirements for data assimilation in mesoscale models during daytime and nighttime. Low-power compact DIAL systems are interesting and affordable options for future water vapor remote sensing networks. Limitations: DIAL systems are affected by the overlap issue (same as the Raman lidar above) in the first some 100 meters. Current instruments are quasi-operational. High-power DIAL systems are expensive and typically require significant scientific technical expertise. Work is ongoing to improve low power DIAL systems to enable daytime operation in regions of high water vapor. Water vapor profiling DIAL systems are not commercially available yet.

GNSS Tomography: Remote sensing of the atmosphere with the microwave signal of the Global Navigation Satellite Systems (GNSS) has become a well-established field of research. The primary use of these signals is the positioning of receiving antennas on or within several 100 kilometers around the earth. The waves passing the atmosphere are affected by the ion concentration in the ionosphere and by the air density in the lower stratosphere and in the troposphere. These influences can be retrieved to a certain degree in the processing of the GNSS data with sophisticated software packages, yielding for example an integral measure of the water vapor content above a GNSS station. With a receiver network, the integral measure can be used to reconstruct a 3D field of wet refractivity, which depends on both atmospheric temperature and humidity (water vapor pressure). The spatial resolution of such a field depends on the number of stations that are deployed. In regions with complex orography, where the terrain allows stations to be placed at various heights above mean sea level, it is possible to retrieve vertical information on the wet refractivity field in the available vertical range and at a very limited resolution above the top station of the network (Champollion et al., 2005; Perler et al., 2011). The International Association of Geodesy has set up a Sub-Commission on Remote sensing and modeling of the atmosphere with the objectives, among others, to investigate the development and enhancement of the GNSS-based sounding techniques, e.g. neutral atmosphere/ionosphere tomography, GNSS reflectometry/scatterometry for altimetry, meteorology, and soil moisture. The new GNSS signals’ structures for GNSS based atmospheric remote sensing are also studied and additional platforms for GNSS based atmospheric remote sensing (buoys, aircrafts, balloons, more dense ground networks, Low Earth Orbiting constellations) are suggested.

Performances: The capability of the tomography to investigate the diurnal cycle of water vapor in a coastal area was shown by (Bastin et al., 2007). (Bender et al., 2011) demonstrate that near real-time processing of a large GNSS station network in Germany with dedicated tomography software is possible and show a qualitative comparison to a NWP model analysis. Another study assesses the uncertainty of the tomographic reconstruction for the wet refractivity at Payerne for a one year study period to be 10 mm km-1 at the ground and 6 mm km-1 at 4500 above m.s.l. (Perler, 2011). (Nilsson et al., 2007) arrives at 4-5 mm km-1 absolute difference to a radiosonde reference and an accuracy of 10% most of the time for the refractivity in the lower 2km of the troposphere. Recent investigations combining wet refractivities from GNSS with temperature profiles of V-band radiometers to derive humidity profiles (Hurter and Maier, 2012) show temporal resolution and a quality comparable to remote sensing with a K-band microwave radiometer, with a vertical resolution being representative of meteorological events in the boundary layer. Advantages: Rather simple deployment of passive, stable all-weather instruments, high data availability, financing being shared with other applications (GNSS reference networks for positioning) and low maintenance make GNSS an attractive source of information for the spatial distribution of water vapor in mountainous topography. Furthermore, its spatial and temporal resolution is somewhat in between the other available water vapor measurement techniques and could bridge the sampling gap between those techniques. Limitations: Derivation of humidity from GNSS requires an accurate 3D field of atmospheric temperature. Therefore, tomography retrievals are currently not judged as the best way to insert information about humidity into NWP models. Instead the integration of humidity information from GNSS data in NWP models might be more successful with the assimilation of path delays, which could be accomplished with a statistical data assimilation scheme (such as 3DVAR, 4DVAR or ensemble kalman filter) in a mathematically thorough way and using information on model and observation uncertainty. Results from assimilation tests using GPS derived slant water vapor are for example given in (de Haan and van der Marel, 2008). The forward operator to be implemented into a NWP model corresponds to the operator used in the water vapor tomography. Experience gained therein can thus help to assimilate path delays.

MWR: Water vapour has distinct spectral features at 22.235 and 183 GHz. Dual channel ground-based MWR make use of the rotational line at 22.235 GHz to derive the vertically integrated water vapour (IWV). The two-channel combination is thus able to retrieve simultaneously IWV and the liquid water path (LWP). Water vapour profiles are derived from microwave profilers that measure the atmospheric emission at several frequencies along the wings of pressure-broadened rotational lines. From the ground the 22.235 GHz line is usually used whereas at low humidity conditions the strong 183 GHz water vapour line is more suitable (Cimini et al., 2010). Microwave radiometers have been run operationally for multiple years in a wide range of different environments, from the tropics (+40°C) to the Arctic (-35°C). MWR technology has matured so far that more than a hundred systems operate continuously worldwide. Performances: Specifications of the accuracy vary between 0.3 and 1 kg/m2 for IWV and 20 to 30 g/m2 for LWP. Improvements in accuracy can be made by using additional frequencies with higher sensitivity to liquid water (i.e. 90 GHz) to further constrain the retrieval problem (Crewell and Löhnert, 2003). Typical root-mean-square difference with respect to radiosonde are 0.7-1.5 g/m3 up in the first 5 km, depending upon IWV, and decreasing with water vapor content above that (Fig.3.2.2). With a pressure broadening of about 3 MHz/hPa tropospheric profiling can be realized with several channels spaced by a few GHz along the line. However, the vertical resolution of water vapour profiles is relatively low, with approximately 1 to 3 DFS (Fig.3.2.1), as shown in Löhnert et al. (2009). Advantages: Microwave radiometers can provide unattended measurements of water vapor at high temporal resolution (<30s) during all weather conditions except during precipitation. They are passive instruments requiring no transmitted power. Day- and night-time operation are equivalent performances. Hardware components are rather reliable over several years. Unlike for temperature profiling, elevation scanning is not beneficial for water vapor retrievals, but azimuth scans are useful to characterize site representativeness in terms of humidity and cloud variability (Kneifel et al., 2009), and to estimate water vapor gradients (Schween et al., 2011), though reducing zenith observation time. Sometimes microwave IWV measurements from the ground are used to scale radiosonde or water vapor lidar measurements. The combination of few scanning radiometers is also proposed for tomography of water vapor (Padmanabhan et al., 2009) and cloud liquid (Huang et al., 2008). Limitations: The number of degrees of freedom in the microwave retrieval is low (generally <2 independent pieces of information, Fig. 3.2.1), and thus the vertical resolution of humidity retrievals. The absolute calibration of MWR still poses some challenges. Tipping curve calibrations (Han and Westwater, 2000) require homogeneous conditions which may be difficult to find in practice. Cryogenic liquid nitrogen (LN2) calibrations suffer from uncertain knowledge of the liquid nitrogen refractivity and practical issues over handling, transportation, and operator safety. Due to the increased use of wireless communication, Radio Frequency Interference (RFI) may appear even at protected frequencies, e.g., 24 GHz. The main practical limitation to these microwave radiometer observations is the need to keep liquid water off of the radome, as this could contaminate the atmospheric retrievals. Operational MWRs are equipped with rain and dew mitigation techniques, typically hygroscopic windows, blowers, and heaters. Radiometer periphery is likely to be subject of damage. Inspection by eye and cleaning of external components, i.e., radome and infrared gold mirror, is recommended every couple of months. The quality of the radome can be affected by birds, UV radiation, etc., requiring replacement roughly every year.

[edit] 3.2.3 Retrieval algorithms and errors

Humidity profiling by MicroWave Radiometers (MWR) relies on the passive measurement of thermal emission by atmospheric water vapor. The water vapor absorption line at 22.235 GHz is mostly used, though the higher sensitive 183.3 GHz line is also used in dry environments. A clear advantage of using passive microwave measurements with respect to the other techniques is that humidity profiles can be retrieved also in cloudy conditions, as the emission of ice clouds is negligible and the contribution of liquid water clouds can be effectively accounted for. From the ground, observations are typically taken in zenith direction at about five to ten frequency channels from 20–30 GHz. Channels closer to the line center correspond to higher absorption (i.e. higher brightness temperature). The atmospheric opacity at these channels is relatively low ( $\sim 0.1$ , see a typical 10-100 GHz opacity spectrum) and thus the radiation comes from throughout the atmosphere and beyond. Consequently, the weighting functions at the different frequencies are quite constant with height and do not change shape significantly with elevation angle. Therefore, water vapor retrievals from MWR are characterized by low vertical resolution; approximately 1 to 3 DFS are available, slightly depending on water content and almost independently on elevation angle (see Fig.3.2.1), as shown in Löhnert et al. (2009). However, combined multi-channel and multi-angle observations are often used to better constrain the retrieval problem and improve tha accuracy (Crewell and Löhnert, 2007). In Tab.3.2.2 reports a summary of the quantitative retrieval accuracies and typical values for vertical resolution for microwave humidity profiling.

Table 3.2.2: MWR characterization for humidity profiling
Temporal resolution	Height range	Independent pieces of information	Vertical resolution	Accuracy
5-15 minutes	up to 10 km	~1-3 depending upon total water vapor content	incresing with height from 0.5 to 3 km in the troposphere (defined as the inter-level covariance)	0.5-1.5 g/m3 in lowest km <0.5 g/m3 above 2 km

MWR water vapor retrievals are usually validated against radiosonde measurements. Statistics (mean and rms) of the difference between MWR retrievals and radiosonde measurements are used to quantify the accuracy of MWR retrievals, though these include the radiosonde representativeness error as well. Typical results are shown in Fig. 3.2.4 for a 1-year dataset collected in Lindenberg during clear and cloudy situations. Typical rms are within 1 g/m3 in the first 2 km and less than 0.5 above that. Rms difference slightly decrease when the sistematic difference is removed a posteriori.

Figure 3.2.4: Statistics of humidity profile differences (mean and rms) during all-sky conditions from September 2004-August 2005 between MWR and radiosonde measurements at the DWD Meteorological Observatory in Lindenberg, Germany. The retrieval results using a Neural Network (NN) retrieval approach are shown in blue (solid: mean; dashed: std). The results for a "a-posteriori" regression are shown in red (solid: mean; dashed: std), demonstrating the potential after the bias removal. The black line show the std (i.e. the variability) of the whole set of radiosonde water vapor profiles. A total number of 1171 matching MWR/radiosonde cases have been considered in the plot. Courtesy of J. Güldner, DWD.

[edit] 3.2.4 Operational performance and technical implementation

Nowadays, off-the-shelf commercial microwave radiometers are robust and unattended instruments providing real time accurate atmospheric observations under nearly all-weather conditions. Accurate MWR observations are subject to instrument integrity and proper signal calibration. Commercial MWR consists in robust hardware exhibiting long life-time (years) even in extreme conditions. However, the radome protecting the antenna aperture must be kept clean, requiring services every once in a while and replacement every few months depending upon environment conditions (presence of dirt, sand, dust, etcetera). To ensure proper calibration, commercial MWR use internal noise diodes and a combination of cryogenic external targets and tipping curve. These last two calibration methods are well know and characterized, although are sometimes impractical. In fact, the tipping curve can be applied to low-absorption channels only (as it assumes a linear relationship between atmospheric absorption and the observed air mass), requiring clear sky and horizontally stratified atmosphere. The method using a cryogenic external target requires an high emissivity target in a cryogenic bath; the cryogenic liquid (often liquid nitrogen, LN2) is not always easily available and it poses some safety issues for handling it. However, the current MWR technology is such that receivers are stable over long periods (months), thus tipping curve and cryogenic calibrations are recommended only few times a year. For avoiding long periods of miscalibration, an operational protocol (including severe quality criteria and a testing period) shall be adopted before accepting the calibration coefficient updates. Operational MWR measurements need to be monitored routinely during clear sky conditions using simple non-scattering radiative transfer models as reference for calibration stability. Such monitoring is necessary to identify the presence of possible measurement bias, which can be subsequently removed for providing an the best humidity profile product. Advantages, challenges and limitations of humidity profiling with MWR are summarised in Table 3.2.3.

Table 3.2.3: Advantages, challenges and limitations of MWR humidity profiling
Advantages	Challenges	Limitations
24/7 continuous unattended measurements on the order of minutes Meaningful retrievals in clear and cloudy-sky Capable of azimuth- and elevation-angle scanning Network suitable, remotely steerable MWRnet as an emerging international network	Automated integrity and quality control of radome Calibration control Radio frequency interference Harmonized data processing: from raw data to quality-controlled humidity profiles (MWRnet goal)	Low vertical resolution Larger errors in heavy cloud and precipitation conditions

The performances of humidity profiling by MWR are within the WMO User Requirements for climate and NWP in terms of uncertainty (threshold), observing cycle (goal), and vertical resolution in the lower levels (threshold). Concerning the horizontal resolution, this is currently limited by the density of operational ground-based MWR, which is steadily increasing. For example, nowadays in Europe the number of ground-based MWR is larger than the number of operational radiosonde launch sites.

Within EG-CLIMET, a cooperation and coordination effort was initiated under the name of (MWRnet), an International Network of Microwave Radiometers. MWRnet links the international MWR experts and users community to share knowledge and best practices on the aspects of harmonization of measurement modes, data formats, meteorological parameter retrieval, operation modes, etc. The successful achievement of the MWRnet goals, specially the standardization of operation procedures and retrieval methods, shall make the performances of MWR humidity profiling more appealing to the WMO User Requirements for climate and NWP.

[edit] 3.2.5 Summary and recommendations

Recommendations similar to as for temperature profiling (see section 3.1) apply for humidity profiles. Due to the suitability for 24/7 nearly all-weather operational measurements and widespread European distribution, microwave profilers have been chosen within EG-CLIMET as the most effective and network-ready instrumentation for humidity profiling, fulfilling potentially most (but not all) of the WMO User Requirements. In fact, limited vertical resolution and corresponding smoothing error are inherent in the passive measurement principle. Note that most microwave profilers are also capable of providing temperature profiles and cloud liquid water path (see sections 3.1 and 3.7) and thus provide additional information on atmospheric stability, continuously within consecutive radiosondes launched typically at 12 hourly intervals. Within EG-CLIMET, MWRnet has been established as a prototype of an international microwave radiometer network setting up common calibration and operation procedures to guarantee continuous, harmonized and quality-controlled observations and retrieved profiles, with uncertainties. In order to prove the value of MWR measurements for NWP and climate studies, EG-CLIMET recommends the following:

Further consolidation of MWRnet to be able to provide near-real-time, quality controlled humidity (and temperature) profiles on an openly available platform in the near future.

Consideration of microwave radiometers within the EUMETNET E-PROFILE project, as a powerful tool for providing high temporal resolution IWV, LWP, and temperature and humidity profiles.

Evaluation of observations impact by means of Observation System Simulation Experiments (OSSE) in collaboration with national weather services (see discussion in the temperature profile summary and recommendations section).

Large and coordinated international experiments (e.g. LAUNCH, COPS, HyMeX), should be exploited to carry out Observation System Experiment (OSE) to characterize MWR data impact into the analysis and forecast. For example, using ground-based water vapor lidar observations during the LAUNCH 2005 measurement campaign, Grzeschik et al. (2008) showed a downstream impact on forecasted humidity within a four-hour time window after assimilation. Similar impact studies are ongoing within MWRnet in cooperation with the HyMeX project.

[edit] 3.3 Wind profile

[edit] 3.3.1 Fundamentals

The wind vector field (u,v,w) as a function of altitude above some point (x₀,y₀) on the surface having an altitude z₀ is commonly referred to as the wind profile above that site. Conventionally, it is measured via radio sounding, whereas another approach to this is to use a remote sensing method. Depending on the wavelength of the radiation used, the scattering targets of interest are aerosols (in case of an IR heterodyne Doppler Lidar), air molecules (for an UV Doppler Lidar for observations in clear air, i.e. aerosol free), precipitation (for weather radar), or Bragg Scattering on refractive index variations due to turbulence eddies(for a radar wind profiler). If the respective tracer is moving with the velocity of the surrounding air, the backscattered signal will be shifted in frequency due to the Doppler effect. If this frequency shift is measured, the component of the velocity in the direction of the beam, the radial velocity V_r, is obtained. Using such a methodology, one gets the whole wind profile instantaneously, i.e. not one point at a time like in a radiosonde descent, and with a high update rate.

Considering the relationship of the radial component of the wind V_r in the direction of observation

$V_r=u \cdot\sin\theta\cos\phi+v\cdot\cos\theta\cos\phi+w\cdot\sin\phi$ Eq. 1

with the radar or lidar beam having an elevation angle $\phi$ and an azimuth angle $\theta$ (see figure 3.3.1) , three different directions of observation that are not coplanar are the minimum necessary to determine all three wind components.

Figure 3.3.1: Sketch of volume scan strategy showing the polar coordinate system being the basis for Eq. 1

[edit] 3.3.2 Retrieval Algorithms and Errors

A scan strategy widely used by radar wind profilers and vertically pointing Doppler lidars is the Doppler Beam Swinging Technique (DBS), using for example four orthogonal azimuth directions at some elevation close to the vertical and a fifth measurement for the vertical itself. Another technique in this vein has been proposed by Lhermitte and Atlas for precipitation Doppler radars, but of course also applicable to every other dopplerized remote sensing technique, makes use of a full circle scan in azimuth (R.M. Lhermitte, D.A. Atlas, 1961; R.M. Lhermitte 1962). The technique is called Velocity Azimuth Display (VAD), since in the days when fast personal computers were not ubiquitous the horizontal wind and the particle fall velocity were extracted from the actual display of the range gated Doppler shift over azimuth (as an example see figure 3.3.2).

Figure 3.3.2: Example of a Velocity Azimuth Display, the corresponding radial wind field is shown in the small box

Although the trained observer may be able to extract also characteristics of inhomogeneous wind fields, the general approach would be to fit the parameters u, v and w (w being dominated by the fall velocity of rain drops in the case of weather radar) to Eq.1.

A refined version of the VAD analysis has been proposed by Browning and Wexler (K.A. Browning and R. Wexler, 1968) using more terms of a general Fourier expansion of the VAD graph.

$V_r=\frac{1}{2}a_0+\sum_{n=1}^\infty a_n\sin n\theta+b_n\cos n\theta$ Eq. 2

Assuming homogeneous fall speed of rain drops over the area of the VAD circle (or equivalently constant vertical velocity w), the following parameters can be expressed by the first Fourier coefficients (R: radius of the VAD circle). Note that Browning and Wexler used the normal mathematical definition of angles, not the meteorological, and therefore Eq. 5 differs slightly from their publication in that a₁ and b₁ are interchanged.

Horizontal divergence: $div(v_H)=\frac{a_0}{R\cos\phi}-\frac{2w}{r}$ Eq. 3

Horizontal wind speed: $|v_H|=\frac{\sqrt{a_1^2+b_1^2}}{\cos\phi}$ Eq. 4

Wind Direction: $\beta=\begin{cases}\frac{\pi}{2}-\arctan\frac{b_1}{a_1},a_1<0 \\ \frac{3\pi}{2}-\arctan\frac{b_1}{a_1},a_1>0\end{cases}$ Eq. 5

Resultant deformation: $def_r(v_H)=-2\frac{\sqrt{a_2^2+b_2^2}}{R\cos\phi}$ Eq. 6

Combining the concept of a linear wind field ( $\vec{V}$ : 3D wind vector, $\hat{J_v}$ : Jacobian matrix)

$\vec{V}=\vec{V_0}+\hat{J_v}\cdot(\vec{r}-\vec{r_0})$ Eq. 7

with a full volume scan, Waldteufel and Corbin suggested in 1979 the Volume Velocity Processing (VVP) Method (P. Waldteufel, H. Corbin, 1979) . When Eq. 8 is transformed to polar coordinates (r: Range) and inserted into Eq. 1 setting x₀ = y₀ = 0 it follows:

$\begin{align}V_r=u_0\cdot\sin\theta\cos\phi+v_0\cdot\cos\theta\cos\phi+w_0\cdot\sin\phi\end{align}$ Eq. 8

$\begin{align}+r\sin^2\theta\cos^2\phi\cdot u'_x \\ +r\cos^2\theta\cos^2\phi\cdot v'_y \\ +r\cos\theta\sin\theta\cos^2\phi\cdot (u'_y+v'_x) \\ +\sin\phi(r\sin\phi-z_0)\cdot w'_z \\ +\sin\theta\cos\phi(r\sin\phi-z_0)\cdot (u'_z+w'_x) \\ +\cos\theta\cos\phi(r\sin\phi-z_0)\cdot (v'_z+w'_y)\end{align}$

Thus, there are a maximum of nine parameters that can be obtained by fitting Eq. 8 to the volume velocity data for each altitude gate. As an example for one of these parameters, a plot of a vertical profile of the horizontal wind is shown in figure 3.3.3. Particularly for the horizontal wind, it is also common to plot wind barbs for each altitude gate. This can be conviently displayed as a time series (figure 3.3.4).

Figure 3.3.3: Profile of horizontal wind, similar plots could be shown for other paramters extracted from a volume scan by fittinbg Eq. 8 to it.

Figure 3.3.4: Time series of wind barbs as a function of altitude (time: abscissa, altitude: ordinate). This plot has the advantage that the direction of the horizontal wind can be displayed as well.

It is worthwhile noting that horizontal vorticity η (the vertical component of the curl of the velocity field, Eq. 9) cannot be extracted, since u'_y and v'_x only appear summed together.

$\eta=(\vec{\nabla}\times\vec{V})\cdot \vec{k} = {\partial v\over\partial x}-{\partial u\over\partial y}$ , $\vec{k}$ : unit vector in z-direction. Eq. 9

Since the assumption of a linear variation of the wind field is most likely to hold if the weather situation is stratified, it seems also sensible to set w'_x and w'_y to zero. Thus, profiles of the following meaningful properties can be obtained by the VVP method in addition to the wind profile: Divergence, vertical shear and Deformation. With regard to sensor synergies, temperature advection as a derived property might be of interest as well. Assuming pure geostrophic wind vg, i.e. the flow of air is devoid of any friction with the surface, gives rise for the following expression (see e.g. Holton 1992)

${\partial v_g\over\partial \ln p}=-\frac{R}{f}\vec{k}\cdot\vec{\nabla}_{H,p}T$ Eq. 10

where T is the thermodynamic temperature, R the gas constant, f the Coriolis factor, and $\vec{\nabla}_{H,p}$ the horizontal Nabla Operator on isobaric surfaces. Using the ideal gas law, the following relation for the temperature advection holds (Rainbow® 5 instruction manual):

$\vec{V}\cdot\vec{\nabla}T=\frac{T\cdot f}{g}(u{\partial v\over\partial z}-v{\partial u\over\partial z})$ Eq. 11

However, if derivatives of the wind field are to be extracted in addition to the horizontal wind using VVP, one has to be aware that the corresponding matrix used in the fit is generally prone to be ill-conditioned, i.e. the solution varies too strongly with a variation of the arguments with respect to round-off errors due to the finite precision of floating point numbers, or, stated more formally, the condition number C given by the ratio of the largest and the smallest singular value of the matrix X^TX encountered in the least square fit procedure is too large, meaning roughly that log₁₀(C) is greater than the machine size precision (for more information see e.g. Wolfram Mathworld). For this reason, Nan et al. have suggested an algorithm called SVVP (S for “stepped”) to overcome this problem (Nan et al., 2007).

[edit] 3.3.3 Operational performance and technical implementation

The methods presented here are not only different analysis methods, but also imply different scan strategies. Therefore, a trade-off has to be made in order to reconcile update rate, accuracy, representativeness and the possibility to obtain additional information about the nature of the wind field. For weather radars, wind profile quality has been compared by Holleman (Holleman, 2005) for different versions of VAD and the VVP methods. He used two different VAD methods (VAD1: Fourier expansion terminated after the third term, VAD2: Fourier expansion terminated after fifth term) and three different VVP methods with three, six and all nine parameters (VVP1: only wind profile (u₀,v₀,w₀); VVP2: divergence, stretching deformation and shearing deformation in addition to wind profile; VVP3: all parameters from VVP2 along with the vertical derivatives). In fact, only wind profiles obtained from VAD1 have been used for comparison with VVP1 and VVP2, since the single parameters have no effect on each other in value and magnitude of error due to the orthogonality of the basis functions of the expansion and the evenly spaced azimuthal intervals. This is of course not the case for the VVP methods. It must be noted, that the VAD data are not obtained from one azimuth circle, but from the same volume data as the VVP products. The difference is only that in the case of VAD the least square fit has been applied to all azimuth circles individually, whereas for the VVP product the volume data have been subjected to the fit at once. Therefore, the effect of using more data for the VVP than for the VAD is eliminated. During the study data from the KNMI C-band Doppler Weather Radar in DeBilt (Meteor AC360), Radiosonde launches in DeBilt and data from the HIRLAM model (Unden et al. 2002) have been compared for nine months. Products have been generated using the Rainbow® 5 software. The conclusion is that the VVP method is superior to VAD in general. Furthermore, the VVP1 method provides the best horizontal wind values which is attributed to noise fitting due to the non-orthogonality of the basis functions of the fit for VVP2 and VVP3 (and therefore linear dependencies between them). The VVP1 minus background statistics have been found to be at least as good as those of the radiosonde profiles.

[edit] 3.3.4 Summary and recommendations

Original Contributions Made by EG-CLIMET Action

Bird echo filter A Gabor filter has been incorporated in the standard wind profiler software to remove the intermittent echoes due to bird migration. Courtesy, V. Lehmann (DWD).
Spectral filtering Correction of false wind retrievals due to clutter, radio frequency interference and rain events using improved spectral processing which has now been incorporated in the standard wind profiler software. Spurious wind retrievals from the profiler at South Uist on 2 June 2011 are identified by the red boxes. Courtesy, R. Leinweber (DWD) / C. Gaffard (MetOffice).
Impact for NWP It has been demonstrated that strategically placed wind profilers (WP) have a greater impact than radio sondes (RS) in reducing errors in the forecast in the UK (upper) and Germany (lower). The errors are expressed in terms of total dry energy. The analysis used the FSO (Forecast Sensitivity to Observations) technique (Cardinali, 2009) which can identify the contribution to the reduction in the forecast error of specific observations when assimilated into the model. Courtesy, R. Leinweber (DWD) / C. Gaffard (MetOffice).

Future prospects:

Following EG-CLIMET presentations to EUCOS, the body responsible for the European observing system, E-PROFILE has been launched which will run from 2013-2017 with a kick-off meeting in April-May 2014. E-PROFILE will be responsible for Wind Profiler data quality and for coordinating real time exchange of backscatter profiles from lidars and ceilometers.

The FSO work above has established that Wind Profilers can have a positive effect in improving weather forecasts but only for those instruments where rigorous data quality control procedures have been implemented. FSO has the advantage that it can identify which profilers are performing well and those which are not, and also the advantage of siting wind profilers in data sparse location. E-PROFILE will take this work further.

[edit] 3.4 Aerosol Backscatter and Extinction profile

The transmission of the atmosphere is highly dependent upon the wavelength of the spectral radiation, and upon the composition and speciﬁc optical properties of the constituents in the atmosphere. The prominent spectral features in the atmosphere's transmission spectrum are primarily due to absorption bands and individual absorption lines of the molecular gases in the atmosphere, while a portion of the slowly varying background transmission is due to aerosols.

Recent estimations on the possible impact of aerosols on the radiative forcing (assumed cooling effect) in a global average are of the same order of magnitude as the CO2 effect (warming effect). A full understanding of the role of aerosols is important for improving weather forecasting and understanding climate change. They scatter and absorb both incoming and outgoing radiation (direct effect), and influence cloud formation, their microphysical properties and lifetime (indirect effect). The amount of radiation that is scattered and the directions of scatter, as well as the amount of radiation absorbed, varies with aerosol composition, size, and shape. Thus, the measurements of aerosol optical properties (aerosol backscatter and extinction coefficients at various wavelengths) contribute to the quantification of the radiative forcing, but also to the estimation of particle's physical properties, by inversion of the spectral optical data.

The backscatter coefficient is a measure of the fraction of incident radiation that is scattered directly back toward the source.
The extinction coefficient is a measure of attenuation of the light passing through the atmosphere due to the scattering and absorption by atmospheric components (aerosols, molecules). The extinction coefficient is the sum of the absorption coefficient and the scattering coefficient, and generally depends on wavelength and temperature.

Applications: Atmospheric correction for satellite imagery; air quality; health and environment; monitoring of volcanic eruptions and forest fire; Earth radiation budget; radiative transfer models; climate change; aviation safety; visibility.

[edit] 3.4.1 User requirements and benefits

User requirements and benefits of measuring the backscatter and the extinction coefficient, especially using ground-based remote sensing techniques are described in the WMO's document " Transitioning to operations: lidars and ceilometers" (W. Thomas, DWD, June 2012). Conform to this document: "Atmospheric profiling from ground-based remote sensing instruments has reached a level of maturity making it possible to gather routinely information about the atmospheric state. Recent improvements of data assimilation techniques pave the way for ingesting profile data into models for numerical weather prediction, thus supporting and fostering the operational use of such instruments and measurements. Further applications are long-term monitoring thus climate research at global and regional level and observations of long-range transport phenomena. Current networks are however heterogeneous with respect to the spatial density of instruments, remote sensing capabilities of instruments and products. Consequently, first steps have recently been undertaken to harmonize data and products and to close the gap between research-oriented operations and application-oriented operations."

User requirements refer to data accuracy and data availability. From this point of view, lidars are providing the best accuracy (relative error better than 10%) while lacking continuous operation. On the contrary, ceilometers are all-weather continuous operation instruments, but are lacking the accuracy in retrieving (especially) the extinction profile. Intermediate lidar products are now available with Nitrogen Raman detection capability and have shown a good data availability with a low maintenance thanks to the use of diode-pump lasers. According to Heese et al. (2010), a combination of different instrument types seems feasible as well as appropriate for a prototype aerosol profiling (backscatter and extinction profiles, plus subsequent parameters) near-real-time system that bridges between research-based and operational aerosol observations. The retrieval of first backscatter profiles and secondly extinction profiles (and further mass extinction coefficients) from routine ceilometer measurements is in principal possible, provided that additional measurements are available (sun photometer, advanced Lidars) and that the instrument was calibrated. Note that the conversion of ceilometer data into backscatter and extinction coefficients is associated with large error bars and limited to 4-5 km in daytime conditions. This method is described in Flentje et al. (2010). Elastic backscatter lidars equipped with nitrogen Raman channels are another way to retrieve backscatter and extinction coefficients profiles independently and without assumptions on particle type. As operational lidar products are now available with nitrogen Raman detection capability, these instruments offer an accurate way to self-calibrate the optical extinction profile without any coupling to other sensors. With respect to hazardous aerosol layers (after volcanic outbreaks, dust storms, forest fires) and thanks to continuous monitoring such network may also act as a warning and tracking system of atmospheric particles.

[edit] 3.4.2 Available techniques

There are several techniques to measure the backscatter coefficient and the extinction coefficient (or at least its integral over a measurement path).

Figure 3.4.1: Multiwavelength Raman lidar operating at the National Institute of R&D for Optoelectronics, Romania

Scattering instruments are used to measure a basic optical property of the air sample: the volume scattering function. Scattering instruments include integrating nephelometers, backscatter meters, forwardscatter meters, and polar nephelometers. Integrating nephelometers perform a point measurement of the light scattered over a range of angles and permit determination of the scattering component of extinction. The air sampled by the integrating nephelometer is enclosed and illuminated indirectly by an artificial light source, allowing automated continuous day and night operation. Nephelometers have been used in a variety of applications (Charlson et al., 1978). Since nephelometers involve point measurements, care must be taken to minimize the influence from local sources. Also, inhomogeneous impairment, such as plume blight, cannot be detected.

Photometers measure light intensity using a photodetector, which converts brightness into representative electric signals. By the use of combinations of lenses and filters, different optical properties may be determined. Sun photometers are photometers pointing at the Sun. Recent sun photometers are automated instruments incorporating a Sun-tracking unit, an appropriate optical system, a spectrally filtering device, a photodetector, and a data acquisition system. These instruments measure the solar radiance after the absorption / scattering from the atmosphere, at several wavelengths. The integral of the extinction coefficient (AOD), as well as other column optical and microphysical parameters can be extracted from multiwavelength sun photometer data.

Transmissometers are instruments which measure the amount of light transmitted from a specified source (artificial) to a receiver, allowing the direct calculation of the average extinction coefficient of the air along the instrument path. When transmissometers are used in very clean atmospheres, their critical sensitivity to atmospheric turbulence can introduce error. Additionally, these instruments are usually limited to a single wavelength and not very portable.

Lidar provides a method of directly measuring the optical properties of atmospheric aerosol distributions, as well as of other atmospheric parameters or components (molecules and fluorescent species, wind velocity and direction, temperature and water vapor) as profiles. Lidar makes use of a laser to excite backscattering in the atmosphere. This backscattered signal is observed using a telescope receiver, which collects the light and send it to the receiver optics. The role of the optical chain is to select specific wavelengths, split between them and direct them to photodetectors, which further convert the optical signal into electrical signals. These are recorded as a function of time by analog-to-digital converters and/or photon counting devices. Each lidar signal represents, therefore, the spatial variation of the measured parameter, i.e. the vertical, slant or horizontal profile of the variable.

Interaction of the laser beam with the atmosphere is complex. Multiple phenomena are produced simultaneously, both elastic (i.e. at the same wavelength: Mie and Rayleigh scattering) and inelastic (i.e. at a different wavelength: vibrational and rotational Raman, fluorescence). Thereby, the set-up of the lidar is application-driven. The backscatter coefficient can be measured using simple elastic backscatter lidars and several types of ceilometers, although some assumptions has to be made (see the "Retrieval algorithms and errors" sub-section). For the measurement of the extinction coefficient, inelastic (vibrational or rotational) Raman detection is generally used. The combination of the two gives independent estimation of both parameters. High Spectral Resolution Lidars take advantage of the spectral distribution of the lidar return signal to discriminate aerosol and molecular signals and thereby measure aerosol extinction and backscatter independently. Multi-wavelength detection is also recommended in order to extract supplementary information (e.g. intensive optical parameters such as Angstrom exponent, color indexes and color ratios, or microphysical properties such as size distribution, complex refractive index and single scattering albedo.

Table 3.4.1: Advantages and limitations of the various aerosol lidar types
Lidar type	Principle	Retrieved parameters	Limitations
General	Scattering (Mie, Rayleigh, Raman)	Backscatter and / or extinction coefficient	Incomplete overlap (at low range) Signal-to-noise ratio (at far range) Saturation (at high extinction values) Multiple scattering (fog, rain, clouds) Estimation of the atmospheric density
Ceilometers	Mie and Rayleigh elastic scattering	Backscatter coefficient	Assumption on the lidar ratio (backscatter/extinction) Calibration value (backscatter coefficient at far range) Daytime signal-to-noise ratio Combination with othe sensors required for the calibration of backscatter coefficient
Elastic backscatter	Mie and Rayleigh elastic scattering	Backscatter coefficient	Assumption on the lidar ratio (backscatter/extinction) Calibration value (backscatter coefficient at far range)
Elastic backscatter and Raman (vibrational / rotational)	Mie and Rayleigh elastic scattering Raman inelastic scattering	Extinction coefficient Backscatter coefficient	Calibration value (backscatter coefficient at far range) Daytime signal-to-noise ratio
Multi-wavelength Raman	Mie and Rayleigh elastic scattering Raman inelastic scattering	Extinction coefficient Backscatter coefficient Angstrom exponent Size distribution	Calibration value (backscatter coefficient at far range) Daytime signal-to-noise ratio
High Spectral Resolution	Aerosol and molecular (spectral separation) scattering	Extinction coefficient Backscatter coefficient	Temperature stability of the ethalons Accurate estimation of the instrument's function

Lidars provide important advantages in the determination of the backscatter and extinction coefficients: high spatial resolution (1 value each 3 - 60 m), high temporal resolution (1 profile each 1 - 60 min), high dynamic range (0.2 ... 15 km). There are two important types of errors associated to the measurement of the backscatter and extinction coefficients from lidar: a) instrumental errors due to technological limitations (both at components' level and their integration); b) retrieval errors due to the non-determination of the lidar equation (not exhaustive, see Section "Retrieval algorithms and errors"). Nevertheless, the quality assurance program developed by the European Aerosol Research LIdar NETwork EARLINET made possible the estimation of the backscatter and extinction profiles with an uncertainty less than 10%, which is proper for microphysical inversion and climatological studies. The range in which this uncertainty threshold is kept depends on the individual lidar systems (the signal-to-noise ratio of the channels).

[edit] 3.4.3 Retrieval algorithms and errors

Whatever the set-up of the lidar system, the magnitude of the received lidar signal is proportional to the number density of the atmospheric diffusers (molecules or aerosols), their intrinsic properties (i.e. probability of interaction with the electromagnetic radiation at the laser wavelengths, called cross–section value) and with the laser incident energy (Measures, 1992). Therefore, obtaining information about the aerosols means to find solutions of the equation which relates the characteristics of the received and emitted signal, and the propagation medium. The form of the equation depends of the interaction type. The basic lidar equation takes into account all forms of scattering and can be used to calculate the signal strength for all types of lidar, except those that employ coherent detection. The propagation of light in an inhomogeneous medium is well described by the electromagnetic theory.

The detected light backscatter power at the wavelength λD from a distance R can be expressed as follows (Nicolae, 2010):

where RCS is the range corrected signal of the lidar and Cs is the instrument function.

The atmospheric backscatter coefficient is a key element of the lidar equation, and is proportional to the cross section of the involved physical process and to the number density of the atmospheric active diffusers (i.e. atoms, molecules, particles, clouds) in the probed volume.

The atmospheric transmittance from the transmitter to the probed volume and from the probed volume to the receiver, respectively, are expressed as the integrals of the atmospheric extinction coefficient and may be different on the two directions of the laser pulses, as is the case of the Raman backscatter radiation (λD = λR ≠ λL). The atmospheric extinction coefficient, backscatter coefficient and the backscatter cross section refer to all possible physical interactions within the atmosphere.

Both in case of elastic backscatter lidar, and Raman lidar, the solution of the equation is not unique (Kovalev,2004), since it has two unknowns: backscatter and extinction coefficients. Combination of elastic and (vibrational) Raman channels allow to retrieve these parameters with minimum assumptions:

where the “L” and “R” indexes correspond to laser and Raman detected wavelength, respectively, and k ranges between 0 for coarse mode particles (maritime, dusts) and 1.5-2 for fine mode particles (pollution forest fires). This relation is valid if the difference between the Raman and laser wavelength is small. Nitrogen molecules are used to obtain the Raman signal, due to the fact that Nitrogen is considered a gas with constant concentration over time and has a Raman spectra easy to be separated from the Rayleigh one. In this case, the second (532 nm) and third harmonics (355 nm) of Nd:YAG laser can be used as excitation, since the associated Raman lines are close to these wavelengths: 607 nm and 387 nm, respectively. With this hypothesis, the aerosol extinction coefficient at the laser wavelength can be obtained by applying the natural logarithm and the derivative to the Raman lidar equation.

Molecular parameters (indices "m") can be calculated with sufficient accuracy from ground values of pressure and temperature using an atmospheric model, or radiosounding. A simple mathematical procedure applied to the couple elastic + Raman channel leads further to the retrieval of the backscatter coefficient (Mattis, 2002). With different couples of elastic and Raman channels, extinction and backscatter coefficients at several wavelengths can be computed, and therefore more products can be obtained (Müller,1999a): lidar ratios, Angstrom exponents, color ratios and even microphysical parameters such as size distribution, effective radius, complex refractive index, single scattering albedo, volume and number concentration.

Figure 3.4.2: Backscatter, extinction and lidar ratio profiles obtained from multiwavelength Raman lidar (1064, 532 and 355 sounding wavelengths); example

An example of the aerosol backscatter coefficient profiles (1064, 532 and 355 nm) and extinction profiles (532 and 355 nm) is shown in Fig. 3.4.2.

Two kinds of errors are associated to the retrieval of the backscatter and extinction from lidar measurements: statistical errors and systematic errors.

1. Statistical errors are mainly due to the to signal detection, i.e. background of sky and dark current of detector (Theopold and Bösenberg, 1988). Directly related to this kind of error, there is the error introduced by operational procedures such as signal averaging during varying atmospheric extinction and scattering conditions (Ansmann et al., 1992; Bösenberg, 1998). Statistical errors can be assessed either by analytical propagation (Gaussian or Poison statistical distributions have to be considered), either by Monte Carlo techniques.

2. Systematic errors generally arise from:

a) the estimation of temperature and pressure profiles (Ansmann et al., 1992);

b) the estimation of the ozone profiles in the UV (Ansmann et al., 1992) and in other spectral ranges;

c) the wavelength dependence parameter k (Ansmann et al., 1992; Whiteman, 2000);

d) the multiple scattering (Ansmann et al., 1992; Wandinger, 1998; Whiteman, 2000);

e) the overlap function (Wandinger and Ansmann, 2002).

Systematic errors are more difficult to estimate and this is still an open scientific issue.

[edit] 3.4.4 Operational performance and technical implementation

Although lidar technique has been used for many years, recent technological developments, coupled with the implementation of modern mathematical procedures have led to a more operative use of lidar systems. Ceilometers are nowadays more and more complex and sensitive, some new products being able to detect aerosols and therefore to deliver the backscatter coefficient with the coupling of other sensors and with a large error (more than 50%). On the other hand, powerful lidars are more and more automatic and suitable for a 24/7 unmanned operation. Elastic lidars equipped with nitrogen Raman detection channel are intermediate solutions for an accurate self-calibration and an independent retrieval of backscatter and extinction coefficient profiles without any coupling to other sensors. New industrial and operational nitrogen raman lidars based on diode-pump lasers have shown a low maintenance and a high data availability. The main progresses recorded in the last years are referring to the improvement of the instruments and retrieval algorithms for:

1. the automation of the operation

From an operational point of view, alignment of the laser beam into the receiver FOV is critical. Depending on the configuration, the overlap control needs to be very precise (order of 0.01 mrad) and stable with temperature. Short term fluctuations in the laser energy are usually averaged out during the integration time of the measurement. However, long term drift in the laser energy is important if the lidar is to be kept running for longer periods of time. Therefore, laser energy should be at least monitored and eventually stabilized. In case harmonics of the fundamental laser frequency are used, conversion crystals are used (SHG, THG) that alter the direction of the outgoing laser beam when they are tuned. This has to be compensated for in order to keep the overlap properly aligned. If the (generally non-eye safe) lidar is to be kept running for longer periods of time, in particular if the operator is not present from time to time, safety precautions have to be taken according to proper use of lasers outdoors. Remote control of the lidar operation (e.g. via web tools) is an option.

2. the improvement of the dynamic range

Telescopes with large apertures for high troposphere and stratosphere exploration tend to have large focal lengths, which tends to reduce field of view and increase the distance at which field full overlap is reached. To overcome this problem, two receiver sets, using different telescopes (one for far range, another, with smaller aperture, shorter focal length and nearer full overlap distance, for close range), can be used. Other solutions based on specific optical components are also available in order to reduce the overlap and ensure the highest range as possible.

Measurements can also be corrected under the full overlap height if the overlap function of the system has been measured.

Increased dynamic range can be achieved also with combined analog and photoncounting techniques.

3. the improvement of the temporal coverage

Daytime performance of (vibrational) aerosol Raman lidar can be achieved by sufficiently suppressing the daytime background and/or by increasing the emitter power. Narrowing down interference filter passband has consequences for the optical design of the receiver (angular dependence of the position of the passband transmission peak). Other solutions exist, e.g. grating/monochromators, tilt slit diaphragm. The limited acceptance angle of small bandwidth interference filters IFF determines the whole lidar optics design.

Ceilometer detection and inversion capabilities are also limited to the lowest part of the troposphere (up to 4-5 km) in daytime conditions.

4. reducing the uncertainties of the final products

The minimum recommendation for an optimized product is to add a nitrogen Raman channel to a backscatter lidar, so that both the backscatter and the extinction coefficient can be derived independently. The same can be achieved by using a HSRL system and / or a scanning lidar (multiple zenith-angle measurements). This latter technic requires a strong assumption on horizontal and temporal stability of the atmosphere. Moreover their use in operational networks has to be demonstrated. The implementation of state-of-the-art algorithms and tools for the correction of the signal as well as for the inversion of the corrected signal contributes both to reducing the uncertainties and to increasing the availability of the data. This includes:

signal pre-processing: cloud screening, pile-up correction, estimation of the statistical error, background subtraction, range correction, handling of signals measured at angle different from zenith, correction for depolarization-dependent receiver transmission, calculation of the profile of the Rayleigh-scattering coefficient, correction for Rayleigh-transmission, temporal averaging to create fixed time intervals, vertical smoothing up to a fixed height resolution
calculation of the extinction coefficient from the Raman signal: calculation of the derivative, estimation of the uncertainty of the derived extinction, determination of the overlap function
calculation of the backscatter coefficient from combined elastic - Raman signals: detection of the reference height, estimation of the reference value

Significant improvements can be achieved by the automation of the lidar inversion, to avoid human error and operator subjectivity.

[edit] 3.4.5 Summary and recommendations

Although satellite imagery (with its increasing temporal and spatial resolution) and satellite remote sensing will ensure in the future the growing need for knowledge of global optical properties of the atmosphere, accurate estimation of the aerosol backscatter and extinction coefficients, especially near ground and in the first atmospheric layers, can be only provided by ground-based remote sensors. Laser-based techniques have the main advantage of high spatial and temporal resolution. Two solutions can be retained for improving short-term weather forecasts and climate change trends analysis, as well as warning and tracking system of atmospheric particles:

Firstly, a network of operational lidars equipped with depolarization and nitrogen Raman detection channels are the solution for an accurate self-calibration and an independent retrieval of backscatter and extinction coefficient profiles, as well as the ability to classify the aerosols.
Secondly, a network of ceilometers, backed-up by multiwavelength Raman lidars and sun photometers, can be an alternative but where the operational use (24/7) of multi wavelength lidars has not been widely demonstrated and where the real capacity of ceilometers to measure above 5 km is not ensured.

Nevertheless, current networks are however heterogeneous with respect to the spatial density of instruments, remote sensing capabilities of instruments and products.

In this respect EG-CLIMET recommends the following:

1. European and national funding agencies should invest more in the technological development of:

Nitrogen Raman lidars with depolarisation - continuous (i.e. daytime), unattended operation
ceilometers - multiwavelength capabilities, increasing dynamic range, increasing the signal-to-noise ratio
network infrastructure, storage capacity and software development, in order to build up the capacity for enhanced usage of profiling instruments

2. European research (EARLINET/ACTRIS) and operational networks (NMHSs, UK Met. Office, DMI, DWD, FMI, KNMI, Meteo-France, SMHI etc.) should develop an optimized and fully automatically working method for a network of different instruments. They should set up working groups to:

encourage and support the set-up of measurement stations with parallel operations of ceilometers, lidars and sun photometers
harmonize lidar / ceilometer observations and data products/data formats
organize and support intercomparison campaigns for ceilometers and Lidars (involvement of EARLINET[/ACTRIS recommended)
define best practices for ceilometer calibration (self-calibration technique, cross-calibration with Lidars and sun photometers), quality assurance, and long-term operations
define a common data format for data exchange/data storage at scientific level and at operational (national weather services) level, including data policy
take advantage of existing algorithms and implement homogeneous automatic data processing procedures in order to increase the near-real-time capability of the networks
integrate European national ceilometer networks and lidar networks into GAW Aerosol Lidar Observation Network GALION, for global coverage

3. GMES “Atmosphere Core Service” initiatives (e.g. MACC II) together with European lidar and ceilometer networks should push for the use of ground-based remote sensing data for:

validating aerosol parameters of the global integrated (chemistry + dynamics) C-IFS model operated at ECMWF
contributing to regional models at higher spatial resolution
assimilating aerosol profiles into models and validation strategies

4. European lidar and ceilometer networks together with WMO, various expert groups (e.g. EG-CLIMET, CIMO, CBS, WEZARD) and national and international aviation control institutions (e.g. EASA, Eurocontrol, ICAO) should set up working groups to:

support long-term monitoring of aerosol parameters/aerosol profiles
set up tools to make the current instrumental network available to users
organize data exchange procedures and data policy
close the gap between research-oriented operations and application-oriented operations (weather and climate, aviation safety, air quality)

[edit] 3.5 Target classification

[edit] 3.5.1 Introduction

The core instrumentation for clouds and aerosols quality controlled-observations comprises:

Lidar/ceilometer providing profiles of
- attenuated backscatter coefficient from aerosol and cloud
- linear depolarisation ratio
Doppler cloud radar operating at 35 or 94GHz, providing profiles of
- reflectivity, Z,
- mean Doppler velocity, v,
- Doppler spectral width, σ_v,
- standard deviation of the mean Doppler width, σ_vbar
- linear depolarisation ratio, LDR.
Microwave radiometer providing
- brightness temperatures at two or more wavelengths in the range 20-30 GHz
- derived water vapour and liquid water path
Additional observations
- surface rain rate from raingauge
- radiosonde profiles, or NWP model output (temperature, pressure, humidity, winds)

The profile of attenuated backscatter coefficient, from a lidar/ceilometer, exhibits returns from aerosol, ice and liquid. The molecular return may also be present at visible lidar wavelengths. Attenuation by liquid is severe, and the lidar signal does not penetrate liquid layers that are deeper than about 300 m, thus only reliably detecting the cloud base. Penetration through ice clouds can reach 3 km or more. The lidar depolarisation ratio potentially provides information on the shape and type of particles responsible for the lidar return. The cloud radar is sensitive to precipitation, ice, snow, insects and liquid droplets.The cloud radar is much less affected by attenuation and provides profiles of the first three moments of the Doppler spectra; reflectivity, Z; Doppler velocity; and the spread of Doppler velocities. Additionally, the variation of the mean Doppler velocity can also be calculated; this can be used for estimating the turbulent properties of the atmospheric particulate, or highlighting the random motion displayed by an insect. The linear depolarisation ratio, if available, is useful for distinguishing insects from clouds and precipitation within the boundary layer, and for identifying the location of melting ice particles.

[edit] 3.5.2 Input datasets

The essential instruments that must be present are vertically pointing cloud radar and backscatter lidar, together with either regular radiosonde profiles, or hourly model forecast data available over the site. Recommended but non-essential instruments are microwave radiometer (for providing liquid water path) and rain gauge. Processing is done one day at a time. Ideally the instruments operate continuously, but if at any time in the day radar, lidar or model data are missing then there will be a gap in the output product. The absence of data from the non-essential instruments may mean that correction for radar attenuation is not possible, but data quality flags will indicate that this is the case.

The decision regarding which instruments and auxiliary data to include in this product was made by considering those that are most used in retrieval algorithms and those that are necessary to correct for radar attenuation and flag bad data. Radar and lidar are complementary due to their very different dependence on particle size; this means that the combination of the two offers the most accurate estimates of cloud occurrence and cloud fraction (Mace et al. 1998, Hogan et al. 2001), and can also be used to retrieve particle size (Donovan et al. 2001, O’Connor et al. 2004). However, it is not the intention that all instruments at a site that could conceivably be used in a retrieval algorithm (or that might be useful for model comparison, such as broadband fluxes) should be combined into this product; instead, routines for placing other instrument data on the same time-height grid are provided for this task.

The algorithm is implemented in Matlab, although future implementation in C and/or python is possible. The input datasets are read into the processing algorithm using separate functions that may make modifications depending on the particular instrument and site.

[edit] 3.5.3 Cloud radar

The vertically pointing radar would typically operate continuously at 35 or 94 GHz and provides profile with a time resolution of around 10-30 seconds and a height resolution of 30-60 m (better than 100 m). The radar resolution is used as a master grid on to which all other datasets are placed. The temporal resolution of 30 s is long enough that the datasets are conveniently small to use, but short enough that cloud fraction and other parameters to be used to evaluate models are of sufficiently high precision. Essential parameters that the radar must provide are radar reflectivity factor Z and Doppler velocity ν (There are some sites with current and/or legacy data without Doppler velocity; the algorithm may be modified in future to cope without Doppler velocity). Radar reflectivity factor should have had the following processing applied to it:

Linear averaging to the resolution required.
Noise subtraction: the reported Z should be that of the atmospheric targets without the contribution from instrument noise and thermal emission that is present in the raw measurements.
Clear sky clearing: areas with no detectable atmospheric signal should be flagged (or SNR should be available). Any remaining speckle noise should be removed using masking algorithms.
Elimination of artefacts, such as the near field effect for instruments with large antennas, overlap effects for some bistatic systems and spurious instrument-specific echos.

Note: Although definitions and processing may be performed with Z in linear units, it is conventional to report the values in logarithmic dBZ units defined thus:

$Z [dBZ] = 10 \log_{10} Z [mm^6 m^3]$

The quality control algorithm attempts to flag likely ground clutter, but since the clutter behaviour can be very different for different radars it is better if it can be removed prior to being read in. Likewise, it is beneficial but not necessary for insects to have been identified; if available, the LDR parameter is an excellent discriminator. The radar should report values as low as possible above the ground. No attempt should be made to correct for attenuation. The radar should obviously be calibrated as well as possible and an indication of the likely accuracy of the calibration should be available. If necessary the appropriate factor will be applied to Z in order to conform to the following calibration convention, defined for a distribution of Rayleigh-scattering liquid water droplets in the absence of attenuation:

in the absence of attenuation, a cloud at 0 °C containing one million 100 μm (i.e. Rayleigh scattering) droplets per cubic metre will have a reflectivity of 0 dBZ at all frequencies.

If several reflectivity channels are available from a particular site, such as the four specialized modes used by the MMCR radars on the ARM sites (Clothiaux et al. 1999), then the one most free from artefacts will be taken, even if this is not the most sensitive. This is because the Instrument Synergy/Target Categorization product is intended to be used in automated algorithms that operate on large volumes of data without the need for significant human quality control. The Doppler velocity should have had clear sky pixels removed in the same way as Z. If necessary, the values will be inverted to ensure that the convention of positive velocities upwards is adhered to. The velocities need not be unfolded, but the folding velocity νfold should be known to the algorithm. It is possible that the algorithm for locating the melting layer (see section 3.4.1) will perform poorly if the folding velocity is too small. Other radar parameters, such as spectral width ( $\sigma_\nu$ ), will be transferred into the output dataset. If available, the 30-s standard deviation of the 1-s mean velocities, $\overline{\sigma_\nu}$ (used to estimate turbulence levels; Bouniol et al. 2003), will be used to assist in the diagnosis of ground clutter.

[edit] 3.5.4 Cloud lidar

The cloud lidar is principally used to identify the base of liquid water clouds. Most commonly this instrument will be a ultra-violet, visible or near-infrared lidar ceilometer reporting only attenuated backscatter coefficient, β. The instrument should be operated pointing between 2 and 5 degrees from zenith to avoid specular reflection from horizontally aligned pristine crystals, which could be mistaken by the algorithm for the presence of supercooled liquid water (Hogan et al. 2003b). The lidar should be calibrated as well as possible (e.g. using the technique of O’Connor et al. 2004). Units are in m-1 sr-1. Two algorithms are proposed here:

1. The CLOUDNET algorithm assumes that all signals from the lidar are due to atmospheric particulates such as cloud and aerosol, rather than Rayleigh scattering from air molecules. This is generally valid in the near infrared (e.g. 905 nm used by the Vaisala CT25K and CT75K instruments) but for lidars at visible wavelengths (e.g. 532 nm micropulse lidars used by ARM), an additional processing step is necessary to identify and flag the molecular return. Background and solar noise should also be identified and flagged in the pre-processing step.

2. The STRAT algorithm (Morille et al. 2007) performs a target classification based on total attenuated backscatter Lidar data. STRAT identifies in each Lidar profile the following categories: (1) portion of the profile where signal-to-noise ratio is below a given threshold, (2) portion of the profile likely to be particle-free (molecular backscatter), (3) portion of the profile with aerosols or clouds (aerosol/cloud separation is available), (4) portion of the profile corresponding to the mixing layer. A configuration file must be adjusted to help optimize the performance of STRAT. STRAT operates on a single Lidar channel, but can be used for any wavelength (ultra-violet, visible or near-infrared). STRAT is developed under GPL licence and available for download at STRAT software download

Note that lidars with Raman or depolarisation channels are far superior in their discrimination between the various atmospheric particulates; the depolarisation ratio and the extinction are extremely useful parameters for liquid water diagnosis and cloud retrievals, and these are provided in the Instrument Synergy/Target Categorization for instruments in quasi-continual operation.

[edit] 3.5.5 Model parameters

At least four radiosonde profiles per day would be required from close to the site to provide adequate dynamic and thermodynamic data above the instruments. Because most sites do not have this information, we use hourly profiles from short-range model forecasts. These models assimilate the data from the radiosonde network so the temperature (T), pressure (p), humidity (q) and horizontal wind (u and v) will usually be accurate enough for our purposes. We do not make use of the cloud variables as these are to be evaluated, and will generally be much less accurate. Before it can be used the model output must be converted into the Cloudnet single-site model format, which includes calculation of a number of radar propagation and scattering parameters at 35 GHz and 94 GHz that depend on thermodynamic state. The variables T, p, u and v are then interpolated on to the time grid of the radar and provided as part of the Instrument Synergy/Target Categorization product. To conserve space, they are not interpolated in height; subsequent processing algorithms will need to do this. The following additional parameters are ingested and used by the algorithm: specific gas attenuation k_g (dB km-1) (predicted from model q, T and p using the line-by-line model of Liebe 1985), specific gas attenuation for saturation with respect to liquid water k_gs (dB km-1) and specific liquid water attenuation k_l (dB km-1 [g m3]-1), using the formulation given by Liebe et al. (1989).

[edit] 3.5.6 Microwave radiometer

A recommended but optional input dataset is liquid water path (LWP) derived from dual- or multi-frequency microwave radiometers. LWP is used in many retrieval algorithms for liquid water clouds. Ideally LWP will not be derived using climatologically tuned coefficients, as these can result in errors exceeding 50 g m^-1 and retrieved values that are negative. One method is described by Gaussiat (2004) which makes use of other sources of data to provide more accurate coefficients; lidar is used to locate the height (and therefore the temperature) of liquid cloud, and the model to provide a more appropriate humidity distribution than climatology. Also, profiles identified by the lidar to be free of liquid water cloud are used to estimate the zero offset and by interpolation across periods of cloud, to provide considerably more accurate LWP in thin cloud. This approach also has the advantage that it can produce accurate LWP even if with poorly calibrated radiometer channels. LWP is important for the correction of radar attenuation in liquid water clouds; at 94 GHz it can exceed 5 dB and so if correction is not performed then reliable retrievals in ice clouds above liquid clouds based on the value of Z are impossible.

[edit] 3.5.7 Rain gauge

The presence of rain on the dish or radome of a radar can result in a large and variable attenuation (Hogan et al. 2003a), of order 10 dB, making it impossible to use the absolute value of Z with any reliability. Rain itself also extinguishes the signal and can be difficult to correct for; microwave radiometers do not provide accurate LWP estimates in rain (Crewell and Loehnert, 2003). Radar attenuation due to the melting level is also uncertain. To diagnose the presence of rain we use either a rain gauge or the radar itself. Ideally the rain gauge should have a fairly high sensitivity; tipping-bucket gauges in particular can be very slow to register the start of light rain events. The radar parameters Z, v, and $\sigma_\nu$ in the lowest few gates can also be used to diagnose probable rain on the ground. This approach tends to be more sensitive than a rain gauge, so the rain gauge is not treated as an essential input dataset.

Further technical details on the algorithms can be found at Cloudnet home page.

[edit] 3.6 Mixing height

[edit] 3.6.1 Fundamentals

The mixing layer height (MLH) is the height of the layer adjacent to the ground over which pollutants emitted within this layer or entrained into it become vertically dispersed by convection or mechanical turbulence within a time scale of about one hour (Seibert et al., 2000). As shown in Figure 3.6.1, during daytime the mixing layer tends to be unstable as a result of convection and is capped by an entrainment zone. At night a shallow stable layer forms near the surface in which mixing occurs through intermittent turbulence, leaving a residual layer above.

Figure 3.6.1: Structure of mixing layer from "An Introduction to Boundary Layer Meteorology", Stull, 1988

MLH is an important parameter for practically all air pollution applications except probably the street scale; it is still one major uncertainty for most air quality models. Different instrumentation and different parameterizations will give variable estimates of MLH. Most desired for air pollution applications are continuous representative time series of MLH for the site of interest. As this is still difficult to achieve with routinely available instrumentation e.g. from NWS networks, also simple parameterizations or even fixed or prescribed values (day/night-time, eventually dependant on atmospheric stability) are still in use. Whereas in convective conditions, MLH is often – and rather straightforward - determined as the capping lid (elevated inversion base) of the convective boundary layer, there is more debate on how MLH is best determined in night-time stable conditions, and which physical processes are relevant for MLH evolution at night.

As pointed out in Seibert et al. (2000), there is no ‘MLH-meters’ able to determine the MLH without uncertainties and assumptions. Furthermore, the definitions itself of Mixing Layer are dependent on the quantity employed in the definition itself. Being the mixing due to turbulence, the best definitions appear those making use of the turbulence. Unfortunately, direct measurements of turbulence are very complex, and its remote sensing is currently out of our reach. As a surrogate, we can alternatively measure some proxies or drivers of the turbulence, as the temperature and wind profile, the energy fluxes, the profile of pollutants. The remote sensing of these parameters has become now possible with a variety of instruments, and the evaluation of the MLH is then possible as well. However, some assumptions may be made according to the technique employed. For example, the potential temperature is used in the parcel method and related techniques (all those using the temperature profile). However, this makes sense only under convective regimes, being the potential temperature profile a proxy of convection. Mechanically-induced turbulence cannot be determined by this approach. Likewise, the aerosol can be used as a tracer of the mixing processes in the PBL, even though advection from long distances may complicate the scenario and make very difficult the tracking of the MLH, especially by automated algorithms. This problem lead to attribution problems that will be discussed later on. In case of stable boundary layer, in fact, some problems limit the applicability of remote sensing techniques to determine the MLH. One is related to the minimum altitude of reliable detection, different for each instrument and dependant on the sounding technique (sodars and mini-sodars allow the first gate to be within a few meters, while electromagnetic-related techniques usually suffer for a larger blind zone).

Figure 3.6.2: Integral scale depth for potential temperature for different classes of profiles.

On the other hand, the definition itself of stable boundary layer is complicated by the fact that the turbulence in the stable boundary layer is rather complex, and however weak. The SBL is usually represented as composed by two layers: the lowest, in contact with the soil, showing mostly continuous turbulence, caused by wind shear and radiative forcing. The upper layer is characterized by sporadic turbulence, caused mainly by breaking of gravity waves, presence of clouds and wind shear. Since the profiles are usually smooth, a good quantity for comparisons is the Integral Scale Depth of SBL, as proposed by Stull:

$H_\xi = \frac{\int_{Z} \xi\, dz}{\xi_S}$

Where ξ can be potential temperature, relative humidity or any other quantity with asymptotic behavior towards the free troposphere. This means that it is often very hard to compare MLH measurements if based on different instruments or different proxies (adapted from Stull).

[edit] 3.6.2 Available Techniques

Mixing layer depth can be determined either (1) using temperature, humidity, wind and turbulence profiles from in-situ or remote sensing based vertical profiles or (2) by tracing gradients in atmospheric constituents or structures using remotely sensed vertical profiles (lidar, wind profiling radar, sodar). This is illustrated in Figure 3.6.3. It is important to keep in mind that the (dis)agreement between different retrievals (e.g. temperature based vs aerosol based) is driven to a large extent by the (in)consistency between the atmospheric parameters of interest (e.g. potential temperature profile vs aerosol concentration profile).

Figure 3.6.3: Structure of PBL for convective (left) and stable (right) cases with potential temperature θ_v, wind speed M, water vapor mixing ratio r, and pollutant concentration c, from "An Introduction to Boundary Layer Meteorology", Stull, 1988.

Techniques to derive the mixing layer depth (MLD) from thermodynamic vertical profiles date back to the 1970’s. Extensive reviews are published on this topic regularly. Similarly methods to diagnostic MLD from model or analyses fields are also well described in the literature. An overview on methods how to derive MLH from measurements as well as parameterizations in meteorological pre-processors are given in Fisher et al. (1998; COST action 710). A paper by Seibert et al. (2000) provides a review and intercomparison of operational methods for the determination of the mixing height. A review of methods for urban areas is given in Piringer and Joffre (2005; COST action 715). Emeis et al. (2008) provides a review of surface-based remote sensing of the mixing-layer height. The reports reflect the status of MLH retrieval shortly before they were finalized.

The table 3.6.1 summarizes tracers and instruments that can be used to estimate the depth of the mixing layer. Without being fully comprehensive, it provides a quick overview.

Table 3.6.1: Tracers and instruments used to estimate the depth of the mixing layer
Tracer	Instrument	Pros	Cons
Temperature	About the tracer:	It is somehow a 'simple' parameter Gives the thermodynamic status of the atmosphere	Works well only under convective regimes. Not trivial to detect MLH under stable conditions. Multiple inversions often observed
	Radiosonde	Routinely operated	Sparse temporal resolution
	Tethered balloons		Typically, low resolution
	Raman Lidar	High resolution	High cost
	MWR	Continuous measurements 24/7, all weather High resolution between surface and 500 m	Vertical resolution too coarse beyond 500m to capture temperature inversions
Vertical wind	About the tracer:	Direct measurement of vertical motions in the convective and stable boundary layers	Difficult to measure Useless
	Doppler lidars	Aerosol requested for operational instruments	High cost, few measurements currently
	Wind profilers		High cost, attribution problem (Emily’s talk)
	Sodar	No tracer is needed, 3D wind field	Low height
Aerosol	About the tracer:	Easy to measure with high resolution	Presence of aerosol is required Advection or removal complicates the situation
	Ceilometers	Relatively inexpensive	Overlap problems for stable layers. Attribution problems
	Research lidars	Can measure turbulence using variance of signal	Works well under convective regimes. Need of attended use and analysis
WV	About the tracer:	Provides almost (Hennemuth and Lammert) the same results as aerosol	It is difficult to measure from remote. Attribution problems
	Raman lidars	High resolution (space and time)	Expensive, not operational, needs calibration
	Dial lidars	Absolute measurement	Expensive, not operational
	MWR	?	?
Radon	Radon meter	Direct measurement of the status of mixing	Only in situ measurements Uncertainties related to the radon immission rate
Turbulence	Sodar (+ wind)	Direct measurement of thermal inhomogeneities at high resolution (∼m, ∼s)	Low altitude range (<1 km), works well only under stable conditions or weak convection Uncomfortable in populated areas

From lidars and ceilometers, the MLH may be derived using different proxies, according to the measured parameter:

Rayleigh (elastic) lidar

Provides the aerosol backscatter profile, and the MH is hence based on the assumption that ground-emitted pollutants (like the aerosol) is dispersed and mixed within the whole PBL by turbulence. Three different techniques have been proposed for the MLH determination from aerosol backscatter profiles and will be discussed in sect. (YY).

Raman (water) lidar

The Raman lidar may provide the water vapor mixing ratio profile, if the suitable channel is operating. The water vapor profile may be employed as the aerosol profile, if it can be assumed produced at ground and mixed by atmospheric turbulence.

Doppler (wind) lidar

Doppler lidars provide the profile of wind (u, v, w), making it a very promising instrument for the detection of turbulence (if suitable spatial-temporal resolution is achieved), and convection through the w component. These quantities are directly connected to the turbulence processes and this kind of instrument can then provide a reliable information about the PBL dynamics. However, these instruments are still expensive and have not reached a large diffusion yet. Moreover, the commercial wind lidars make use of the aerosol signal (which is orders of magnitude larger than the molecular one), so the presence of aerosol is, again, mandatory for a good signal-to-noise ratio and the determination of the MLH.

[edit] 3.6.3 Retrieval algorithms based on aerosol backscatter Lidars and ceilometers

As mentioned in sect. 3.6.2, the determination of the MLH by lidar/ceilometers consists in solving two different problems: first, the recognition of all the aerosol layers, and then the attribution of the PBL top to one of the layers found. This problem is sometimes referred to the ‘attribution problem’, and will be presented in section 3.6.4. Here the problem of the layer recognition will be discussed.

Almost all operational eye-safe lidars (historically known as ceilometers) make use of Rayleigh scattering to provide information about clouds and aerosols throughout the troposphere. The Rayleigh echo from molecules and aerosols allow the elastic lidars to measure the aerosol backscatter coefficient, and, with greater uncertainty, the extinction coefficient and the optical thickness. So far, the calculation of these products requires attended calibration of the instrument and data inversion, although several semi-automated methods have been proposed so far (O’ Connor; Wiegner and Geiss). This aspect is described in sec. 3.4. However, this is a rather time-consuming activity, and hence it is not suitable for continuous and operational observations.

In the recent years, several techniques have been investigated to automatically derive some useful information from raw lidar profiles. These information include: cloud base (and eventually top), cloud coverage, presence of rain, and height of the mixing layer. This latter, in particular, is still an open task since several problems still limit the reliability of such product.

However, several automatic analysis may be performed using the background-subtracted signal coming from the instrument, eventually under the form of Range-Corrected Signal (commonly referred to as RCS or Pr2) or logarithm of RCS. The determination of aerosol layers is usually performed on the RCS or ln(RCS), although some authors prefer the signal.

The methods proposed so far to infer the boundary layer height, also referred to as mixing layer height or mixing height, from elastic lidar backscatter data may be classified in three categories:

threshold method;
variance method;
gradient method.

The threshold method has been proposed by Melfi et al. (1985), and is based on the assumption that the aerosol load in the free troposphere is very low. In this case, the aerosol backscatter is significantly higher than zero only in the PBL. The ML is then determined as the zone, close to the ground, where the backscattering exceeds a fixed threshold. This technique requires a good signal-to-noise ratio, being quite sensitive to noise in the data.

The variance method is a powerful technique that employs the temporal variance of the signal to detect the MH (illustrated in Figure 3.6.4). In fact, it has been shown that a maximum in the aerosol backscatter signal is associated to the entrainment zone, which is the interface between the mixed layer and the free troposphere. This layer is characterized by the different eddies reaching different heights, causing a large variance in the aerosol cross section.

Figure 3.6.4: MLD detection method using the maximum variance technique. References: [Hennemuth and Lammert, 2005], [Hooper and Eloranta, 1986], [Menut et al., 1999]

Figure 3.6.5: MLD detection methods using the first (a) or second (b) derivative of Pr2 or the first derivative of the logarithm of Pr2 (c) References: [Flamant et al., 1997,], [Martucci et al., 2007], [Menut et al., 1999], [Sicard et al., 2006]

However, although this method is very powerful for the determination of the convective boundary layer, its reliability under stable or neutral conditions has not been proved so far. When turbulence is very weak, as often happens during nighttime, not necessarily the highest variance is directly connected to the top of the mixing layer. In these conditions is even hard to define the mixing layer, and often the most reliable method to detect the mixing status of the atmosphere is a direct measurement of the aerosol distribution (Seibert et al, 2000). However, the use of variance to detect the height of the stable boundary layer has been further investigated by Pal et al. (2013, submitted). Another key point concerning the variance method is that it requires a very high signal-to-noise ratio, so that the variance can be attributed to variation in the signal and not induced by noise. Many ceilometers, especially those composing current networks are not powerful enough to provide a reliable variance profile with acceptable time resolution. Next generation ceilometers will likely allow to use this quantity to add valuable information to the MLH determination procedures.

The gradient method has been proposed by Endlich et al. (1979), and rests on the hypothesis that the aerosol is produced at ground and is well mixed within the boundary layer. The lowest inflection point detected in the aerosol backscatter coefficient indicates the MLH. The identification of the inflection points can be performed either by direct numerical differentiation (the first (a) or second (b) derivative of the range-corrected signal Pr2 or the first derivative of the logarithm of Pr2 (c) ; illustrated in Figure 3.6.5) or by discrete wavelet transform (maximum correlation coefficient between the signal and a wavelet, illustrated in Figure 3.6.6). The wavelet transform to detect the MH from lidar data has been first proposed by Davis (2000). The advantage of this technique is that it is less prone to noise since an integral is calculated, rather than a derivative. However, if a convenient smoothing is performed on the data, the two operations produce very similar effects.

Figure 3.6.6: MLD detection method using the wavelet covariance. References: [Baars et al., 2008], [Brooks, 2003], [Cohn and Angevine, 2000], [Teschke et al. 2008 ], [Haij et al., 2007], [Morille et al., 2007,], [Wauben et al, 2008]

Figure 3.6.7: Strong Saharan advection observed by a CHM-15k Nimbus over San Pietro Capofiume (Po valley, Italy). The dynamics of the PBL is hardly visible against the strong aerosol structure reaching 5 km. The grey lines represent the timing of sun rise and set, from left to right.

At the base of these three categories there are however some common assumptions, coming from the fact that the aerosol is used as a tracer of the boundary layer. This implies that it is supposed to be emitted at ground and mixed by turbulence within the PBL. Wind or inhomogeneities of the surrounding area may limit the validity of these techniques, since the aerosol may be advected from the neighborhood or even from long distances. In case of strong advection of aerosol the individuation of the mixing layer from lidar data may be complicated because of the continuity of the aerosol echo between the mixing layer and the free troposphere above. Such a case is shown in fig. 3.6.7, relative to a strong Saharan dust advection over Italy. The same is true when the aerosol is removed by strong winds or breeze. In this case, the low aerosol echo does not allow the identification of aerosol layers. Furthermore, in case of fog the signal may be completely extinguished inside the fog layer and no information on the atmosphere above may be retrieved.

[edit] 3.6.4 Retrieval uncertainties based on aerosol backscatter Lidars and ceilometers

There are three important steps in the mixing height retrieval process, namely (1) the lidar/ceilometer pre-processing to produce an attenuated aerosol backscatter profile from raw signal, (2) gradient detection techniques to find the significant aerosol gradients, and finally (3) quality control and layer attribution to identify the actual mixing height from multiple possible layer detections. Each step introduces uncertainty in the retrieval process.

Optical overlap. A key aspect in detecting the aerosol layers from ceilometers is the overlap between the laser beam and the field of view (FOV) of the receiver. In fact, closer than the height of complete overlap (HCO), the echo is detected only partially, leading to a raising branch of the lidar signal that confuses gradient detection. Even though a transfer function may be estimated or measured to correct the signal, at very low altitudes the effectiveness of this correction is low because of the high correction factor that amplifies noise, and is inapplicable below the minimum height for which the laser starts entering in the FOV of the receiver. This difficulty leads to a ‘blind zone’ close to the instrument where the top of the PBL may lay under stable conditions, causing the inability to detect the PBL or a wrong attribution to higher layers. For these reasons, it is recommended to design the instruments so that the overlap is reached as low as possible (e.g. beginning of usable signal between 50 and 100m, and full overlap between 200 and 300m), and use an accurate correction function to reconstruct the signal at close range.

Gradient detection. Different gradient detection techniques were tested and compared during EG-CLIMET. No evidence was found that the first derivative, wavelet transform, and two-dimensional derivative techniques have different skills to detect one or multiple significant aerosol gradients from lidar and ceilometer attenuated backscatter. Lidar-based retrievals of mixing height were found to be consistent (i.e. within 300 m of) with radiosonde-based retrievals about 70% of the time during daytime, and about 30% of the time at night. Poor performances at night are due to: (1) Lidar optical overlap functions and (2) difficulties in identifying aerosol gradients in stable conditions. However, our studies showed that when mixing height retrievals from a ultraviolet lidar and a near-infrared ceilometer agreed, they were 25-40% more likely to agree with an independent radiosonde mixing height retrieval than when each lidar or ceilometer was used alone (Haeffelin et al., 2012).

Attribution issue. While a visual inspection of the lidar profiles usually may give a good idea of the PBL evolution, up to now automated procedures reliable in the widest range of scenarios are not well established. Hence, a correct automatic attribution of the top of the PBL still represents an open research topic. This is mainly because advected aerosol layers as well as residual layers may complicate the scenario and make most automated algorithms fail. The attribution may be helped using both self-consistent data (the internal way) and ancillary data (the external way). Both ways make use of other assumptions employing the physics of the PBL.

As an example of self-consistent information, the variance of the signal, if provided, may help to point out the turbulent layers, and detect without ambiguity the Convective Boundary Layer (CBL). Several works have been published (Hennemuth and Lammert, 2005; Lammert and Bösenberg, 2006; Pal et al., 2010; Behrendt et al., 2011) on this aspect and the use of variance to detect the CBL is now rather clear. On the contrary, the use of temporal variance of the aerosol echo is much more difficult for stable boundary layers. In this case, in fact, turbulence is often sporadic or driven by wind shear, making the temporal variance much less effective to solve the problem of attribution. However, Pal et al. (2013, submitted) have found that taking into account system noise errors and sampling errors, profiles of detrended, high-pass filtered, aerosol backscatter variances can be derived. These profiles reveal at what height turbulent mixing processes are strongest. In convective conditions, the variance profiles typically exhibit one large maximum at the top of the CBL. In stable conditions, the profile reveals multiple smaller maxima. They find that the lowest variance maximum typically coincides with the height of the lowest aerosol backscatter gradient. By combining gradient and variance analyses, and taking into account atmospheric stability derived from ancillary surface measurements, Pal et al. (2013, submitted) increase substantially the retrieval consistency between Lidar and radiosonde retrievals compared to single retrieval methods presented in Haeffelin et al. (2012). During daytime, they find more than 90% of occurrence when the lidar-radiosonde consistency is better than 150 m. At night, more than 65% of lidar and radiosonde retrievals are consistent within 50 m.

An other approach makes use of ancillary data to attribute the MLH to one of the detected layers. These supplementary information may span from a 0-order PBL model to attribute the highest layer during the daytime and the lowest during night time, to a sophisticated synergy with other measurements, such as ground fluxes and a prognostic PBL model, (e. g. the Batchvarova-Gryning model), or radiosoundings or temperature profilers. Di Giuseppe et al. (2012) showed how the use of a Bayesian Selective Method, coupled for example to a rough slab model may help the attribution by selecting the layers closest to the model. Obviously, the more reliable the model, the more accurate will be the selection. The main problem with this approach is the balance between the weights of measurements and model.

Operational status. Gradient and variance-based techniques have been successfully automatized. Hence mixing height retrievals based on these techniques are typically available with most commercial Lidar and ceilometer systems. However, the fraction of undefined or erroneous retrievals remains high and should be quantified precisely. The fraction of the time that mixing is correctly traced by the tracers we consider remains an open and important question.

[edit] 3.7 Liquid clouds

Low-level liquid clouds are prevalent in all seasons and on the global scale. They can be described through cloud cover, vertical distribution (macro-physics), total path integrated liquid water (LWP) as well as droplet size distribution (micro-physics), which can be expressed in terms of liquid water content (LWC), cloud droplet number concentration (N) and effective radius (Reff). Lifetime, as well as macro-physical and microphysical properties of liquid clouds are determined by various factors such as large scale meteorological forcing, physical and chemical variations of cloud condensation nuclei (CCN) population, radiation processes, turbulent surface fluxes, etc. Especially frequently occuring thin mid-level liquid water clouds (alto-cumulus) play a crucial role in the interaction with solar radiation and thus impact atmospheric radiative forcing due to clouds (Turner et al. 2007). Also, condensation and evaporation of cloud water induces vertical and horizontal transports of energy from smallest to global scales. Liquid clouds are also relevant factors in boundary layer processes leading to deep convection and govern the formation of snow and ice in supercooled environments with respect to liquid water. Recent findings (Cesana et al., 2012) even show that also in Arctic regions liquid cloud occurence dominates ice cloud occurrence.

[edit] 3.7.1 User requirement and benefits

Thus, the prediction of climate and weather is extremely dependent on the correct description of clouds on all spatial and temporal scales. This requirement is extremely difficult to meet since clouds since are highly variable in space and time, difficult to measure, interact in a physically complex way with their surrounding and must be correctly described by means of their phase, full particle size spectrum, and shape spectrum. In the context of high-resolution NWP, WMO Observing Requirements Database sets the uncertainty goals for cloud liquid water measurements for high-resolution NWP (global climate models) in the lower troposphere to 5 % (20 %) relative accuracy at 0.1 km (0.2 km) vertical and 15 min (60 min) temporal resolution. Note that the corresponding uncertainty thresholds are set to 20 % (100 %) relative accuracy at 0.5 km (2 km) vertical and 3 h (12 h) temporal resolution.

Satellites can only partially provide such information due to limits in vertical, horizontal and temporal resolution as well as in the information content of passive remote sensors. In this respect Cloudsat (launched in 2006), the first cloud radar in space, has revolutionized the measurement capabilities of clouds from space concerning vertical resolution. However, Cloudsat's life time is limited and is (so far) a singular instrument if its type. In situ measurements are usually more accurate however, require in-cloud flights or radiosoundings which have high costs and can only be organized occasionally or with poor temporal resolution.

It has been shown in the last two decades that a combination of active and passive ground-based remote sensors such as Doppler cloud radar, elastic (or inelastic) lidar and multi-channel microwave radiometer (together wit a limited number of assumptions) have the potential to retrieve these cloud microphysical parameters for different types of liquid clouds. National and international projects and research initiatives (FP5 Cloudnet project, US DOE ARM Programm, FP7 ACTRIS infrastucture, German Research Ministry HD(CP)2 initiative,...) have lead to a loose network of cloud profiling stations with such suitable instrumentation throughout Europe and the US. In the last years, EG-CLIMET has gathered scientists from these research projects to enable a common and more accurate development of cloud profiling retrieval approaches. Retrieval approaches as well as instrument accuracy and sensitivity have improved constantly throughout the years and this, along with the improved instrumental capabilities for measuring aerosols optical properties, have contributed to significantly to reduce the uncertainty of the retrieved cloud microphysics and the related radiative forcing.

Measurements of clouds using ground-based remote sensing networks can lead to an improvement of models by providing an evaluation basis. Measurements can help to obtain insight into cloud parametrizations, i.e. methods to describe sub-scale processes such as convection or small scale processes like droplet formation and turbulence, by means of surrounding meteorological parameters of temperature, pressure, humidity and wind. Methods for determining integrated and vertically resolved cloud liquid water microphysical proeprties are presented and their accuracies are assessed. This is why it is essential to continue developing new methods with highest possible accuracy.

[edit] 3.7.2 Available techniques

The following ground-based remote sensing instruments are sensitive to cloud liquid water and the available techniques are summarized in the following. However, in order to gain essential information on the vertical profile of liquid water cloud microphysical properties an integration of the different measurements and methods is necessary. This is described in Synergetic profiling retrieval algorithms.

Figure 3.7.1: Time series of LWP (top), IWV(center) and profile of absolute (bottom) from Jülich

Microwave radiometer: Due to their suitability for operational measurements and widespread European distribution (i.e. organized within the new international Microwave Radiometer Network MWRnet), microwave radiometers (MWR) have been in the main focus of EG-CLIMET. They are the most reliable technique for deriving the path-integrated liquid water amount (LWP), however provide no information on the vertical distribution of cloud liquid water (Crewell et al. 2009). The estimation of LWP by ground-based microwave radiometry has a long tradition. Westwater (1978) proposed a dual-frequency radiometer with channels at the wing of the water vapor line at 22.235 GHz and in the window region at 31.65 GHz to derive the Integrated water vapor (IWV) and the LWP of the atmosphere. First tests start in 1980. Details of the physical background are described in the MWR Fundamentals and in various reviews as e.g. Askne and Westwater (1986).

In summary, due to the nearly linear relation between TB and IWV as well as vs LWP, the integrated values can be derived by linear equations as follows:

$IWV\,=\,a_0 + a_1TB_{23} + a_2TB_{31}$ $LWP\,=\,b_0 + b_1TB_{23} + b_2TB_{31}$

where a and b denote the coefficient vectors and TB the brightness temperatures of the radiometer. Regression coefficients are calculated mainly on the basis of training data sets consisting of concurrent TB and IWV/LWP values. Both IWV and LWP are obtained from a representative dataset of radiosonde observations, whereby a simple cloud model (i.e. empirically modified adiabatic assumption) is typically assumed to calculate LWP. These data are then used to calculate TB applying a radiative transfer model. Fig. 3.7.1 shows a typical 24h time series of IWV and LWP derived from MWR measurements between 21 and 32 GHz. Most microwave radiometers, which derive these two parameters have a frequency located on the wing of the 22.235 GHz water vapor line and a frequency within the “window” region between 30 and 35 GHz. Window region means that gas absorption is weak and the influence of emitting cloud drops will be large. If TB is measured on the low frequency side (~21.4 GHz) or the high frequency side (~23.8 GHz) of the water vapor absorption line, then, in cloud-free cases, TB is very well linearly related to IWV. This is due to the fact that at both of these frequencies the weighting function is nearly constant with height. In case of clouds, the measurements around the 22.235 GHz line are also influenced by emission of cloud liquid water drops. Thus, liquid clouds “disturb” the water vapor signal and are corrected for by a measurement in the window region. Similarly, water vapor influence on the cloud measurements in the window region are corrected for by using measurements on the wing of the 22.235 GZ absorption line. Lately, increasingly higher frequencies (> 30 GHz) are being used for atmospheric parameter retrieval. First multichannel radiometers were developed to retrieve vertical structures of thermodynamic variables. Closely related was an accuracy improvement of LWP retrievals achieved by multiple regression techniques or neural networks. Löhnert and Crewell (2003) have shown by simulations that the use of additional channels at about 50 GHz and 90 GHz result in better retrievals. Compared to the classical two-channel algorithm the rms-error could be reduced from about 35 gm^-2 to 15-20 gm^-2. However, systematic errors due to different cloud model statistics become more important. Nevertheless, in spite of the technological progress uncertainties in LWP estimations remain unsettled. In a study (Turner et al., 2007) an identical data set of brightness temperatures was used to retrieve LWP by various methods and absorption models. The results are sensitive to uncertainties in MWR calibration, absorption models as well as to the retrieval methods which together may cause biases of up to 50%. Hence, the combination of different active and passive sounding instruments is needed to meet user requirements.

Cloud radar: In the last two decades sensitive microwave radars have been developed, which can detect small cloud particles up to distances of a few kilometers. High spectral, spatial and temporal resolution allow the development of new techniques, which can help to quantify cloud microphysics at finer scales than before. Typically, higher frequencies are used for cloud radars than for weather radars, since these are more sensitive to cloud particles. However, due to the increasing attenuation with frequency, the range of cloud radars is limited to a few kilometers. Typically the radar reflectivity of clouds ranges from –50 to 0 dBZ, whereby –50 dBZ represents the delectability limit of most cloud radars and values above 0 dBZ increasingly imply rain. Cloud radar measurement have been used to relate Z directly to LWC with a power law relationship of the form:

$Z\,=\,cLWC^d$

with Z is in [mm⁶ m^-3] (e.g. Atlas 1954, Sauvageot and Omar 1986). This relation is, however, extremely dependent on the DSD. For example, if an air volume of 1 m³ contains 0.1 g of liquid water and only droplets 5 µm in radius, the reflectivity will be 8 times smaller than if the volume consists only of droplets 10 µm in radius. The coefficients c and d may be derived empirically from in-situ aircraft measurements by measuring the DSD, calculating LWC and Z (assumption Rayleigh scattering) and finally using a least squares to determine a and b. Instead of aircraft measurements other attempts have been made using microphysical cloud models, which resolve the drop size spectrum (Liao and Sassen 1994) and thus allow the calculation of Z and LWC. Fox and Illingworth (1997a) show scatter plots of LWC and Z calculated from DSD-aircraft measurements, which show maximum uncertainties of up to one order of magnitude in LWC for a single measurement if only droplets smaller than ~50 µm in radius are considered. They claim relative LWC accuracies of ~50 % for typical marine stratocumulus.

Since LWC is proportional to D³ and Z to D⁶, the occurrence of just a few larger precipitating (drizzle) drops, which do not contribute significantly to LWC, will dominate the radar signal. Many low level stratocumulus clouds contain drizzle drops and consequently Z - LWC relations must be adapted accordingly during precipitation.

Most modern cloud radars have Doppler capabilities and thus the possibility of measuring the Doppler velocity spectrum. Here, the possibility is given to detect precipitating particles by relating the Doppler velocities of particles to their fall speed, which is determined by particle size.

As shown by Hogan et al. (2005), another approach towards retrieving LWC from radar measurements is to use two radars at different wavelengths. Since attenuation is proportional to LWC within the Rayleigh backscattering regime, the differences between the Z measurements at a certain height give information on attenuation and thus on LWC.

Infrared spectrometer: Next to being sensitive to temperature and traces gases (i.e. water vapor, carbon dioxide, methane, nitrus oxide) highly resolved spectral infrared measurements as provided by an AERI are also sensitive to liquid and ice clouds. Thus, together with reasonable a priori assumptions for temperature and humidity, an AERI is able retrieve the cloud properties cloud effective radius (Reff) and cloud optical depth (COD). An AERI spectrum is sensitive to the liquid cloud properties Reff and COD, whereas MWR observations of liquid clouds are generally sensitive to the integrated liquid water path (LWP). However, within the optical limit, COD=3LWP/2(rho_lReff) directly relates MWR and AERI observations, with rho_l the bullk density of liquid water. At approximately LWP=60gm^-2, the signal of the infrared spectrometer is fully satured. This implies, as mentioned by Turner et al., that an AERI can only be used to retrieve the microphyical properties of thin liquid water clouds, which can however, effectively regulate the solar radiation balance.

Shortwave irradiance: Cloud optical depth can also be derived by using shortwave irradiance measurements. Together with LWP from an MWR, additionally the mean effective radius can then be derived. Several studies have been carried out to estimate cloud optical depth (COD) by broadband (Leontyeva and Stamnes 1994, Dong et al. 1997, Boers 1997, Barker et al. 1998, Qiu 2006) and narrow band (Min and Harrison 1996, Marshak et al. 2000, Daniel et al. 2002, Marshak et al. 2004, Min et al. 2004, Chiu et al. 2010, Matamoros et al. 2011) global (i.e. direct+diffuse), diffuse or direct measurements of irradiance in the shortwave (SW) region. Here we focus on methodologies using broadband SW irradiance, because of the large availability of such type of measurements. The empirical and semi-empirical methodologies presented by Barnard and Long (2004) and Barnard et al. (2008) permit to estimate the COD using the ground-based diffuse and global SW irradiance, respectively, without the need of using other type of measurements or radiative transfer model simulation. Other advantage of these techniques concern the methodology itself, which reduces the impact of the pyranometer calibration. These characteristics make such methodologies attractive for use in routine calculations over one or more sites and for collection of long time series of data. Major drawbacks of this approach are the assumption of a plane-parallel and homogeneous cloud, possibly satisfied in cases of fully overcast conditions, and the lack of information related to the vertical distributions of the clouds. Moreover, the applicability of these algorithms is limited to surface types characterized by albedo lower than 0.30, to solar zenith angles below 75° and to COD values larger than about 5. For further detailed see Barnard and Long (2004) and Barnard et al. (2008). The cloud effective radius can be estimated using COD and LWP values. Assuming a constant LWC(z) within the cloud and a value of the extinction efficiency factor of 2 in the SW region, the effective radius is Reff=3/2*(LWP/COD). Actually the vertical profile of the effective radius varies within the cloud, generally increasing from the cloud base up to the proximity of the cloud top. Under the assumption of a linear increase in LWC(z), i.e. adiabatic profile, it is possible to derive the maximum value of Re(z) as Re(z,top) = 9/5*(LWP/COD)

[edit] 3.7.3 Synergetic profiling retrieval algorithms

Within the scope of the EG-CLIMET four different retrieval methods for profiling LWC, Reff and N all based on active and passive ground-based microwave remote sensing measurements have been thouroughly assessed. The combination of passive MWR and active cloud radar together with a backscatter lidar are currently the most robust way to profile liquid cloud microphysical properties, concerning both 24/7 instrument performance and well as algorithm applicability. All methods use the same information on cloud phase & type, cloud boundaries, radar reflectivity, ceilometer-backscatter and MWR-derived LWP, respectively MWR brightness temperature. This information is derived by the Cloudnet categorization product. Additionally these measurements are available at all atmospheric profiling observatories.

In order to have a "truth" to validate against, all retrieval methods have been applied in a synthetic model environment. Measurement simulations of the ground-based remote sensing instruments using microphysical variables from cloud resolving model output provided this reference. The simulations were carried out within the framework of ECSIM (EarthCare Simulator). After applying the microphysical retrievals to the measurement simulations, an independent evaluation of performance was carried out in order to identify strengths and weaknesses and to improve the retrieval algorithm quality in general. Additionally, the methods are applied to real measurements and evaluated through a short-wave radiative closure using simultaneous broad-band pyranometer measurements.

Figure 3.7.2: EG-CLIMET state-of-the-art techniques to retrieve microphysics from liquid clouds

Cloudnet - scaled adiabatic The Cloudnet algorithm is the standard method within the Cloudnet products to retrieve LWC. In case a non-precipitating liquid cloud is detected by the Cloudnet categorization scheme, cloud base, cloud top and cloud temperature (extracted from atmospheric model output) are used to calculate the adiabatic liquid water content as a function of height above cloud base. Since this LWC represents a theoretical upper limit to cloud LWC, the LWC profile is linearly scaled to meet the the LWP determined independently by a MWR.

TUD-RSCPP algorithm The retrieval method relies on a combination of the cloud radar reflectivity, the microwave radiometer estimated liquid water path and on the cloud geometrical thickness from lidar and cloud radar. These observations are used as input data for different vertical cloud models to retrieve profiles of the LWC, the droplet concentration, the effective radius, the optical extinction and the optical depth. The three cloud models are characterized by their predefined in-cloud vertical structure of the assumed gamma DSD parameters (concentration, shape parameter and mean radius). This assumption is necessary to reduce the number of unknowns since the vertical information of the DSD properties from surface remote sensing observations are still lacking. The common assumptions in all three cloud models on the vertical distribution of the DSD parameters are that the cloud droplet concentration and DSD shape parameter remain constant within the cloud layer. The differences in the in-cloud vertical structure of the cloud models are related to the cloud layer mean droplet radius. In the vertical uniform (VU) cloud model, the cloud layer mean droplet radius is uniformly distributed over the cloud layer thickness while the scaled-adiabatic stratified (SAS) and homogeneous mixed (HM) cloud models parametrize the vertical profiles of the mean droplet radius in consideration of possible impacts of the cloud dilution. The SAS cloud model accounts for the entire range of mixing processes available in the atmosphere by a constant reduction in the particle size with height. In case of the HM cloud model, the impact of mixing is associated with the observed vertical variation in the radar reflectivity profile, which is attributed to changes in the mean particle size. The main assumptions constrain the application of the algorithms to liquid water clouds without drizzle formation and it is expected that drizzle-sized particles will produce biased results, because they are dominating the cloud radar reflectivity while their contribution to the LWC, the droplet concentration and the effective particle size are rather small.

IPT - Integrated Profiling Technique: The IPT (Löhnert et al., 2004, Löhnert et al. 2008) is a variational scheme for retrieving profiles of temperature, humidity and cloud microphysical properties. The core version of this technique includes the physically consistent combination of microwave radiometer, cloud radar and lidar/ ceilometer together with information on the background state (a priori information). It is a variational technique that, similarly to data assimilation techniques, requires uncertainty estimates of the measurements, forward model and background state, which need to be carefully specified. If assuming a Gaussian distribution of atmospheric variables, measurements and their corresponding error, the solution will bring forth not only the most probable solution, but also the error covariance matrix for each derived variable. The retrievable parameters include profiles of temperature, humidity and LWC, as well as Reff. By adapting an empirical relation between Z and LWC for cloud, respectively precipitation, it can retrieve LWC also in drizzling cases.

SYRSOC - Synergistic Remote Sensing of Cloud: SYRSOC (SYnergistic Remote Sensing Of Cloud) is a multi-module technique developed at the National University of Ireland Galway and retrieving the three primary microphysical parameters from liquid clouds (Martucci and O’Dowd, 2011, Martucci et al., 2012, Ovadnevaite et al., 2011), i.e. the cloud droplet number concentration (CDNC), the effective radius ( $R_{eff}$ ) and the cloud liquid water content (LWC). In addition to the three main microphysical variables, SYRSOC provides a number of parameters describing the cloud droplet spectral properties (relative dispersion), the degree cloud of subadiabaticity, the Doppler spectrum of droplets, the cloud optical depth and the cloud albedo. Extinction from standard 355-1500 nm inverted backscatter LIDAR signal or directly from Raman signal is used as input data for SYRSOC. Other input data are the temperature and humidity profiles from co-located operational microwave-radiometer and the reflectivity/signal-to-noise-ratio and depolarization ratio from co-located Ka-band Doppler cloud RADAR. Data from the 1064-nm and 15-km vertical range Jenoptik CHM15K LIDAR ceilometer, the RPG-HATPRO water vapour and oxygen multi-channel microwave profiler and the MIRA36, 35 GHz Ka-band Doppler cloud RADAR are currently used at the GAW Atmospheric Station of Mace Head (Ireland) to supply the necessary input to SYRSOC.

[edit] 3.7.4 Technical implementation and performance

In the following, the main results of the retrieval algorithm application to the simulated data sets are discussed with respect to the different microphysical parameters.

LWC

Figure 3.7.3: Mean LWC profile from cloud resolving model output (black bold) and corresponding 1-sigma range (black dotted) for a simulation initialized over the Cabauw, NL area. The red lines show retrievals results and corresponding 1-sigma ranges from the Cloudnet retrieval (left) and the retrieval method according to C. Brandau (HM model), Delft University, NL (right).

A comparison between the standard Cloudnet scheme and the RSCCP method acording to Brandau (HM cloud model) shows an improvement in LWC retrieval skill using the latter method (Fig. 3.7.3). In contrast to Cloudnet, which relies on a linearly scaled adiabatic assumption, the Brandau method uses radar reflectivity profiles from a cloud radar assuming a relationship between the 2nd and 3rd moment of the DSD based on aircraft measurement (Brenguier et al. 2011). This assumption holds only in non-precipitating clouds. Note, three of the four assessed methods require the LWP derived by independent measurements of an MWR. In non-precipitating cases, the accuracy of LWP is the most crucial factor for retrieving both LWC and Reff. In case the LWP is accurately know, random and systematic error can both be on the order of ~10% for the Brandau method. The IPT method was shown to be very sensitive to the a priori assumption, is however, independent of LWP, whereas the SYRSOC method is very sensitive towards an accurate retrieval of lidar extinction from lidar backscatter. All retrieval methods were shown to be very sensitive towards a correct description of cloud base and cloud top and the corresponding distinction between cloud droplets and precipitation.

Reff & N

Figure 3.7.4: : Mean Reff (left) and N (right) profile from cloud resolving model output (black bold) and corresponding 1-sigma range (black dotted) for a simulation initialized over the Cabauw, NL area. The red lines show retrievals results and corresponding 1-sigma ranges from the retrieval method according to C. Brandau (HM model), Delft University, NL (right).

For non-precipitating cases, the Brandau retrieval method delivers the most satisfactory results for Reff (Fig. 3.7.4, left). Within the cloud boundaries, Reff can be derived with overall accuracies of ~15%. The Brandau method as well as the IPT assumes constant values of N throughout the cloud. Although this is actually the case within the clouds analysed (Fig 3.7.4, right), systematic errors of more than 50% occur. Improvements are only possible if a more situation-specific relation between the 2nd and 3rd moment of the droplet size distribution is used instead of the one proposed by Brenguier et al. 2011.

Precipitation Frequently, liquid clouds contain precipitation size drops (drizzle). In these cases the assumptions on the relations between 2nd and 3rd moment of the droplet size distribution is no longer valid, leading to large overestimation (underestimation) of Reff (N) because a small number of larger droplets dominate the radar reflectivity factor signal. However, both IPT and Brandau method still deliver fairly robust results in LWC with overall errors in the range of 20-50%.

[edit] 3.7.5 Summary and Outlook

Figure 3.7.5: Histogramm of one year of MWR LWP observations at Lindenberg

Due to their capability to provide continuous observations, ground-based remote sensing observations of clouds are widely used and well suited for:

Long-term observations (Validation of new methods, climate applications), e.g. Fig. 3.7.5 gives an impression about the amount of liquid water at Lindenberg during one year. It shows a histogram of non-rejected retrievals indicating that no liquid water was observed at about 24% of the cases. For only for 8% the LWP was greater than 200 gm^-2.

Figure 3.7.6: Model and MWR LWP (top) and solar radiation balance (bottom) observed at Lindenberg observatory in January 2010

NWP model validation. For validation studies LWC, N and Reff measurements are needed as component of a variety of continuously observed parameters. Investigations, which aim at revealing possible deficiencies in the model parameterization, rely on the long-term availability of corresponding parameters. The periods may cover time intervals ranging from months up to several years. LWP from MWR can be provided for such long periods of time. In the frame of a validation study (Vogel et al., 2011) of operational weather forecast models (COSMO-EU) a systematic prediction error of the 2 m temperature during winter months was found. The overestimation of the noon temperature results from an error of the radiation balance at surface of about 20-40 W m^-2. In order to find reasons for the overestimation the radiation balance was split into solar and thermal components. In fact, model radiation peaks appear in low stratiform clouds because their cloud water content is considerably to low compared to the MWR-derived LWP. Furthermore, if the model produces a realistic LWP then the radiance balance simulated by the model agrees with the observation (Figure 3.7.6).

Next steps Currently, research focus is on developing retrieval methods that allow determining microphysical properties of the non-precipitating and precipitating parts of the liquid cloud. This can only be achieved by using additional information from the full Doppler spectrum of the cloud radar. Furthermore, physically consistent a priori data (i.e. long-term statistics) of cloud profiles is needed from in-situ measurement to be able to better constrain the retrieval methods. These methods should be ideally developed within a variational framework, which is flexible concerning the used measurements and retrieval assumption and additionally allowing an inherent error approximation.

[edit] 4 Networks

[edit] 4.1 Operational networks

[edit] 4.1.1 The European network of wind profilers CWINDE

Figure 4.1.1: Spatial distribution of CWINDE wind profilers network

The EUMETNET E-WINPROF programme is providing vertical profiles of wind measurements from wind profilers and weather radars from a network of stations across Europe. Its main goal is to improve the overall usability of wind profiler data for operational meteorology and to provide support and expertise to both profiler operators and end users. Since 2002, this programme is operating the network CWINDE (fig. 4.1.1) which displays time series of realtime quality controlled wind profiles from more than 25 sites in Europe.

Monthly statistics on availability and data quality are sent to the data owners. A list of wind profilers and weather radars whose winds are operationally assimilated into the main Numerical and Weather Prediction (NWP) models in Europe is also updated on a regular basis.

[edit] 4.1.2 The Swiss nuclear powerplant meteorological surveillance tool CN-MET

Figure 4.1.2: Visual sketch of CN-MET system

The main purpose of CN-MET (Centrale Nucléaire et METéorologie) is to bring up to date the system delivering weather information necessary to the population safety in case of a nuclear hazard. CN-MET represents the coupling of a specifically adapted measurement network (mainly ground-based remote sensing) and a predictive tool in the form of a fine grid numerical weather prediction model currently operated at MeteoSwiss (COSMO-2). This new tool, calling upon modern measurement and modeling techniques of the atmosphere, represents a solution which will keep all its relevance for the next decades.

In case of a nuclear accident, the necessary atmospheric data used to calculate the diffusion of a contaminated air mass will be provided by a fine grid numerical model, covering the whole Swiss territory. The measurement network within CN-MET combines in-situ measurements and ground-nased remote sensing systems (wind profilers and microwave radiometers). It is directly adapted to provide the best information (initial and boundary conditions, as well as test measurements) for this model. CN-MET not only ensures the emergency preparedness for the concerned population on a local scale, but also enhances it on a regional scale corresponding to the Swiss Plateau.

For more information: Calpini et al, 2011.

[edit] 4.2 Candidate networks

[edit] 4.2.1 Ceilometer network

The number of automatic Lidars and ceilometers with profiling capability installed over Europe has increased over the past two years. National Meteorological and Hydrological Services (NMHS) in Germany, France, the Netherlands and the United Kingdom, in particular, are deploying Lidars and ceilometers to cover their national territories with the objective to reach a spatial density of nearly one device every 100 km (e.g. Haij and Klein Baltink 2007; Flentje et al. 2010). Figure 4.2.1 (from Haeffelin et al., 2012) provides a convincing representation of the density of automatic backscatter lidars and ceilometers. These investments have been made because of the Lidars/ceilometers ability to detect volcanic ash, but the network is potentially of great value in monitoring clouds and pollution and evaluating their representation in NWP models. Ultimately, incorporation of such data could lead to improved prediction of air quality and hazardous weather.

Although the name ceilometer suggests that their sole purpose is to detect cloud-base, modern ceilometers are able to provide continuous accurate and reliable profiles of backscatter from aerosols and clouds. In the past, Lidars were strictly research instruments. Similarly modern Lidars are becoming more automated and can now contribute efficiently to continuous monitoring of air quality and weather.

Several communities have expressed interest in exploiting data that can be derived from automatic Lidars/ceilometers in Europe: for evaluation of the representation of clouds and aerosols in operational weather forecast models run by National Met Services, for evaluation of climate models, for aerosol transport surveillance and air traffic safety (eg VAAC services, national aviation control entities), for air quality applications (eg EU FP7/GMES MACC-II programme), for greenhouse gas monitoring applications (eg. GAW, ICOS programme). Hence, efforts should be made to provide Lidar/ceilometer data in a harmonized way in Europe.

Automatic Lidar and Ceilometer map over Europe

About 50 institutions, mainly the European NMHSs and aviation control entities, were contacted for their national Lidar and ceilometer networks and a station map was generated using the google earth visualization tool (see Figure 4.2.1). Several WMO member states of the RA VI did not respond to the survey (Albania, Georgia, Lithuania, Luxembourg, Russia, Serbia, Hungaria, Ukrainia, Italy, Bulgaria), thus were not providing any information about local capacities. Enhancements of national ceilometer networks are currently planned in Belgium, Finland, France, Iceland, and Italy. Google Earth was chosen for visualizing the ceilometer positions and the instrument types. The map contains more than 1000 positions (as of March 2012) of ceilometers and lidars in Europe (EARLINET, CIS-Linet, Pollynet, Leonet) but also America (MPLnet) and Asia (AD-net lidars), thus showing the potentially available global vertical profiling capacities. There is however no storage of raw data for roughly half of all instruments gathered, making it impossible to retrieve information about aerosol layers at these positions. These stations are generally marked by using different white symbols representing the different instrument types in the animation. Several EARLINET stations, the entire AD-net and all active MPLnet stations provide quick looks of the backscatter signal. Furthermore, all Jenoptik ceilometers in Germany and some LD40 instruments in the Netherlands operated by KNMI provide links to quick look images (range-corrected backscatter intensities) in near-real-time. Links to quick looks of the UK Met. Office (UKMO) instruments will be added at a later stage. In case of emergency (e.g. volcanic ash plumes) the map may provide information about the spatial distribution of ash clouds and the height regime of such clouds. The map can easily be enhanced by users by adding more stations and/or additional information (e.g., station meta data). The Lidar/ceilometer map is electronically available (as google earth kml-formatted file) on request from the author but requires currently at run time a google earth installation at the user’s site. It is planned offering download of the latest stable version through a dedicated web page.

Figure 4.2.1: Lidar and Ceilometer map as of Mar 30^th, 2012, centered over Europe

Table 4.2.1: Legend for Lidar and Ceilometer map
blue symbol "square":	Vaisala CT12K	blue symbol "blank":	Vaisala CT25K
blue symbol "star":	Vaisala CL31	blue symbol "diamond":	Vaisala CL51
blue symbol "circle":	Vaisala CT75K	cyan/white symbol "square":	Vaisala LD12
cyan symbol "blank":	Vaisala AW11	cyan symbol "circle":	Vaisala LD40
white shaded circle:	Vaisala CTC21	green symbol "blank":	Eliasson CBME80
green needle:	Jenoptik CHM15K	yellow needle:	Jenoptik CHM15KX
yellow symbol "star":	other Lidar	red symbol "A":	AD-net
red symbol "C":	CIS-Linet	red symbol "E":	Earlinet
red symbol "L":	Leonet	red symbol "M":	MPLnet
red symbol "N":	NDACC	red symbol "P":	Pollynet
black/white squares:	Telvent Cirrus 100	black/white circles:	MTECH 8200
white:	backscatter data stored, instrument types as given above
white donut:	unknown instrument type

The data was transfered to an openlayers-based solution, which is free of charge, and the result is now visible and accessible under DWD - Ceilometer-Viewer

Progress and Challenges

Towards a European network of automatic lidars and ceilometers: Harmonizing recording formats and data sharing protocols, data quality management, calibration, target classification and parameter retrievals for clouds and aerosols.

There is an increasing interest in Europe for automatic Lidar/ceilometer data for NWP evaluation and assimilation and for atmospheric surveillance (eg. aerosol transport). Most European countries are planning or are in the process of deploying reasonably dense networks of profiling ceilometers or automatic lidars.

This topic is at the cross road between “operational observation specialists” (Met Services) and “Lidar data interpretation experts” (Research programs).

Several communities have expressed their interest in exploiting data that can be derived from automatic Lidars/ceilometers in Europe: for evaluation of the representation of clouds and aerosols in operational weather forecast models run by National Met Services, for evaluation of climate models, for aerosol transport surveillance and air traffic safety (eg VAAC services, national aviation control entities), for air quality applications (eg EU FP7/GMES MACC-II programme), for greenhouse gas monitoring applications (eg. GAW, ICOS programme). Hence, efforts should be made to provide Lidar/ceilometer data in a harmonized way in Europe.

EG-CLIMET has brought together Met Service representatives involved in Lidar and ceilometer activities and Lidar data analysis experts involved in the EU FP7 ACTRIS programme.

Main conclusions: The participants are highly motivated by the importance of establishing a European network of automatic lidars and ceilometers that would enable data sharing and harmonized processing. A website will be developed to give visibility to the network, present the state of the network and give access to visualization of the measurements, initially at just a few sites (e.g. DWD - Ceilometer-Viewer).

The group proposes that data sharing, calibration and processing shall be handled in a framework similar to the WINPROF system of EUMETNET. This system would include data sharing based on BUFR format, and, harmonized processing using common algorithms (possibly also centralized processing).

Formats: The group will propose a common BUFR format for operational purposes allowing efficient data sharing.

The group will propose a common NetCDF format for scientific applications that will contain all data and metadata.

Calibration and processing: Calibration of automatic lidar/ceilometer measurements is important to enable scientific exploitation of the data. The group will develop common procedures to produce calibrated backscatter profiles.

Processing of calibrated lidar/ceilometer data to produce (1) target classification, liquid cloud, ice clouds, aerosol; (2) aerosol and cloud backscatter profiles; (3) aerosol and cloud extinction profiles; (4) aerosol speciation is of high importance, in order to inform users about observed aerosol properties. The group will propose common procedures to retrieve these properties (inspired by the experience of the FP6 programmes, EARLINET and CLOUDNET).

The way forward: Following EG-CLIMET presentations to EUCOS, the body responsible for the European observing system, E-PROFILE has been launched which will run from 2013-2017 with a kick-off meeting in April-May 2013. E-PROFILE will be responsible for Wind Profiler data quality and for coordinating real time exchange of backscatter profiles from lidars and ceilometers. E-PROFILE will be involved in the logistics, a proposed COST action ‘TOPROF’ would be concerned with operational problems of data quality, calibration and the formats for data exchange.

[edit] 4.2.2 MWRnet

MWR can provide timely and enough accurate atmospheric temperature and humidity data, especially good in the planetary boundary layer (PBL), which remains the single most important under-sampled part of the atmosphere, outside the reach of surface sensors and with poor satellite coverage. At the EG-CLIMET MC Meeting in Oslo (March 2009), some MC/WG members concurred on that the use of ground-based MWR in NWP and climate studies was hampered by unsufficient communication between users, manufacturers, and experts, lack of coordination for networking, unknown number of operational MWR. Thus, a long-time overdue cooperation and coordination effort started under the auspices of EG-CLIMET: MWRnet, an International network of MicroWave Radiometers. MWRnet aims to address the lack of coordination between the MWR operations and increase the utilization of quality controlled MWR data. The long-term mission of MWRnet is the set up of an operational network sharing good practices (in terms of procedures, formats, quality control, protocols, software, etc...) and life cycle of MWR data, facilitating the access of well documented and quality controlled MWR observations and retrievals (with errors).

MWRnet currently links about 61 members, operating more than 94 MWR world wide (including dual-channel units, water vapor profilers, single-channel temperature profilers, multi-channel temperature profilers, and temperature and water vapor profilers), of which about 30 in Europe (temperature and water vapor profilers, for the most). More information on MWRnet and the network map are available at: MWRnet website

MWRnet started within EG-CLIMET and most of the activities were carried out within this COST action. In particular, 3 SWG meetings and 3 STSM were performed:

SWG 00: From raw data to meteorological products
SWG 02: MWR data processing
SWG 17: Towards operational use of MWR data
STSM 06: Assessment of Microwave Radiometer Temperature Profiling
STSM 11: Estimate of PBL Mixing Height from MWR data
STSM 13: Development of a ground-based Radiative Transfer Model (RTM) for NWP

The major achievements of MWRnet within EG-CLIMET were:

Development of calibration control methods
Advances in retrieval algorithm development
MWR Data Assimilation experiment
Assessment of O-B statistics
Initial efforts towards a ground-based MWR Forward Model suited for NWP
EU FP7 proposal EMERGE (unfunded)

In particular, the proposal EMERGE (European MicrowavE Radiometer network within GEo) grouped eight members (CETEMPS-Univ. of L’Aquila (IT), Univ. of Köln (D), KNMI (NL), IMAA (IT), FMI (FI), DWD (D), Meteoswiss (CH), MetOffice (UK)), five of which from National Weather Services. EMERGE passed all quality criteria but unfortunately did not reach the funding level.

MWRnet pursued building connections with NWP data assimilation (DA), climate, and radiopropagation communities:

NWP DA:
- Contribution to the US Tropospheric Profiling Technology Workshop (organized by the US NSF and NWS)
- Invitation to chair a session on the German DA Workshop
- DA experiment in collaboration with Meteo France (HyMeX)
- Mention in the EUCOS roadmap for 2013-2017 as an interesting network for EUCOS expansion
CLIMATE:
- Invitation to join the GRUAN (GCOS Reference Upper Air Network) Task Team 5 focusing on ancillary measurement (w.r.t. radiosondes)
- Contribution to the MWR handbook for GRUAN
RADIO PROPAGATION
- Contribution to the final report of COST Action IC0802 – “Propagation tools and data for integrated Telecommunication, Navigation and Earth Observation systems” with a MWR handbook focusing on MWR estimates of atmospheric attenuation

At its present stage, MWRnet faces both technical and bureaucratic challenges:

Implement common data life-cycle (data format, quality control, retrieval)
Establish a trusted ground-based MWR Forward Model suited for NWP
Data sharing policy

As the outcome of the MWRnet meetings, the following recommendations were collected for good practices with MWR operations.

Table 4.2.2: MWRnet recommendations for MWR operations
#	Type	Recommendation	Note
MM1	Measurement mode	Perform zenith viewing alternating with elevation scans regularly, possibly as frequent as 5 min. Store observations at all channels. If possible, perform 2-side scans.
MM2	Measurement mode	Perform frequent observations of the calibration load (5min intervals). Use integration time ~10 sec (as calibrations need to have longer integration times than the observations for a safe reduction of rms noise).
MM3	Measurement mode	Ideally, all raw voltages of receivers and temperatures in the radiometer system should be recorded continuously in order to make a post-calibration possible.
MM4	Measurement mode	Level 0 data should always be stored. Always store data even if quality flags are on. Avoid discarding data.
CC1	Calibration control	Carefully follow instructions for cryogenic calibration. If possible check Tb after cryogenic calibration against a reference (e.g. clear sky radiosonde simulations).
CC2	Calibration control	Before each cryogenic calibration: observe the cold load for ~2min to characterize the instrument drifts since the last calibration. Note that this need a dedicated featured software since the observed TB will NOT be the LN2 temperature. In fact, the interface reflection on the LN2-surface, residual mirror emission, overspill-termination and other correction factors need to be applied.
CC3	Calibration control	Be careful when using calibration coefficients obtained by a single sky dip (tipping curve). Make sure the threshold for a horizontally homogeneous sky are set very tight, Averaged time series of sky dip calibration coefficients may be used to avoid jumps in the data. Perform full sky-scans to assess the validity of the “homogeneous sky” assumption.
CC4	Calibration control	Inspection by manufacturer every 1.5-2 years is recommended.
CC5	Calibration control	Re-processing of MWR observations and retrievals may be possible if a comparable set of collocated radiosonde profiles is available. Alternatively model analyses could be used.
CC6	Calibration control	Climate application should rely on careful calibration monitoring (including radiative transfer comparison and close maintenance).
CC7	Calibration control	Gain calibration should be performed once every 3-5 minutes for some 5-10 sec integration time.
QC1	Quality control	Use sanity checks to monitor the reliability of the instrument hardware and thus of observed Tb. Use flags provided by manufacturers as well as developed by users.
QC2	Quality control	Use quality control checks to estimate the value of retrievals in opaque (rainy) situations. Use flags provided by manufacturers as well as developed by users.
QC3	Quality control	Rain flag is necessary, especially for humidity, but is may overkill acceptable retrievals. Check the quality of retrievals during rain flagged periods.
RA1	Retrieval algorithm	Uniform multi-linear regression (or NN) retrievals based on radiative transfer calculations should be implemented. These are robust to handle and their accuracy is mostly optimized. Alternatively, direct regression retrievals based on the relation between measurements and model output should be considered.
RA2	Retrieval algorithm	Ideally, a variational approach should be adopted for all the MWR. However, future testing is required – specifically concerning the handling of liquid clouds
RA3	Retrieval algorithm	The estimate of the retrieval error should be provided.
RA4	Retrieval algorithm	The estimate of in-depth retrieval characteristics should be provided (averaging kernels, degrees of freedom)
RA5	Retrieval algorithm	Avoid RH profiles computed from T and WV retrieved profiles.
DF1	Data format	Produce data in a easy-to-share format with metadata.
DF2	Data format	netCDF format complying to the Climate-Forecast (CF) convention is preferable.
DF3	Data format	Common data and metadata format should be decided building on the experience of ARM, LUAMI, COPS.
DF4	Data format	Data should be processed and stored in a reliable and centralized server.

[edit] 5 NWP Applications

[edit] 5.1 Quantifying the impact of wind profiler observations

[edit] 5.1.1 Wind Profiler Impact seen by FSO preliminary results

Until recently there had only been a few studies of the impact of wind profiler observations in NWP and these studies concluded that the impact is very small, or even neutral in the UK Met Office global unified model (UM). “Significant impact cannot be detected from the European wind profiler network” Technical Report No. 532 2009, Richard Dumelow. In this denial experiment, wind profilers were removed as a whole observing system along with VAD wind from weather radars.

Within the last couples of years several Met services like NRL, ECMWF, the UK Met Office have developed forecast sensitivity to observation (FSO) tools which estimate the reduction of forecast error associated with individual observations. At the Met office, this tool has been recently developed for the global model by Andrew Lorenc and Richard Marriott and is run to correspond with parallel suites containing significant changes to the UM and /or data assimilation. It allows comparison of the impact of different observing systems (Lorenc and Marriott 2012) for different versions of the model. For the first time, the impact of each wind profiler can easily be examined.

In this section we show the impact, measured by FSO, of wind profilers on 24-hour global forecasts over a period of one month and compare it with radiosonde impact. The theoretical foundation for the Met Office FSO tool is fully described in Lorenc and Marriott 2012.

[edit] 5.1.2 Wind profiler impact on 24-hour global model forecasts

Figure 5.1.1: Values for 24-hour forecast impact associated with the use of wind profiler within areas of 2.5 by 2.5 degrees. If in that grid box two profilers are present, their impacts are combined. (In Europe wind profiler are together with VAD wind from weather radar). Negative values indicate beneficial forecast impacts (corresponding to a reduction in forecast error). Impacts were accumulated over the full period (22/08/2010-29/09/2012)

Using the chain rule of derivatives (adjoint techniques), values of forecast error sensitivity to observations (usually at a forecast length of 24h) can be computed for each assimilated observation simultaneously. The values represent the change in forecast error for a unit observation innovation. Multiplying the sensitivity by the observation innovation gives an estimate of the forecast error difference due to the observation. This is an estimate of the observation’s impact in the full system, i.e. assimilation + forecast model. The innovation is the difference between the equivalent model observation computed from the forecast valid at the analysis time issued from the previous analysis and the observation use in the current analysis cycle. The forecast error is computed using an energy norm which includes elastic and potential energy, thermal energy, the latent thermal energy of condensation and kinetic energy (Lorenc and Marriott 2012). The forecast error can be computed on any domain. In this study the domain is the full globe for model levels up to 150 hPa.

This tool has been developed for the operational global model which uses a 4D-Var assimilation scheme (Rawlins et al 2007). The FSO tool was run over a period of approximately one month from the 22/08/2010 until the 29/09/2010 using a reduced-resolution version of the UM that was operational at the Met Office between 16 March and 20 July 2011. The full forecast model was run at N512 resolution (approx. 25km in the horizontal and the adjoint model at N216 (approx. 60km in the horizontal. The 4D-Var assimilation scheme uses a 6 hour window and was run at N216 resolution in both the forward and adjoint runs. The wind profilers which are suitable for data assimilation are quality controlled using a background check (if the innovation is too large the observation is rejected). The wind profiler data are hourly thinned.

Figure 5.1.2: An example of wind from wind profiler 70197 (CENA2 Alaska) with quality issues. Winds in red are flagged by the data assimilation quality control. However, some erroneous winds are assimilated

Figure 5.1.1 shows FSO-estimated values of the difference in 24h forecast error associated with the use of wind profiler observations within areas of 2.5 by 2.5 degrees. If in that area two profilers are present, their impacts are combined. N.B. the field shows estimated values of forecast error impact attributed to observations in those locations, not the change in forecast error itself. The error difference measured by the FSO tool was accumulated over the full period for each of the wind profilers and weather radars assimilated in the UK Met Office global model. The impact is quite variable but most of the wind profilers have a beneficial impact (negative value corresponding to a reduction in forecast error). The strongest beneficial impact comes from the Japanese network whilst a few wind profilers have a detrimental impact. The profiler in the middle of Alaska is clearly giving a detrimental impact. A few wind profilers in the US are also measured as having a detrimental impact. In Europe, impacts are mostly neutral/beneficial except for over Switzerland.

The detrimental impact of the wind profiler located in Alaska is due to the quality of the data. Figure 5.1.2 shows one example of these observations. A fair amount of the winds are blowing in spurious directions. Most of them are flagged by the data assimilation quality control but some suspect winds are assimilated. The comparison of the wind against the first guess (Figure 5.1.3) reveals strong bias and a large root mean square deviation. This wind profiler is now blacklisted by the Met Office and is in need of maintenance. (It stopped sending data in 2012.) Some of the other wind profilers from the NOAA network are also giving slightly detrimental impacts; the origin of these detrimental impacts has not yet been studied. The wind profiler in Switzerland at Payerne is located in the vicinity of very complex terrain not well represented by the global model and it is not surprising that such detailed information might have a detrimental effect on the global model. The comparison with the global model in Figure 5.1.4 clearly shows large biases in the boundary layer.

Figure 5.1.3: Comparison of wind data from 70197 (CENA2 Alaska) against the background from the global model for the whole period

Figure 5.1.4: Comparison of wind data from Payerne (Switzerland) against the background from the global model for the whole period

Figure 5.1.5 shows total 24-hour forecast impacts for all European wind profilers. The largest beneficial impact is for wind profiler 03020 South Uist high mode UK (North West Scotland), followed by 10266 Ziegendorf (North Germany). A couple of wind profilers are giving detrimental impacts where they are situated in regions of complex orography (Switzerland 6610, 6632 ). The detrimental impact for the three other wind profilers 11036, 12842, 12982 haven’t yet been investigated.

Figure 5.1.5: Total 24-hour forecast impact over the period for each of the wind profilers assimilated in Europe in the UK Met Office’s global model. The vertical axis is labelled with WMO numbers of the wind profilers

In the UK, total wind profiler impact for the period is larger than that for radiosondes; (see Figure 5.1.6 and 5.1.7) by a factor ~3 when comparing the South Uist wind profiler and Lerwick radiosonde, which are both located in Scotland, and for Camborne (Cornwall).

Figure 5.1.6: Total impact for wind profilers located in the UK

Figure 5.1.7: Total impacts for radiosondes launched in the UK. The impact includes all observations reported by the radiosondes: wind, temperature and humidity data

Figure 5.1.8: Mean impact per profile for German wind profilers

Figure 5.1.9: Mean impact per profile for German radiosondes. The impact includes all observations reported by the radiosondes: wind, temperature and humidity data

Figure 5.1.10: Total impacts for wind profilers located in Germany

Figure 5.1.11: Total impact for radiosondes launched in the UK. The impact includes all observations reported by the radiosondes: wind, temperature and humidity data

At Lindenberg in Germany, the mean wind profiler impact per sounding is as large as the mean impact per radiosonde profile (Figures 5.1.8 and 5.1.9) even though radiosonde observations include temperature and humidity readings as well as winds. (Part of the reason for this could be that the Lindenberg wind profiler is located at a manned observatory (GRUAN station) and is very well maintained.) When accumulated over the full period, the wind profiler impact is larger than the radiosonde impact by a factor ~7 (Figures 5.1.10 and 5.1.11) due to the higher frequency at which wind profiler soundings are performed. The variance of the Lindenberg radiosonde impacts is large meaning that there may be error in our estimation of this mean impact. This result should therefore be confirmed over a larger period of time. Also, it is possible that errors in the impacts of individual observations might be correlated (in height and in time). The total impact, which is just the sum of all the individual impacts, might then be exaggerated. This needs more investigation. However, as the Lindenberg wind profiler and radiosonde are collocated, their impact estimates should each suffer from similar error-correlations. Comparison of their impacts is therefore justified.

When comparing the impact of Lindenberg with Ziegendorf or South Uist, the impact is relatively small. This is not surprising as, at Lindenberg, the atmosphere is already well described in the model due to assimilation of the radiosonde four times a day. The same applies for Camborne where both wind profiler and radiosonde are assimilated. There is a tendency to measure larger impacts for wind profilers and radiosondes located close to the sea, e.g. Lerwick, South Uist, Eimden, Ziegendorf.

[edit] 5.1.3 Conclusion

The FSO tool allows efficient estimation of the impact of each wind profiler. Some wind profilers have a detrimental impact because of quality issues (as in Alaska) or representativeness problems (as at Payerne) but most are measured as having a beneficial impact. The largest impacts come from the Japanese network which are very homogeneous in quality. In general the impact is larger near the coast and in other less well-observed areas. For the studied period, wind profilers of good quality were found to have as much impact per profile as radiosondes with the total wind profiler impact being much larger when accumulated over time. Correlation of errors may cause the beneficial or detrimental impact of observations to be exaggerated. However, these preliminary results tend to indicate that wind profilers could be giving large impacts where they are well maintained and placed in strategic locations. An extended period should be studied to confirm these findings.

[edit] 5.2 Operational assimilation of wind profiler observations

Figure 5.2.1: Typical example of a one-day wind profile time series at Payerne. Coloured barbs: wind profiler measurement; grey barbs COSMO-2 profiles.

Wind profiler observations are operationally assimilated at the European level since a few years (see CWINDE). At the regional scale, an operational system combining wind profiler measurements and a 2km-resolution NWP model was designed in Switzerland (see Figure 5.2.1). Its main purpose is to deliver weather information necessary to the population safety in case of a nuclear hazard. It represents the coupling of a specifically adapted measurement network (mainly ground-based remote sensing) and a predictive tool in the form of a fine grid numerical weather prediction model currently operated at MeteoSwiss (COSMO-2). During the project phase, the positive impact of the three wind profilers on the quality of the forecast over the Swiss Plateau was demonstrated. This system is operational since 2009 Calpini et al, 2011..

[edit] 5.3 MWR data assimilation test

A first trial of assimilating microwave radiometers (MWR) measurements into numerical weather prediction was carried out in preparation to the Hydrological cycle in Mediterranean EXperiment (HyMeX) Special Observing Period 1, held in September-November 2012 in the Western Mediterranean (WMed) arget area.

Figure 5.3.1: Domain of Arome WMed (black line) and distribution of MWR (red: humidity only, blue: temperature only, purple: humidity and temperature) participating to the Data Assimilation preparation phase to HyMeX SOP1

The NWP system used for this study is Arome-WMed, a particular version of the Arome system covering the western part of the Mediterranean Sea (see fig. 5.3.1). Arome-WMed has a horizontal resolution of 2.5 km, a non-hydrostatic dynamical core, detailed physics inherited from the research Meso-NH model, and is coupled with the global Arpege NWP system. It has a three-dimensional variational (3DVar) data assimilation system [10] with background covariances specially computed for the WMed domain. 3DVar analyses are performed every three hours and provide new initial states for subsequent forecasts. Data assimilation tools developed for the Météo-France Arome-WMed NWP system were used to assimilate temperature and humidity retrievals from a list of 13 MWR members (Table 5.3.1) of the international network of ground-based microwave radiometers MWRnet.

Table 5.3.1: MWR units participating to the data assimilation test into HyMeX Arome-WMed NWP
STATION	INSTITUTION	Lat	Lon	m a.s.l.	Products
Bern	IAP	46.88	7.46	905	H
Cagliari	INAF/OAC	39.5	9.24	623	T, H
Granada	CEAMA-UGR	37.16	-3.6	683	T, H
Kloten	MeteoSwiss	47.48	8.53	436	T
Lampedusa	ENEA	35.51	12.34	50	T, H
Madrid	UniLeon	40.49	-3.46	620	T, H
Padova	ARPAV	45.4	11.89	30	T
Payerne	MeteoSwiss	46.82	6.95	491	T, H
Potenza	IMAA/CNR	40.6	15.72	760	T, H
Rovigo	ARPAV	45.07	11.78	23	T
Schaffhausen	MeteoSwiss	47.68	6.62	437	T
Schneefernerhaus	UniCologne	47.42	10.98	2650	T, H
Toulouse	ONERA	43.38	1.29	144	T, H

Preliminary results are summarized in Cimini et al., 2012. As a first step, observation-minus-background (O-B) statistics have been computed for temperature and relative humidity to check the consistency between MWR products and 3-h Arome forecasts. For all MWRs, the O-B standard deviations are generally consistent with those of radiosondes, but tend to increase with height. O-B biases are generally much larger than those found for radiosondes (except for Lampedusa where the temperature bias is particularly small). This is likely due to the difference between the climatological mean assumed in the retrieval and the mean atmospheric state during the period under analysis. Ongoing work includes deeper investigation of automatic quality control and O-B biases, and a quantitative evaluation of the impact Arome-WMed on analyses and forecasts.

[edit] 6 References

Ansmann, A., Riebesell, M., Wandinger, U., Weitkamp, C., Voss, E., Lahmann, W., Michaelis, W., Combined Raman elastic-backscatter lidar for vertical profiling of moisture, aerosol extinction and lidar ratio, Appl. Phys B., 55 (1), 18-28, 1992

Ansmann A., M. Riebesell, and C. Weitkamp, "Measurement of atmospheric aerosol extinction profiles with a Raman lidar," Opt. Lett. 15, 746-748 (1990)

Argyrouli A., N. Budko, H. Russchenberg & C. Unal (2012): The effect of droplet clustering on the statistics of radar backscatter from water clouds, Proceedings of 9th International Symposium on Tropospheric Profiling, ISBN 978-90-815839-4-7, L'Aquila, ITALY, 3-7 Semptember 2012.

Askne, J. and E.R. Westwater, 1986: A review of ground-based remote sensing of temperature and moisture by passive microwave radiometers. IEEE Trans. Geosci. Remote Sens., GE-24, 340-352.

Atlas, D., The estimation of cloud parameters by radar, Jour. Meteor., 11, 309-317, 1954

Baars, H., Ansmann, A., Engelmann, R., and Althausen, D.: Continuous monitoring of the boundary-layer top with lidar, Atmos. Chem. Phys., 8, 7281-7296, 2008.

Barker, H. W., T. J. Curtis, E. Leontieva, and K. Stamnes, 1998: Optical depth of overcast cloud across Canada: Estimates based on surface pyranometer and satellite measurements, J. Climate, 11, 2980–2993.

Barnard, J. C., Long C. N., 2004: A simple empirical equation to calculate cloud optical thickness using shortwave broadband measurements, J. Appl. Meteor.; 43(7): 1057-1066.

Barnard J.C., C.N. Long, E.I. Kassianov, S.A. McFarlane, J.M. Comstock, M. Freer, and G. McFarquhar, 2008: Development and Evaluation of a Simple Algorithm to Find Cloud Optical Depth with Emphasis on Thin Ice Clouds, Open Atmospheric Science Journal 2:46-55. doi:10.2174/1874282300802010046

Bastin, S., C. Champollion, O. Bock, P. Drobinski, and F. Masson, 2007: Diurnal cycle of water vapor as documented by a dense GPS network in a coastal area during ESCOMPTE IOP2. J. Appl. Meteor. Climatol., 46, 167–182.

Battan, L.J. (1973): Radar observation of the atmosphere. The University of Chicago Press.

Bauer-Pfundstein, M. & Görsdorf, U. (2007), Target separation and classification using cloud radar Doppler-spectra, in 'Proceedings 33rd Intern. Conf. on Radar Meteorology, Cairns'.

Behrendt, A., Pal, S., Aoshima, F., Bender, M., Blyth, A., Corsmeier, U., Cuesta, J., Dick, G., Dorninger, M., Flamant, C., Di Girolamo, P., Gorgas, T., Huang, Y., Kalthoff, N., Khodayar, S., Mannstein, H., Träumner, K., Wieser, A., Wulfmeyer, V., 2011a. Observation of convection initiation processes with a suite of state-of-the-art research instruments during COPS IOP8b. Quarterly Journal of Royal Meteorological Society 137, doi: 81e100. doi:10.1002/qj.758.

Bender, M., Dick, G., Ge, M., Deng, Z., Wickert, J., Kahle, H.-G., Raabe, A., and Tetzlaff, G.: Development of a GNSS water vapour tomography system using algebraic reconstruction techniques, Adv. Space Res., 47, 1704–1720, doi:10.1016/j.asr.2010.05.034, 2011.

Bergada, M., S.M. Sekelsky & L. Li (2001): External Calibration of Millimeter-Wave Atmospheric Radar Systems Using Corner Reflectors and Spheres, Eleventh ARM Science Team Meeting Proceedings, Atlanta, Georgia, March 19-23, 1-8.

Bianco, L., J. M. Wilczak, and A. B. White, 2007: Convective boundary layer depth estimation from wind profilers: statistical comparison between an automated algorithm and expert estimations, J. Atmos. Ocean. Tech., 25, 1397-1413).

Bleisch R., N. Kampfer, and A. Haefele. Retrieval of tropospheric water vapour by using spectra of a 22 GHz radiometer. Atm. Meas. Tech., 4:1891-1903, 2011.

Boers, R., Russchenberg, H., Erkelens, J., and V. Venema, 2000. J. Appl. Meteor., 39, 169-181

Boers, R., J. R. Acarreta, and J. L. Gras, 2006. J. Geophys. Res., 111, D22208, doi: 10.1029/2005JD006838

Boers, R., 1997: Simultaneous retrievals of cloud optical depth and droplet concentration from solar irradiance and microwave liquid water path, J. Geophys. Res., 102(D25), 29,881–29,891, doi:10.1029/97JD02494.

Bohren, C. F., Clothiaux, E. "Fundamentals of Atmospheric Radiation: An Introduction with 400 Problems", 1. Edition, Wiley-VCH, Berlin, 2006, 472 pp. ISBN-10: 3-527-40503-8, ISBN-13: 978-3-527-40503-9

Bosenberg, J, Ground-based differential absorption lidar for water-vapor and temperature profiling: methodology, Appl. Opt., 37 (18), 3845-3860, 1998

Bouniol, D., A. J. Illingworth and R. J. Hogan, 2003: Deriving turbulent kinetic energy dissipation rate within clouds using ground based 94 Ghz radar. Proc. 31st Conference on Radar Meteorology, Seattle, USA, Amer. Meteor. Soc., 193-196.

Brandau, C.L., Russchenberg, H.W.J., Knap, W.H., 2010. Atmospheric Research, 96, DOI:10.1016/j.atmosres.2010.01.009.

Brenguier, J.-L., Burnet, F., and Geoffroy, O.: Cloud optical thickness and liquid water path – does the k coefficient vary with droplet concentration?, Atmos. Chem. Phys., 11, 9771-9786, doi:10.5194/acp-11-9771-2011, 2011.

Bringi, V.N. & V. Chandrasekar (2001): Polarimetric Doppler Weather Radar. Cambridge University.

Brooks, Ian M., 2003: Finding boundary layer top: Application of a wavelet covariance transform to Lidar Backscatter Profiles. J. of Atmos. and Oceanic Technol., 20, 1092 – 1105.

Browning, K.A. and R. Wexler, 1968: The Determination of Kinematic Properties of a Wind Field Using Doppler Radar, J. Appl. Met., 7, 105-113.

Cadeddu, M.P. and D.D. Turner, (2011), Evaluation of water permittivity models from ground-based observations of cold clouds at frequencies between 23 and 170 GHz, IEEE Trans. Geosci. Rem. Sens., in press, doi:10.1109/TGRS.2011.2121074.

Cadeddu M. P., V. H. Payne, S. A. Clough, K. Cady-Pereira, and James C. Liljegren (2007), Effect of the Oxygen Line-Parameter Modeling on Temperature and Humidity Retrievals From Ground-Based Microwave Radiometers, IEEE Trans. Geosci. Rem. Sens., vol. 45, no. 7, pp. 2216-2223.

Cadeddu M. P., Liljegren, J. C., and A. L. Pazmany, Measurements and Retrievals From a New 183-GHz Water-Vapor Radiometer in the Arctic, IEEE Trans. Geosci. Rem. Sens, 45, 7, 2207-2215, 2007.

Calpini B., D. Ruffieux, J.-M. Bettems, C. Hug, P. Huguenin, H.-P. Isaak, P. Kaufmann, O. Maier, and P. Steiner, Ground-based remote sensing profiling and numerical weather prediction model to manage nuclear power plants meteorological surveillance in Switzerland. Atmos. Meas. Tech., 4, 1617-1625, 2011, DOI 10.5194/amt-4-1617-2011. Online

Canny, J., A Computational Approach To Edge Detection, IEEE Trans. Pattern Analysis and Machine Intelligence, 8:679-714 (1986).

Cariou Jean-Pierre, Parmentier Rémy, Valla Matthieu, "An innovative and autonomous 1.5µm Coherent lidar for PBL wind profiling"; 14th CLRC, USA

Cariou J.P., B. Augere, M. Valla, “Laser source requirements for coherent lidars based on fiber technology”, C. R Physique 7 (2006) Elsevier Ed.

Cesana, G., J. E. Kay, H. Chepfer, J. M. English, and G. deBoer (2012), Ubiquitous low-level liquid-containing Arctic clouds: New observations and climate model constraints from CALIPSO-GOCCP, Geophys. Res. Lett, 39, L20804, doi:10.1029/2012GL053385 http://onlinelibrary.wiley.com/doi/10.1029/2012GL053385/abstract

Champollion, C., F. Masson, M. N. Bouin, A. Walpersdorf, E. Doerflinger, O. Bock, and J. Van Baelen, 2005: GPS water vapour tomography: Preliminary results from the ESCOMPTE field experiment. Atmos. Res., 74, 253-274.

Charlson, R.J., D.S. Covert, T.V. Larson, and A.P. Waggoner, Chemical properties of tropospheric sulphur aerosols, Atmos. Environ., 12, 39-53, 1978.

Chiu, J. C., C.-H. Huang, A. Marshak, I. Slutsker, D. M. Giles, B. N. Holben, Y. Knyazikhin, and W. J. Wiscombe, 2010: Cloud optical depth retrievals from the Aerosol Robotic Network (AERONET) cloud mode observations, J. Geophys. Res., 115, D14202, doi:10.1029/2009JD013121.

Cimini D., O. Caumont, U. Löhnert, L. Alados-Arboledas, R. Bleisch, J. Fernández-Gálvez, T. Huet, M. E. Ferrario, F. Madonna, O. Maier, F. Nasir, G. Pace, and R. Posada: An International Network of Ground-Based Microwave Radiometers for the Assimilation of Temperature and Humidity Profiles into NWP Models, Proceedings of 9th International Symposium on Tropospheric Profiling, ISBN 978-90-815839-4-7, L'Aquila, ITALY, 3-7 Semptember 2012. Online

Cimini D., E. Campos, R. Ware, S. Albers, G. Giuliani, J. Oreamuno, P. Joe, S. Koch, S. Cober, and E. Westwater, (2011) “Thermodynamic Atmospheric Profiling during the 2010 Winter Olympics Using Ground-based Microwave Radiometry”, IEEE Trans. Geosci. Rem. Sens., 2011.

Cimini D., E. R. Westwater, and A. J. Gasiewski (2010), “Temperature and humidity profiling in the Arctic using millimeter-wave radiometry and 1DVAR”, IEEE Trans. Geosci. Rem. Sens., Vol. 48, 3, 1381-1388, 10.1109/TGRS.2009.2030500.

Cimini, D., E. R. Westwater, A. J. Gasiewski, M. Klein, V. Leusky, and S. Dowlatshahi, The Ground-based Scanning Radiometer: A Powerful Tool for Study of the Arctic Atmosphere, IEEE Trans. Geosci. Rem. Sens., Vol. 45, No. 9, pp. 2759-2777, 2007

Cimini, D., T. J. Hewison, L. Martin, J. Güldner, C. Gaffard and F. S. Marzano (2006), “Temperature and humidity profile retrievals from ground-based microwave radiometers during TUC”, Met. Zeitschrift, Vol. 15, No. 1, 45-56.

Cimini, D., E. R. Westwater, R. Ware, S.J. Keihm, Y. Han, F. S. Marzano, and P. Ciotti (2004), Empirical evaluation of four microwave radiative forward models based on ground-based radiometer between 20 and 60 GHz, Proc. 14th ARM Science Team Meeting.

Clothiaux, E.E., M.A. Miller, B.A. Albrecht, T.P. Achermann, J. Verlinde, D.M. Babb, R.M. Peters & W.J. Syrett (1995): An evaluation of a 94 GHz radar for remote sensing of cloud parameters, J. Atmos. Oceanic Technol., 12, 201-229.

Clothiaux E. E., and Coauthors, 1999: The Atmospheric Radiation Measurement Program Cloud Radars: Operational Modes. J. Atmos. Oceanic Technol., 16, 819–827.

Clough S. A., M.W. Shephard, E. J.Mlawer, J. S. Delamere, M. J. Iacono, K. Cady-Pereira, S. Boukabara, and P. D. Brown (2005), “Atmospheric radiative transfer modeling: A summary of the AER codes,” J. Quant. Spectrosc. Radiat. Transf., vol. 91, no. 2, pp. 233–244.

Cohn, S.A., and W.M. Angevine, 2000: Boundary-layer height and entrainment zone thickness measured by lidars and wind profiling radars. J. Appl. Meteor., 39, 1233 – 1247.

COST710 Final report

COST715 Final report

Crewell S., K. Ebell, U. Loehnert, and D. D. Turner (2009), “Can liquid water profiles be retrieved from passive microwave zenith observations?”, Geophys. Res. Lett., V. 36, L06803, doi:10.1029/2008GL036934

Crewell, S., and U. Löhnert, 2003: Accuracy of cloud liquid water path from ground-based microwave radiometry, 2. Sensor accuracy and synergy. Radio Sci., 38, 8042, doi: 10.1029/2002RS002634.

Crewell, S., and U. Löhnert, 2007: Accuracy of boundary layer temperature profiles retrieved with multi-frequency, multi-angle microwave radiometry. IEEE Transactions on Geoscience and Remote Sensing, 45(7), 2195-2201, DOI10.1109/TGRS.2006.888434.

Dabas A. , “Semi-empirical model for the reliability of a matched filter frequency estimator for Doppler lidar”, Journal of Atmospheric and Oceanic Technology, 16:19–28, 1999.

Daniel, J. S., S. Solomon, R. W. Portmann, A. O. Langford, C. S. Eubank, E. G. Dutton, and W. Madsen, 2002: Cloud liquid water and ice measurements from spectrally resolved near-infrared observations: A new technique, J. Geophys. Res., 107(D21), 4599, doi:10.1029/2001JD000688.

Danne, O. (1996): Messungen physikalischer Eigenschaften stratiformer Bewölkung mit einem 94 GHz-Wolkenradar. PhD thesis. University Hannover, Germany.

Davis, K. J., Gamage, N., Hagelberg, C. R., Kiemle, C., Lenschow, D. H., and Sullivan, P. P., 2000. An objective method for deriving atmospheric structure from airborne lidar observations. Journal of Atmospheric and Oceanic Technology 17, 1455–1468.

de Haan, S., van der Marel, H. Observing three-dimensional water vapour using a surface network of GPS receivers. Atmos. Chem. Phys. Discuss. 8, 17193–17235, 2008.

Di Giuseppe, F., Riccio, A., Caporaso, L., Bonafé, G., Gobbi, G. P. and Angelini, F. (2012), Automatic detection of atmospheric boundary layer height using ceilometer backscatter data assisted by a boundary layer model. Q.J.R. Meteorol. Soc., 138: 649–663.

Dolfi-Bouteyre et al. “Aircraft wake vortex study and characterization with 1.5 μm fiber Doppler lidar“, Journal of Aerospace Lab, December 2009.

Dong, X., and G.G. Mace, 2003. J. Atmos. and Oceanic Tech., 20, 42-53.

Dong, X., T. P. Ackerman, E. E. Clothiaux, P. Pilewskie, and Y. Han, 1997: Microphysical and radiative properties of boundary layer stratiform clouds deduced from ground-based measurements, J. Geophys. Res., 102(D20), 23,829–23,843, doi:10.1029/97JD02119.

Donovan, D.P. & A.C.A.P. Van Lammeren (2001): Cloud effective particle size and water content profile retrievals using combined lidar and radar observations 1. Theory and examples, Journal of Geophysical Research-Atmospheres 106, 27425–27448.

Doviak, R.J. & D.S. Zrnic (2006): Doppler radar and weather observations. Second Edition, Academic Press, San Diego.

Drüe, C., Frey, W., Hoff, A., Hauf, Th., 2008: Aircraft type-specific errors in AMDAR weather reports from commercial aircraft, Quart. J. Roy. Meteor. Soc., 134 (630), 229-239, doi: 10.1002/qj.205.

Emeis S, Schäfer K, MünkelC (2008) Surface-based remote sensing of the mixing-layer height - a review. Meteorol Z 17: 621-630

Endlich R.M., F.L. Ludwig, E.E. Uthe (1979) An automatic method for determining the mixing depth from lidar observations. Atmospheric Environment, Volume 13, Issue 7, Pages 1051–1056

Eresmaa, N., Karppinen, A., Joffre, S. M., Räsänen, J., and Talvitie, H.: Mixing height determination by ceilometer, Atmos. Chem. Phys., 6, 1485-1493, 2006.

Feltz, W.F., W.L. Smith, R.O. Knuteson, H.E. Revercomb, H.M. Woolf, and H.B. Howell, 1998: Meteorological applications of temperature and water vapor retrievals from the ground-based Atmospheric Emitted Radiance Interferometer (AERI). J. Appl. Meteor., 37, 857–875, doi: 10.1175/1520-0450(1998)037<0857.

Feltz, W.F., H.B. Howell, R.O. Knuteson, H.M. Woolf, D.D. Turner, R. Mahon, T.D. Halther, and W.L. Smith, 2005: Retrieving Temperature and Moisture Profiles from AERI Radiance Observations: AERIPROF Value-Added Product Technical Description, DOE/SC-ARM/TR-066, U.S. Department of Energy, Washington, D.C.

Fiocco, G.; and Smullin, L. D., Detection of Scattering Layers in the Upper Atmosphere (60-140 km) by Optical Radar, Nature, I275 (1963).

Fisher, B., S. Joffre, J. Kukkonen, M. Piringer, M. Rotach, M. Schatzmann (Eds.), 2005: Meteorology applied to urban air pollution problems. Final Report of COST Action 715. ISBN 954-9526-30-5, 276 pp. Demetra Ltd. Publishers. Printed in Bulgaria.

Fisher B.E.A., Erbrink J.J., Finardi S., Jeannet P., Joffre S., Morselli M.G., Pechinger U., Seibert P. and Thomson D.J. (1998): EUR 18195 - COST Action 710 - Final report. Harmonisation of the pre-processing of meteorological data for atmospheric dispersion models, Luxembourg: Office for Official Publications of the European Communities 1998 - 431pp. ISBN 92-828-3302-X.

Flamant C., J. Pelon, P. H. Flamant, and P. Durand, “Lidar determination of the entrainment zone thickness at the top of the unstable marine atmospheric boundary-layer,” Boundary-Layer Meteorol. 83, 247–284 1997.

Flentje H, Heese B, Reichardt J, Thomas W (2010) Aerosol profiling using the ceilometer network of the German Meteorological Service. Atmos Meas Tech Discuss 3: 3643-3673, doi:10.5194/amtd-3-3643-2010

Fox, N. and A. J. Illingworth, The retrieval of stratocumulus cloud properties by ground-based cloud radar. J. Appl. Meteor., 36, 485 - 492, 1997

Frisch, A.S., C.W. Fairall, G. Feingold, T. Utal, & J.B. Snider (1998): On cloud radar microwave radiometer measure-ments of stratus cloud liquid water profiles, Journal of Geophysical Research 103, 23195–23197.

Gaussiat, N., R. J. Hogan and A. J. Illingworth, 2007: Accurate liquid water path retrieval from low-cost microwave radiometers using additional information from lidar and operational forecast models. J. Atmos. Oceanic Technol., 24, 1562-1575.

Gero, P.J., and D.D. Turner, 2011: Long-term trends in downwelling spectral infrared radiance over the U.S. Southern Great Plains. J. Climate., 24, 4831–4843, doi: 10.1175/2011JCLI4210.1.

Goldsmith J. E. M., F. H. Flair, S. E. Bisson, d. D. Turner, 1998: Turn-key Raman lidar for profiling atmospheric water vapor, clouds, and aerosols, Appl Opt., 37, 4979-4990.

Goody, R. M. and Y. L. Yung , “Atmospheric Radiation”, Theoretical Basis, Oxford University Press, Second Edition, 1995, 544 pages.

Görsdorf, U. (2007): Cloud radar. In: Engelbart D.A.M., W.A. Monna, J. Nash & C. Mätzler (Ed.): Integrated ground-based remote sensing stations for atmospheric profiling, COST Action 720 - final report, 149-167.

Görsdorf U., Engelbart D., Teschke G.: Can insects be used for the detection of the mixing-height layer? Methodic and results of mixing-height layer estimation from Ka-band radar measurements, submitted to ISTP2009 in Delft.

Görsdorf U., V. Lehmann & M. Bauer-Pfundstein (2012): Ka-band moment statistics and aspects of accuracy,Proceedings of the 9th International Symposium on Tropospheric Profiling.

Grzeschik, M., H.-S. Bauer, and V. Wulfmeyer, 2008: Four-dimensional analysis of water-vapor Raman lidar data and their impact on mesoscale forecasts. J. Atmos. Oceanic Tech., 25, 1437-1453, DOI:10.1175/2007JTECHA974.1.

Haeffelin, M., F. Angelini, Y. Morille, G. Martucci, S. Frey, G.-P. Gobbi, S. Lolli, C. D. O’Dowd, L. Sauvage, I. Xueref-Rémy, B. Wastine, D. Feist, 2012: Evaluation of mixing height retrievals from automatic profiling lidars and ceilometers in view of future integrated networks in Europe, Boundary-Layer Meteorol. 143:49–75.

Haij, M.J. de, H. Klein Baltink and W.M.F. Wauben: Continuous mixing layer height determination using the LD-40 ceilometer: a feasibility study, Scientific Report WR 2007-01, KNMI, De Bilt, 2007.

Han, Y. and Ed R. Westwater. 2000: Analysis and Improvement of Tipping Calibration for Ground-based Microwave Radiometers.IEEE Trans. Geosci. Remote Sens., 38(3), 1260–127

Hardesty, R.M, Hoff, R.M, Eds. Hoff, R.M., Hardesty, R.M., Carr, F., Weckwerth, T., Koch, S., Benedetti, A., Crewell, S., Cimini, D., Turner, D., Feltz, W., Demoz, B., Wulfmeyer, V., Sisterson, D., Ackerman, T., Fabry, F., Knupp, K., Thermodynamic Profiling Technologies Workshop report to the National Science Foundation and the National Weather Service. NCAR Technical Note 488, NCAR/TN-488+STR, ISSN: 2153-2397, 80pp. Online at http://nldr.library.ucar.edu/repository/collections/TECH-NOTE-000-000-000-853, 2012.

Hartung, D. C., J. A. Otkin, R. A. Petersen, D. D. Turner, W. F. Feltz, 2011: Assimilation of Surface-Based Boundary Layer Profiler Observations during a Cool-Season Weather Event Using an Observing System Simulation Experiment. Part II: Forecast Assessment. Mon. Wea. Rev., 139, 2327–2346. doi: http://dx.doi.org/10.1175/2011MWR3623.1

Heese, B., Flentje, H., Althausen, D., Ansmann, A., and Frey,S.: Ceilometer-lidar inter-comparison: backscatter coefficient retrieval and signal-to-noise ratio determination, Atmos. Meas. Tech. Discuss., 3, 3907–3924, 2010

Hennemuth B., Lammert A. (2005) Determination of the atmospheric boundary layer height from radiosonde and lidar backscatter. Boundary-Layer Meteorol DOI: 10.1007/s10546-005-9035-3.

Hewison T. J., D. Cimini, L. Martin, C. Gaffard and J. Nash, Validating clear air absorption model using ground-based microwave radiometers and vice-versa, Meteorologische Zeitschrift, Vol.15, No.1, 27-36, 2006.

Hewison T. (2006), “Profiling Temperature and Humidity by Ground-based Microwave Radiometers”, PhD Thesis, Department of Meteorology, University of Reading

Hewison T. (2007), “1D-VAR retrievals of temperature and humidity profiles from a ground-based microwave radiometer, IEEE Trans. Geosci. Rem. Sens., Vol. 45, No. 7, pp. 2163-2168.

Hogan, R.; Jakob, C. & Illingworth, A. (2001), 'Comparison of ECMWF winter-season cloud fraction with radar-derived values', Journal of Applied Meteorology 40(3), 513--525.

Hogan R.J., D. Bouniol, D.N. Ladd, E.J. O'Connor & A.J. Illingworth (2003): Absolute calibration of 94/95-GHz radars using rain. J. Atmos. Oceanic Technol., 20, 572–580.

Hogan, R. & O’Connor, E. (2004), 'Facilitating cloud radar and lidar algorithms: the Cloudnet Instrument Synergy/Target Categorization product', Cloudnet documentation.

Hogan, R.; O'Connor, E. & Illingworth, A. (2009), 'Verification of cloud-fraction forecasts', Quarterly Journal of the Royal Meteorological Society 135(643), 1494--1511.

Hogan, R. J., N. Gaussiat and A. J. Illingworth.:2005, Stratocumulus liquid water content from dual-wavelength radar, J. Atmos. Oceanic Technol., 22, 1207-1218

Holleman I., 2005: Quality Control and Verification of Weather Radar Wind Profiles, J. Atm. Oc. Tech., 1541-1550.

Holton, J.R., 1992 (2005): An Introduction to Dynamic Meteorology, fourth edition, Elsevier Academic Press, ISBN: 0-12-354015-1.

Hooper, W.P., & E.W. Eloranta, 1986. Lidar measurements of wind in the planetary boundary layer: the method, accuracy and results from joint measurements with radiosonde and kytoon. J. Climate Appl. Meteor. 25:990-1000.

Huang, D., Y. Liu, and W. Wiscombe, 2008: Cloud tomography: Role of constraints and a new algorithm. J. Geophys. Res., 113, D23203, doi: 10.1029/2008JD009952.

Hurter F. and Maier O., Accuracy of boundary layer humidity profiles retrieved by GNSS meteorology and microwave radiometry, Proceedings of 9th International Symposium on Tropospheric Profiling, ISBN 978-90-815839-4-7, L'Aquila, ITALY, 3-7 Semptember 2012.

Illingworth, A.; Hogan, R.; O’Connor, E.; Bouniol, D.; Brooks, M.; Delanoe, J.; Donovan, D.; Eastment, J.; Gaussiat, N.; Goddard, J. & others (2007): Cloudnet - Continuous evaluation of cloud profiles in seven operational models using ground-based observations. Bull. Am. Meteorol. Soc 88, 883-898.

Janssen, M. A. “An Introduction to the Passive Remote Sensing of Atmospheres,” in Michael A. Janssen (ed.), Atmospheric Remote Sensing by Microwave Radiometry, New York, J. Wiley & Sons, Inc, 1993, pp.1-36.

Kadygrov E. N. and D. R. Pick, “The potential performance of an angular scanning single channel microwave radiometer and some comparisons with in situ observations,” Meteorol. Appl., vol. 5, pp. 393–404, 1998. DOI: 10.1017/S1350482798001054

Kaufman, Y. J., D. Tanré, and O. Boucher, 2002. Nature, 419, 215–223.

Kizhakkemadam, 2002, Estimation of atmospheric boundary layer depth from raman lidar using 2-d spatial filters, Master of science, The Pennsylvania State University.

Kollias, P., E.E. Clouthiaux, M.A. Miller, B.A. Albrecht, G.L. Stephens & T.P. Ackerman (2007): Millimeter-Wavelength Radars, new frontier in atmospheric cloud and precipitation research. Bulletin of the American Meteorological Society, 88, 1608-1624.

Kovalev V., V. Eichinger, Elastic Lidar. Theory, Practice, and Analysis Methods, Wiley Interscience Publ., New York, USA, 2004.

Kneifel, S., U. Löhnert, A. Battaglia, S. Crewell, and D. Siebler (2010), “Snow scattering signals in ground-based passive microwave radiometer measurements”, J. Geophys. Res., 115, D16214, doi:10.1029/2010JD013856.

Kneifel, S., S. Crewell, U. Löhnert, and J. Schween, 2009: Investigating water vapor variability by ground-based microwave radiometry: Evaluation using airborne observations. IEEE Geosci. Remote Sens. Letts., 6, 157–161, doi: 10.1109/LGRS.2008.2007659.

Kropfli, R.A. & R.D. Kelly (1996): Meteorological research application of MM-wave radar. Meteorol. Atmos. Phys., 59, 105–121.

Lammert A, Bösenberg J (2006) Determination of the convective boundary layer height with laser remote sensing. Boundary-Layer Meteorol 119 : 159–170

Langland, R. H. and Baker, N. L. (2004): Estimation of observation impact using the NRL atmospheric variational data assimilation adjoint system. Tellus 56A, 189-201.

Leontyeva, E., and K. Stamnes, 1994: Estimations of cloud optical thickness from ground-based measurements of incoming solar radiation in the Arctic, J. Climate, 7, 566–578.

Lhermitte, R.M. and D. Atlas, 1961: Precipitation Motion by Pulse Doppler Radar in Measurements of Particle Fall Velocities, Proceedings of the 9th Weather Radar Conference, Boston, American Meteorological Society, 218-233.

Lhermitte, R. (1990): Attenuation and scattering of millimeter wavelength radiation by clouds and precipitation. J. Atmos. Oceanic Technol., 7, 464–479.

Lhermitte, R., (2002): Centimeter and Millimeter Wavelength Radars in Meteorology. Lhermitte Publications.

Lhermitte, R.M., 1962: Note on Wind Variability with Doppler Radar, J. Atmos. Sci., 19, 343-346.

Liao, L. and K. Sassen, Investigation of relationships between Ka-Band radar reflectivity and ice liquid water density, Atmos. Res., 34, 231-248, 1994

Liebe, H. T., 1985: An updated model for millimeter-wave propogation in moist air. Radio Sci., 20, 1069-1089.

Liebe, H. T., Manabe, T. and Hufford, G. A., 1989: Millimeter-wave attenuation and delay rates due to fog/cloud conditions. IEEE AP, 37, 1617-1623.

Liljegren, J.C., E. E. Clothiaux, G. G. Mace, S. Kato, and X. Dong, 2001. J. Geophys. Res., 106,

Liljegren J. C., S. A. Boukabara, K. Cady-Pereira, and S. A. Clough (2005), “The effect of the half-width of the 22-GHz water vapor line on retrievals of temperature and water vapor profiles with a twelve-channel microwave radiometer,” IEEE Trans. Geosci. Rem. Sens., vol. 43, no. 5, pp. 1102–1108.

Lorenc A.C. (2003): Modelling of error covariances by four-dimensional variational data assimilation. Q. J. R. Meteorol. Soc. 129: 3167-3182.

Lorenc A.C. and Marriott R.T. (2012): Observation Impacts in the Met Office Global NWP System, submitted to QJRMS.

Löhnert U., and O. Maier (2012): Operational profiling of temperature using ground-based microwave radiometry at Payerne: prospects and challenges, Atmos. Meas. Tech., 5, 1121-1134, doi:10.5194/amt-5-1121-2012. Online

Löhnert, U. and Maier, O.: Operational profiling of temperature using ground-based microwave radiometry at Payerne: prospects and challenges, Atmos. Meas. Tech., 5, 1121-1134, doi:10.5194/amt-5-1121-2012

Löhnert U., D. Turner, and S. Crewell (2009), Ground-Based Temperature and Humidity Profiling Using Spectral Infrared and Microwave Observations. Part I: Simulated Retrieval Performance in Clear-Sky Conditions, Journal of Applied Meteorology and Climatology, 48(5):1017-1032.

Löhnert, U.; Crewell, S.; Krasnov, O.; O'Connor, E. & Russchenberg, H. (2008), 'Advances in continuously profiling the thermodynamic state of the boundary layer: Integration of measurements and methods', Journal of Atmospheric and Oceanic Technology 25(8), 1251-1266.

Löhnert U., E. van Meijgaard, H. K. Baltink, S. Groß, and R. Boers (2007), “Accuracy assessment of an integrated profiling technique for operationally deriving profiles of temperature, humidity and cloud liquid water,” J. Geophys. Res., vol. 112, no. D4, p. D04 205.

Löhnert U., S. Crewell, and C. Simmer (2004), “An integrated approach toward retrieving physically consistent profiles of temperature, humidity, and cloud liquid water,” J. Appl. Meteorol., vol. 43, no. 9, pp. 1295–1307.

Löhnert,U. and S.Crewell, 2003: Accuracy of cloud liquid water path from groud-based microwave radiometry. Part I. Dependency on cloud model statistics. Radio Sci. 38, 8041, doi:10.1029/202RS002654.

Mace, G. G., C. Jakob and K. P. Moran, 1998: Validation of hydrometeor occurrence predicted by the ECMWF model using millimeter wave radar data. Geophys. Res. Lett., 25, 1645-1648.

Marshak, A., Y. Knyazikhin, A. B. Davis, W. J. Wiscombe, and P. Pilewskie, 2000: Cloud‐vegetation interaction: Use of normalized difference cloud index for estimation of cloud optical thickness, Geophys. Res. Lett., 27(12), 1695–1698, doi:10.1029/1999GL010993.

Marshak, A., Y. Knyazikhin, K. D. Evans, and W. J. Wiscombe, 2004: The “RED versus NIR” plane to retrieve broken‐cloud optical depth from ground‐based measurements, J. Atmos. Sci., 61, 1911–1925.

Martin L., ASMUWARA - The All-Sky Multi Wavelength Radiometer: Documentation, IAP Re-search Report, No. 2002-12, University of Bern, August 2002.

Martucci, G., J. Ovadnevaite, D. Ceburnis, H. Berresheim, S. Varghese, D. Martin, R. Flanagan, C.D. O’Dowd, 2012. Atmospheric Environment, 48C, 205-218.

Martucci, G. and O'Dowd, C. D., 2011. Atmos. Meas. Tech., 4, 2749-2765, doi:10.5194/amt-4-2749-2011.

Martucci, G., R. Matthey, V. Mitev, and H. Richner, 2007: Comparison between Backscatter Lidar and Radiosonde Measurements of the Diurnal and Nocturnal Stratification in the Lower Troposphere. J. Atmos. Oceanic Technol., 24, 1231–1244.

Maschwitz, G., U. Löhnert, S. Crewell, T. Rose, and D. D. Turner, 2013, Investigation of ground-based microwave radiometer calibration techniques at 530 hPa. Atmos. Meas. Tech. Discuss., 6, 989-103.

Matamoros, Salvador, Josep-Abel González, Josep Calbó, 2011: A Simple Method to Retrieve Cloud Properties from Atmospheric Transmittance and Liquid Water Column Measurements, J. Appl. Meteor. Climatol., 50, 283–295. doi: http://dx.doi.org/10.1175/2010JAMC2394.1

Mattis I., et al., 2002: Geophys.Res. Let. 29, 1306.

Mätzler C., Thermal Microwave Radiation: Applications for Remote Sensing, Thermal Microwave Radiation: Applications for Remote Sensing No.52, series: IEE Electromagnetic Wave series, The Institution of Engineering and Technology (IET), 2006, ISBN 0-86341-573-3 / 978-086341-573-9.

Measures R. M., Laser Remote Sensing. Fundamentals and Applications, Krieger Publishing Company, Malabar, Florida, 1992.

Melfi S. H., J. D. Sphinhirne, S.-H. Chou, and S. P. Palm, Lidar observations of the vertically organized convection in the planetary boundary layer over the ocean, J. Climate Appl. Meteorol. 24, 806 – 821 1985.

Menut L., C. Flamant, J. Pelon and P.H.Flamant, 1999,'Urban boundary layer height determination from lidar measurements over the Paris area' Applied Optics, 38, 945-954.

Min, Q., E. Joseph, and M. Duan, 2004: Retrievals of thin cloud optical depth form a multifilter rotating shadowband radiometer, J. Geophys. Res., 109, D02201, doi:10.1029/2003JD003964.

Min, Q., and L. C. Harrison, 1996: Cloud properties derived from surface MFRSR measurements and comparison with GOES results at the ARM SGP Site, Geophys. Res. Lett., 23, 1641–1644.

Morille, Y., M. Haeffelin, P. Drobinski, and J. Pelon, 2007: STRAT: An Automated Algorithm to Retrieve the Vertical Structure of the Atmosphere from Single-Channel Lidar Data. J. Atmos. Oceanic Technol., 24, 761–775.

Müller D., Wandinger U., Ansmann A., 1999: Appl Optics, 38, 2346.

Münkel C, Eresmaa N, Räsänen J, Karppinene A (2007) Retrieval of mixing height and dust concentration with lidar ceilometer. Bound-Layer Meteorol 124: 117-128

Nan, L., W. Ming, T. Xiaowen, and P. Yujie, 2007: An Improved Velocity Volume Processing Method, Adv. Atmos. Sci., 24, 893-906.

Nicolae D., C. Talianu, T. Trickl, B. Tatarov, H. Nakane, N. Sugimoto, I. Serikov, V. Rizi, M. Iarlori, J. Pelon, P. Flamant, J. Spinhirne, Recent Advances in Atmospheric lidars, INOE Publishing House, 2010

Nicolae D., Belegante L., Nemuc A., 2010: Optoelectron. Adv. Mat.-RC, 4, 12.

Nilsson, T., Gradinarsky, L., & Elgered, G. (2007). Water vapour tomography using GPS phase observations: Results from the ESCOMPTE experiment. Tellus A, 59(5). doi:10.3402/tellusa.v59i5.15150

O'Connor, E. J., A. J. Illingworth and R. J. Hogan, 2004: A technique for autocalibration of cloud lidar. J. Atmos. Oceanic Technol., 21, 777-786.

Otkin, Jason A., Daniel C. Hartung, David D. Turner, Ralph A. Petersen, Wayne F. Feltz, Erik Janzon, 2011: Assimilation of Surface-Based Boundary Layer Profiler Observations during a Cool-Season Weather Event Using an Observing System Simulation Experiment. Part I: Analysis Impact. Mon. Wea. Rev., 139, 2309–2326. doi: http://dx.doi.org/10.1175/2011MWR3622.1

Ovadnevaite, J., D. Ceburnis, G. Martucci, J. Bialek, C. Monahan, M. Rinaldi, M. C. Facchini, H. Berresheim, D. R. Worsnop, and C. O'Dowd, 2011. Geophys. Res. Lett., 38, L21806, doi:10.1029/2011GL048869

Padmanabhan, S., S.C., Reising, J. Vivekanandan, F. Iturbide-Sanchez, 2009, Retrieval of atmospheric water vapor density with fine spatial resolution using three-dimensional tomographic inversion of microwave brightness temperatures measured by a network of scanning compact radiometers. IEEE Trans. Geosci. Rem. Sens., 47, 3708–3721, doi: 10.1109/TGRS.2009.2031107.

Pal, S., Behrendt, A., Wulfmeyer, V., 2010. Elastic-backscatter-lidar-based characterization of the convective boundary layer and investigation of related statistics. Annales Geophysicae 28, 825-847.

Pal, S., M. Haeffelin, E. Batchvarova, Exploring a geophysical process-based attribution technique for the determination of the atmospheric boundary layer depth using aerosol lidar and near surface meteorological measurements, submitted to JGR.

Payne V. H., J. S. Delamere, K. E. Cady-Pereira, R. R. Gamache, J.-L.Moncet, E. J. Mlawer, and S. A. Clough (2008), “Air-broadened half-widths of the 22 GHz and 183 GHz water vapor lines,” IEEE Trans. Geosci. Rem. Sens., vol. 46, no. 11, pp. 3601–3617.

Payne, V.H., E.J. Mlawer, K.E. Cady-Pereira, and J.-L. Moncet, (2011), Water vapor continuum absorption in the microwave, IEEE Trans. Geosci. Rem. Sens., 49, 2194-2208, doi:10.1109/TGRS.2010.2091416.

Perler, D (2011) Water vapour tomography using global navigation satellite systems , PhD thesis No. 20012, ETH Zurich, Switzerland.

Perler, D., A. Geiger, and F. Hurter (2011). 4D GPS water vapor tomography: new arameterized approaches. J. Geod. 85(8), 539-550.

Petty, G.W. "A First Course In Atmospheric Radiation", (2nd Ed.) Sundog Publishing, Madison, Wisconsin, 2006, 460 pp. (paperback), ISBN-10: 0-9729033-1-3 ISBN-13: 978-0-9729033-1-8.

Piironen, A.K., & E.W. Eloranta, 1995. Convective boundary layer mean depths and cloud geometrical properties obtained from volume imaging lidar data. J. Geophys. Res. 100:25 569-25 576.

Piringer, M., S. Joffre (Eds.), 2005: The urban surface energy budget and mixing height in European cities: data, models and challenges for urban meteorology and air quality. Final report of Working Group 2 of COST Action 715. ISBN 954-9526-29-1, 239 pp. Demetra Ltd. Publishers. Printed in Bulgaria.

Protat, A., D. Bouniol, E. J. O’Connor, H. Klein Baltink, J. Verlinde, K. Widener, 2011: Cloudsat as a global radar calibrator. J. Atmos. Oceanic Technol., 28, 445–452.

Qiu, J., 2006: Cloud optical thickness retrievals from ground-based pyranometer measurements, J. Geophys. Res., 111, D22206, doi:10.1029/2005JD006792.

Rainbow® 5 Instruction Manual, Release 5.31.0: Products and Algorithms, Selex Systems Integration GmbH, Document Code: GEMA-SD-0150-5310-2.

Ramanathan, V., Cess, R. D., Harrison, E. F., Minnis, P., Barkstrom, B. R., Ahmad, E., and D. Hartmann, 1989. Science, 243 (4887), 57-63 [doi: 10.1126/science.243.4887.57]

Rawlins F., Ballard S.P., Bovis K.J., Clayton A.M., Li D., Inverarity G.W., Lorenc A.C., Payne T.J. (2007): The Met Office global 4-dimensional data assimilation system. Q. J. R. Meteorol. Soc. 133: 347-362.

Reichardt J. U. Wandinger, V. Klein, I. Mattis, B. Hilber, D. Engelbart, R. Bergvie, F. H. Berger, 2001: RAMSES – The German Meteorological Service water-vapour Raman lidar, promet, 36, 161-168.

Rinehart, R. E. (2005): Radar for Meteorologists. Fourth Edition. Rinehart Publications, Columbia, MO.

Russchenberg, H.W. (1992): Ground-based remote sensing of precipitation using a multipolarized FM-CW Doppler radar. PhD thesis, Technical University Delft.

Russchenberg, H., Löhnert, U., Brandau, C., and Ebell, K., eds. (2009): Radar scattering by stratocumulus: often much lower than expected. Why?, Proceedings of the 8th International Symposium on Tropospheric Profiling, 2009.

Sauvageot, K. (1992): Radar meteorology. Artech House, Boston/London.

Sauvageot, H. and J. Omar, Radar reflectivity of cumulus clouds. J. Atmos. Oceanic Technol., 4, 264-272, 1986

Schween, J.H., S. Crewell, and U. Löhnert, (2011): Horizontal-humidity gradient from one single-scanning microwave radiometer, IEEE Geosci. Remote Sens. Lett. 8(2), 336-340.

Seibert, P.; Beyrich, F.; Gryning, S.E.; Joffre, S.; Rasmussen, A.; Tercier, P. (2000): Review and intercomparison of operational methods for the determination of the mixing height. ATMOS ENVIRON. 2000; 34(7): 1001-1027.

Sicard M., C. Pérez, F. Rocadenbosch, J. M. Baldasano, and D. García-Vizcaino, 2006: Mixed layer depth determination in the Barcelona costal area from regular lidar measurements: Methods, results and limitation. Bound.-Layer Meteor., 119, 135–157.

Simeonov V., T. Dinoev, B. Calpini, S. Bobrovnikov, Y. Arshinov, P. Ristori, H. van den Bergh, and M. Parlange, 2010: A Raman Lidar as Operational Tool for Water Vapor Profiling in the Swiss Meteorological Office, 25 ILRC proceedings, pp. 1175-1178.

Smith, W.L, W.F. Feltz, R.O. Knuteson, H.E. Revercomb, H.M. Woolf, and H.B. Howell, 1999: The retrieval of planetary boundary layer structure using ground-based infrared spectral radiance measurements. J. Atmos. Oceanic Technol., 16, 323–333, doi: 10.1175/1520-0426(1999)016<0323.

Sobel, I., Feldman,G., A 3x3 Isotropic Gradient Operator for Image Processing, presented at a talk at the Stanford Artificial Project in 1968, unpublished but often cited, orig. in Pattern Classification and Scene Analysis, Duda,R. and Hart,P., John Wiley and Sons,'73, pp271-2.

Solomon, S.; Qin, D.; Manning, M.; Chen, Z.; Marquis, M.; Averyt, K.B.; Tignor, M.; and Miller, H.L., ed., IPCC AR4 WG1: Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 978-0-521-88009-1 (pb: 978-0-521-70596-7).

Steyn, D.G., M. Baldi, and R.M. Hoff, 1999: The Detection of Mixed Layer Depth and Entrainment Zone Thickness from Lidar Backscatter Profiles. J. Atmos. Oceanic Technol., 16, 953–959.

Stull R (1988) An introduction to boundary layer meteorology. Kluwer Acad Publ, Dordrecht, p 666

Teschke, G.; Görsdorf, U.; Körner, P. & Trede, D. (2006), A new approach for target classification of Ka-band radar data, in 'Fourth European Conference on Radar in Meteorology and Hydrology (ERAD), Barcelona', pp. 18--22.

Teschke G., J. Reichardt, D. Engelbart,Wavelet algorithm for the estimation of mixing layer heights. Proc. ILRC Delft, 2008.

Theopold, F.A., and J. Bosenberg, Evaluation of DIAL measurements in presence of signal noise, Proc. 14th International Laser Radar Conf., San Candido, Italy, 209-211, 1988.

Turner, D.D., 2007: Improved ground-based liquid water path retrievals using a combined infrared and microwave approach, J. Geophys. Res., 112, D15204, doi:10.1029/2007JD008530.

Turner D. D., M. P. Cadeddu, U. Löhnert, S. Crewell, and A. M. Vogelmann (2009), Modifications to the Water Vapor Continuum in the Microwave Suggested by Ground-Based 150-GHz Observations, IEEE Trans. Geosci. Rem. Sens., vol. 47, no. 10, .pp. 3326-3337.

Turner, D.D., Vogelmann, A.M., Austin, R., Barnard, J.C., Cady-Pereira, K., Chiu, C., Clough, S.A., Flynn, C.J., Khaiyer, M.M., Liljegren, J.C., Johnson, K., Lin, B., Long, C.N., Marshak, A.,Matrosov, S.Y.,McFarlane, S.A., Miller,M.A., Min, Q., Minnis, P., O'Hirok, W., Wang, Z., Wiscombe, W. , 2007. Bull. Amer. Meteor. Soc., 88, 177–190.

Twomey, S.A.,1977. J. Atmos.Sci., 34, 1149-1152.

Ulaby, F.T., R.K. Moore & A.K. Fung (1981): Microwave remote sensing, active and passive, Vol. 1. Artech House, Norwood, MA.

Unden, P., and Coauthors, 2002: Hirlam-5 scientific documentation, SMHI Hirlam-5 Project Tech. Rep., 146.

Vaughan G., D. P. Wareing, S. J. Pepler, L. Thomas, and V. Mitev, Atmospheric temperature measurements made by rotational Raman scattering, Applied Optics, Vol. 32, Issue 15, pp. 2758-2764 (1993)

Venable, D.D., D.N. Whiteman, M.N. Calhoun, A.O. Dirisu, R.M. Connell, and E. Landulfo, 2011: Lamp mapping technique for independent determination of the water vapor mixing ratio calibration factor for a Raman lidar system. Appl. Optics, 50, 4622–4632, doi: 10.1364/AO.50.004622.

Waldteufel, P., and H. Corbin, 1979: On the analysis of single Doppler radar data, J. Appl. Meteor., 18, 532–542.

Wandinger, U., Multiple-Scattering Influence on Extinction-and Backscatter-Coefficient Measurements with Raman and High-Spectral-Resolution Lidars, Appl. Opt., 37 (3), 417-427, 1998.

Wandinger, U., and Ansmann, A., Experimental determination of the lidar overlap profile with Raman lidar, Appl. Opt., 41 (3), 511–514, 2002.

Wauben Wiel M.F., de Haij Marijn and Baltink Henk Klein, Towards a cloud ceilometer network reporting mixing layer height, TECO-2008 - WMO Technical Conference on Meteorological and Environmental Instruments and Methods of Observation St. Petersburg, Russian Federation, 27-29 November 2008.

Westwater, E.R., 1978: The accuracy of water vapor and cloud liquid determination by dual-frequency ground-based microwave radiometry. Radio Sci 13, 667-685.

Westwater E.R., S. Crewell, C. Mätzler: A Review of Surface-Based Microwave and Millimeter Wave Radiometric Remote Sensing of the Troposphere URSI Radio Science Bulletin, No. 310, 59-80, 2004

Westwater E. R., S. Crewell, C. Mätzler, D. Cimini: Principles of surface-based microwave and millimeter wave radiometric remote sensing of the troposphere Quaderni della Società Italiana di Elettromagnetismo Vol.: 1, No.3, 50-90, 2005

Whiteman, D. N., 2000: Investigation of Cloud Properties using a Raman Lidar, Ph.D. dissertation, University of Maryland, Baltimore County.

Whiteman D. N., Examination of the traditional Raman lidar technique. I. Evaluating the temperature-dependent lidar equations, Applied Optics, Vol. 42, Issue 15, pp. 2571-2592 (2003) pdf

Whiteman D. N., Examination of the Traditional Raman Lidar Technique. II. Evaluating the Ratios for Water Vapor and Aerosols, Applied Optics, Vol. 42, Issue 15, pp. 2593-2608 (2003) pdf

Wilczak J. M., E. E. Gossard, W. D. Neff, W. L. Eberhard, 1996: Ground-based remote sensing of the atmospheric boundary layer: 25 years of progress, Boundary-Layer Meteorology; 78(3):321-349. DOI:10.1007/BF00120940 pp.321-349

Wolfram Mathworld, Condition Number

Zhao C, SA Klein, S Xie, X Liu, JS Boyle, and Y Zhang. 2012. Geophysical Research Letters, 39, L08806, doi:10.1029/2012GL051213

@@ Line 1: / Line 1: @@
 == Introduction ==
-Contributors: D. Ruffieux, A.J. Illingworth
-===General Remarks===
+===List of contributors===
-The advent of high resolution climate models toether with high resolution weather forecast models running at global, regional and 1km convection resolving scales requires an integrated composite observing sytem which builds on existing infrastructure.Such a system must be of appropriate quality to meet the requirements of the NWP and climate coummunity.  The goal of the COST action ES0702 is to specify an optimum European network of inexpensive, unmanned ground based profiling stations, which can provide continuous profiles of winds, humidity, temperature, clouds and aerosol properties.
+'''Editors''': A.J. Illingworth, D. Ruffieux, D. Cimini, U. Löhnert, M. Haffelin, V. Lehmann.
-If the data from these networks are to be used, then several conditions must be fulfilled. Firstly a standard calibration, maintenance, and automatic data quality checking system must be developed.   Secondly, the format of the data must be the same, so that it can be exchanged efficiently and rapidly in near real time. The model can then be evaluated by comparison with the observations over over a suitably long period. Ideally difficulties with the model can be identified and rectified so we can move to the third stage, and the 'O-B' statistics can be derived.  That is to say the statistics of the difference between the observation and the background state. If the absence of bias can be confirmed, the standard deviations of the differences characterised and the spatial representativity of the observations established, then the observations can be considered as candidates for data assimilation and they can be used to improve the initial state of the model so that it better represents the true state of the atmosphere. The density of the network is a balance between the spatial representativity of the observations and the economic costs of deploying  the instruments.
+'''Contributors (in alphabetical order)''': F. Angelini, E. Batchvarova, C. Brandau, D. Cimini, O. Cox, H. Czekala, A. Dabas, D. Donovan, J.C. Dupont, K. Ebell, J. Fernández-Gálvez, M. E. Ferrario, C. Gaffard, G.P. Gobbi, U. Görsdorf, J. Güldner, A. Haefele,  M. Haffelin, F. Hurter, A.J. Illingworth, S. Kauczok, H. Klein Baltink, V. Lehmann, R. Lehtinen, D. Leuenberger, U. Löhnert, S. Lolli, F. Madonna, O. Maier, G. Martucci, G. Maschwitz, I. Mattis, D. Nicolae, E. O’Connor, G. Pace, S. Pal, M. Piringer, B. Pospichal, D. Ruffieux, L. Sauvage, B. Thies, L. Thobois, W. Thomas, M. Wiegner.
+===General Remarks===
-The COST action has identified three existing ground-based profiling networks and a group of atmospheric observatories and has, through various workshops and sponsored scientific missions, facilitated the implementation of  appropriate coordination and harmonisation of operating procedures, retrieval algorithms, recording formats to meet these aims.  In the current financial climate the development of completely new observing networks is unrealistic,  so instead we have concentrated on ensuring that the data from existing networks is of uniform and high quality across Europe. If the data are of variable quality and procedures are different from one country to another then they are of limited use.  The three existing networks of ground-based instrument are:
+The advent of high resolution climate models together with high resolution weather forecast models running at global, regional and 1km convection resolving scales requires an integrated composite observing sytem which builds on existing infrastructure.Such a system must be of appropriate quality to meet the requirements of the numerical weather prediction (NWP) and climate coummunity.  The goal of the COST action ES0702 is to specify an optimum European network of inexpensive, unmanned ground based profiling stations, which can provide continuous profiles of winds, humidity, temperature, clouds and aerosol properties.
-CEILOMETERS.  The current national networks in the UK, F, NL and D, operated by the national weather services (NWS), comprise over 200 ceilometers. Ceilometers are very robust with low maintenance requirements. They provide profiles of backscattered light due to aerosols (including volcanic dust) and clouds. EG-CLIMET has organised and hosted workshops with NWSs to collect and centralize their ceilometer backscatter data and to ensure that the data is subject to common format, calibration and data interpretation algorithms. Such data will be available to:
+If the data from these networks are to be used, then several conditions must be fulfilled. Firstly a standard calibration, maintenance, and automatic data quality checking system must be developed.   Secondly, the format of the data must be the same, so that it can be exchanged efficiently and rapidly in near real time. The model can then be evaluated by comparison with the observations over over a suitably long period. Ideally difficulties with the model can be identified and rectified so we can move to the third stage, and the 'O-B' statistics can be derived.  That is to say the statistics of the difference between the observation and the background state. If the absence of bias can be confirmed, the standard deviations of the differences characterised and the spatial representativity of the observations established, then the observations can be considered as candidates for data assimilation and they can be used to improve the initial state of the model so that it better represents the true state of the atmosphere. The density of the network is a balance between the spatial representativity of the observations and the economic costs of deploying  the instruments.
-•	Evaluate the backscatter profiles predicted by the prognostic aerosols within the next generation of European forecast models for forecasting air quality such as within  ECMWF’s  MACC model. Ultimately the profiles could be assimilated into such models.
+This document provides a summary of the major findings and conclusions of the EG-CLIMET action. It highlights four profiling instruments, their synergy, and NWP applications. The instruments provide profiles of aerosol and cloud backscatter, winds, temperature and humidity:
+* Ceilometers
+* Doppler lidars,
+* Wind profilers
+* Microwave Radiometers
+* Synergy and NWP applications
-•	Monitor the spatial distribution, height and density of aerosol plumes (e.g. volcanic ash, mineral dust, biomass burning, or industrial accidents) over Europe, which are key information for air traffic safety. Again such information could be assimilated into atmospheric dispersion models.
+===Summary of Findings and Recommendations===
-•	Monitor the depth through which surface emitted species are mixed or trapped.  These data could be used to evaluate dispersion models and be assimilated into such models.
+'''Ceilometers''': EG-CLIMET has
-MICROWAVE RADIOMETERS.  In the last decade MicroWave Radiometers (MWR) have matured towards network-suitable instruments, which can operate in 24/7 unattended mode. Currently continuous ground-based MWR observations are carried out at 30 sites in Europe providing temporally highly-resolved monitoring of the following atmospheric parameters:
+* Compiled a list of hundreds of ceilometers deployed in Europe.
+* Demonstrated they could supply real time backscatter profiles from clouds and aerosols.
+* Demonstrated simple accurate calibration techniques using atmospheric targets
+* Demonstrated they can measure the boundary layer height in unstable boundary layers.
+* Compared the backscatter profiles of clouds and aerosols with NWP models predictions.
+* Recommended to EUCOS that these instruments be networked to provide real time data.
-•	Down-welling microwave radiance at multiple  channels
+'''Doppler Lidars''': EG-CLIMET has
-•	Temperature profile T(z), with highest accuracy and resolution in the boundary layer (BL)
+* Examined the performance of new Doppler lidars; 25 are now deployed in Europe.
+* Demonstrated that they can provide accurate winds in the boundary layer.
+* Demonstrated they can measure turbulence and vertical exchange in the boundary layer.
+* Recommended to EUCOS that these instruments be networked to provide real time data.
-•	Integrated Water Vapour (IWV) and cloud Liquid Water Path (LWP)
+'''Wind Profilers''': EG-CLIMET has
+* Developed algorithms, now implemented operationally, to reject spurious bird echoes.
+* Improved algorithms, now implemented operationally, for rejecting spurious ground clutter.
+* Demonstrated the positive impact of well-maintained wind profilers on NWP forecasts.
-•	Low-resolution humidity profile V(z).
+'''Microwave Radiometers''': EG-CLIMET has
-Direct measurements (radiances) as well as atmospheric retrievals are available for data assimilation into numerical weather prediction (NWP) models as well as for satellite and NWP validation. EG-CLIMET is drawing up specifications for MWR data life-cycle (including operation procedures, instrument monitoring, calibration control, data quality control, harmonized metadata and data format) essential to guarantee reliable and easy-to-access data of high quality. MWR data and products provide essential information on temperature inversion, thermal trapping, convective initiation and other situations important for operational meteorology and air quality monitoring and forecasting.
+* Compiled a list of MWRs in Europe and developed an international network: MWRnet.
+* Demonstrated the accuracy of temperature and water vapour in retrieved profiles.
+* Demonstrated the value of MWR in estimating boundary layer depth.
+* Provided the first comparison of MWR retrievals with NWP model predictions.
-WIND PROFILERS.     need some remarks here about the need for improved data quality etc, but have we really achieved this, and is not this the responsiblity of an existing group?NEED TO DISCUSS WHAT CLAIMS WE WILL BE MAKING HEAR.
+'''Synergy and NWP''': EG-CLIMET has shown that
+* Ceilometer data may be used for evaluation of NWP models and subsequent assimilation.
+* Doppler Lidars, together with Wind Profilers, can provide winds throughout the troposphere.
+* Strategically placed wind profilers have a positive impact on NWP forecasts.
+* Wind profilers are operationally assimilated in several NWP models. Moreover, they can be combined with NWP to provide warnings in case of a nuclear hazard.
-ATMOSPHERIC OBSERVATORIES.  Throughout Europe there is an increasing number of sites with multiple remote sensing instruments with the potential of retrieving the complete atmospheric state within the column above. Currently there are on the order of ~10 observatories. One specific focus of these observatories is on the synergy of advanced remote sensing instruments following the approach taken in the EU FP5 project Cloudnet, providing real-time evaluation of cloud /aerosol parameterisation schemes in NWS forecast models and anchor points for satellite retrieval evaluation.  The density of observations with such observatories is low, so the data are probably not candidates for data assimilation.
+Following EG-CLIMET presentations to EUCOS, the body responsible for the European observing system, E-PROFILE has been launched which will run from 2013-2017 and will be responsible for Wind Profiler data quality and for coordinating real time exchange of backscatter profiles from ceilometers and lidars. A new COST action, ES1303, TOPROF, ’Towards Operational ground based PROFiling with ceilometers, Doppler lidars and microwave radiometers for improving weather forecasts’, will address common calibration, retrieval algorithms and data quality issues.
-NOT SURE WHERE ELSE THIS IS TO BE DISCUSSED - MAYBE THIS SECTION SHOULD BE LEGTHENED.
+'''A condensed overview of the EG-CLIMET achievements is available in the''' [http://cetemps.aquila.infn.it/mwrnet/eg-climet-overview-final-21May2013.pdf EG-CLIMET Executive Summary]
 == Instruments ==
-Contributors: V. Lehmann
 === Radar Wind Profiler ===
+Radar wind profilers (RWP) are special Doppler radars designed for measuring the vertical profile of the wind vector in the lowest 5 - 20 km of the atmosphere (depending on the operating frequency), on timescales ranging from seconds to years.
+RWP are also able to provide additional information about the atmospheric state through the profiles of backscattered signal intensity and frequency spread (spectral width) of the echo signal.
-* [[Radar wind profiler]]
+For more information: [[Radar wind profiler]]
 === mm-Wavelength Radar ===
-Contributors: Boris Thies, Ulrich Goersdorf
+Millimeter wavelength cloud radars measure profiles of the intensity of particle-backscattered signals and their Doppler shift which can be used to derive information about the particle size and concentration as well as about their motion. Because of their short wavelengths, cloud radars have excellent sensitivity to small cloud droplets and ice crystals. Some radars have the capability for polarimetric measurements which contain additional information about the particle shape and orientation. Cloud radars are ideal for continuously monitoring the vertical distribution and structure of various cloud types as well as for studying the role of non-precipitating clouds in the climate system.
-* [[Cloud radar]]
+For more information: [[Cloud radar]]
+=== Lidar Fundamentals ===
+Lidar is one of the most powerful atmospheric profiling techniques for the ground-based monitoring of aerosol, water vapour, clouds and many other atmospheric parameters.
+The lidar profiling technique is based on the study of the interaction between a laser radiation sent into the atmosphere and the atmospheric constituents.
+For more information: [[Lidar fundamentals]]
 === Doppler Lidar ===
-Contributors: Laurent Sauvage, Ludovic Thobois, Alain Dabas
+The Doppler Wind Lidar (DWL) have demonstrated their ability to provide wind measurements through the atmosphere. A DWL is a rugged instrument that meets the requirement of unmanned and unattended operation, with a very high spatio-temporal resolution. Some commercial available coeherent systems provide measurements with a temporal resolution of about 10 s and spatial resolution of 50 m measurements of the full wind velocity vector and backscatter within the atmospheric boundary layer.
+For more information: [[Doppler Wind Lidar]]
 === Raman Lidar ===
-Contributors: Alexander Haefele
+The Raman lidar uses the scattering properties of molecules and aerosols to derive profiles of water vapor and other species, aerosols and temperature with a high vertical and temporal resolution. Raman lidars can cover an altitude range from a few hundreds of meters to the lower stratosphere. Recent progress in lidar research brought Raman lidars into a nearly operational state and they are becoming suited for meteorological applications.
-* [[Raman Lidar]]
+For more information:  [[Raman Lidar]]
 === Ceilometer ===
-Contributors: Martial Haffelin, Ewan O Connor
+Ceilometers are inexpensive single-channel lidars. These instruments are principally employed to automatically identify the height of the cloud base above the instrument. Although the name ceilometer suggests that their sole purpose is to detect cloud-base, modern ceilometers are able to provide continuous accurate and reliable profiles of backscatter from aerosols and clouds. Modern Lidars are becoming more automated and can now contribute efficiently to continuous monitoring of air quality and weather.
+For more information: [[Ceilometer]]
 === Microwave Radiometer ===
-Contributors: Nico Cimini, Ulrich Loehnert, Bernhard Pospichal
 Ground-based microwave radiometer (MWR) measurements of atmospheric thermal emission are useful to derive temperature and humidity profiles as well as information on integrated values of water vapor and liquid water.
 With careful design, MWR can make continuous observations (time scales of seconds to minutes) in a long-term unattended mode in nearly all weather conditions.
-MWR are used for a variety of environmental and engineering applications, including meteorological observations and forecasting, communications, geodesy and long-baseline interferometry, satellite validation, climate, air-sea interaction, and fundamental molecular physics.
+MWR are used for a variety of environmental and engineering applications, including meteorological observations and forecasting, communications, astronomy, radio-astronomy, geodesy and long-baseline interferometry, satellite validation, climate, air-sea interaction, and fundamental molecular physics.
 For more information: [[Microwave radiometer]]
-=== Pyranometer ===
-Contributors: Giandomenico Pace
-Shortwave and longwave broadband irradiances are key climatic variables, their measurements being fundamental to determine the Earth’s radiation budget.
-Historically, irradiance measurements in the solar region were intended to determine the solar constant and its variability and were first performed in XIX century; the availability of such a long time series of  measurements has been afterwards used also in climatological studies, for example to estimate the perturbation to the stratospheric optical depth induced by the large volcanic eruptions (Stothers, 1996).
-Regular ground-based measurements of direct and global shortwave irradiance have a long history, starting at the beginning of XX century, when pyranometers were built and commercialized (Abbot and Aldrich,1916).
-Nowadays pyranometers are commonly used in studies of  meteorology, climatology and solar energy. When properly installed and operated pyranometers furnish continuous observations of global, direct and diffuse SW irradiance in all weather and environmental conditions.
-For more information: [[Pyranometer]]
-== Retrievals ==
-Contributors: U. Loehnert, N. Cimini
-=== Direct retrievals ===
-Active remote sensing instruments ...
-=== Inversion schemes ===
-Passive remote sensing also has the potential for retrieving the atmospheric thermodynamic state (Westwater et al. 1997), i.e. the distribution of temperature and humidity in a quasi continuous and instantaneous way. This requires a retrieval model, which transforms the measured radiative quantities into thermodynamic information. In general, the retrieval problem is ill-posed, implying that no unique solution for the atmospheric parameter exists with respect to the measurements. Rather, a wide range of possible atmospheric parameters can bring forth the same measured radiative quantities, so that further assumptions and/or additional measurements are needed to narrow down the range of valid solutions. Moreover, the vertical resolution of a typical microwave profilers or infrared spectrometers for temperature and humidity retrieval are limited (e.g. Löhnert et al. 2009, Güldner and Spänkuch 2001) shwoing that these methods cannot bring forth profiles with more than 10 independent levels. Cadeddu et al. 2003 have applied a multi-resolution wavelet transform technique for studying the vertical resolution of temperature profiles from a multi-frequency microwave profiler and found rapidly degrading values of 125 m in 400 m height to about 500 m in 1.5 km height at zenith viewing direction. Löhnert et al. 2009 have also shown, that the pieces of independent temperature and humidity information is on the order of 4, respectively 2 for multi-angle, multi-frequency microwave measurements. For liquid water, this number decreases to the order of 1 (Crewell et al. 2009) making the profile retrieval of this variable not sensible from passive microwave measurements alone.
-A variety of techniques can be used to derive information on the atmospheric state vector x, from the observation vector y, which in our case represents radiometric measurements. In fact, the Forward (F) problem, represented by the radiative transfer through the atmosphere, is analytically solvable and in its discrete form can be expressed by:
-y = F(x)
-Conversely, because only a finite number of highly correlated observations affected by measurement error (e ) are available, the inverse problem of estimating x from y:
-x = R(y+e )
-accepts non-unique solutions and thus is said to be ill-posed. In this regard, the observations act as constraints that need to be coupled with auxiliary information, known a priori, to provide a meaningful solution. The equation above is general, and each technique is based on a different approach to the solution. In the following, we summarize the main features of some techniques that are generally applied to the radiometric observations.
-==== Multi-linear regression ====
-Text here
-{| class="wikitable"
-!colspan="6"|Template Table
-|-
-| Instrument
-| Operational units
-| Performances
-|-
-| Ceilometer
-| align="right"| 1000
-| excellent
-|-
-| MWR
-| align="right"| 30
-| superb
-|}
-==== Neural Networks ====
-Text here
-==== Variational approaches ====
-Text here
 == Products ==
-Contributors: Various
 === Temperature profile ===
@@ Line 130: / Line 110: @@
 ==== User requirements and benefits ====
 In the context of high-resolution NWP, [http://www.wmo-sat.info/db/ WMO Observing Requirements Database] sets the ''uncertainty goals'' for temperature measurements in the lower troposphere to 0.5 K accuracy at 0.1 km vertical and 15 min temporal resolution. Note that the corresponding ''uncertainty thresholds'' are set to 3 K accuracy at 1 km vertical and 6 h temporal resolution.
-Current weather forecast models rely on a) radiosondes, b) polar-orbiting satellites and c) ascending/descending commercial aircrafts at major airline hubs (AMDAR: Aircraft Meteorological DAta Relay) for the lower tropospheric temperature profile. While the vertical resolution and accuracy of radiosondes are high, the temporal resolution is commonly only 12 h at a given launch site. Moreover, the already sparse global coverage of radiosonde sites will be further reduced in the comming years as a result of economic pressure. Polar orbiting satellites provide temperature information of the upper and middle troposphere with a temporal resolution of typically 3-6 h. However, lower tropospheric temperature information is extremely difficult to retrieve due to surface contamination effects. In case commercial air traffic is running operationally, AMDAR measurements provide vertically highly resolved measurements of temperature with an absolute accuracy of better than 1.0 K (Drüe et al. 2008) around major airport hubs of the word. However these measurements are more frequent during daytime and are subject to natural hazards, i.e. volcanic eruptions or extreme weather events.
+Current weather forecast models rely on a) radiosondes, b) polar-orbiting satellites and c) ascending/descending commercial aircrafts at major airline hubs (AMDAR: Aircraft Meteorological DAta Relay) for the lower tropospheric temperature profile. While the vertical resolution and accuracy of radiosondes are high, the temporal resolution is commonly only 12 h at a given launch site. Moreover, the already sparse global coverage of radiosonde sites will be further reduced in the coming years as a result of economic pressure. Polar orbiting satellites provide temperature information of the upper and middle troposphere with a temporal resolution of typically 3-6 h. However, lower tropospheric temperature information is extremely difficult to retrieve due to surface contamination effects. In case commercial air traffic is running operationally, AMDAR measurements provide vertically highly resolved measurements of temperature with an absolute accuracy of better than 1.0 K (Drüe et al. 2008) around major airport hubs of the word. However these measurements are more frequent during daytime and are subject to natural hazards, i.e. volcanic eruptions or extreme weather events.
 Within this COST action ''ground-based remote sensing'' instruments have been identified for atmospheric temperature profiling of the lower troposphere. Advantages of these instruments in comparison to the above-mentioned platforms are continuous measurements with higher temporal resolution, i.e. on the order of minutes. Also the remote sensing systems are typically very sensitive towards the boundary layer temperature profile, complementing polar-orbiting satellite measurements. Next to the temporal aspect, MWR distributed at stations without regular radiosonde launches can add additional information in space. As shown by Löhnert et al. (2007), the optimal combination of available radiosonde data with continuously measuring microwave profilers has the potential to improve the 4D temperature field within a measurement domain.
 ==== Available techniques ====
-Several ground-based remote sensing techniques for temperature profiling the lower troposphere are available. Due to their suitability for operational measurements and widespread European distribution (i.e. organized within the new international Microwave Radiometer Network [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]), microwave profilers have been in the main focus of EG-CLIMET (see [[:Microwave_radiometers_for_temperature_profiling | Microwave radiometers for temperature profiling]]) and are suited for fulfilling the WMO User Requirements within the next years. Additionally, some of the wind profiler stations within [http://www.metoffice.gov.uk/research/weather/ewinprof E-WINPROF] are also equipped with a Radio Acoustic Sounding System (RASS), which also offers the possibility of operational temperature sounding. Additionally, some of the [http://www.actris.net/Stations/tabid/4319/language/en-GB/Default.aspx European Atmospheric Observatories (AO)] have been equipped with infrared spectrometers, which can deliver temperature profile information in clear-sky conditions. Raman lidar seems also a promising technology for future applications. The latter three measurement principles are shortly highlighted below, while the potential of microwave radiometers is discussed in detail.
+Several ground-based remote sensing techniques for temperature profiling the lower troposphere are available. Due to their suitability for operational measurements and widespread European distribution (i.e. organized within the new international Microwave Radiometer Network [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]), microwave profilers have been in the main focus of EG-CLIMET (see [http://wiki.eg-climet.org/index.php?title=Microwave_radiometer Microwave radiometers]) and are suited for fulfilling the WMO User Requirements within the next years. Additionally, some of the wind profiler stations within [http://www.metoffice.gov.uk/research/weather/ewinprof E-WINPROF] are also equipped with a Radio Acoustic Sounding System (RASS), which also offers the possibility of operational temperature sounding. Additionally, some of the [http://www.actris.net/Stations/tabid/4319/language/en-GB/Default.aspx European Atmospheric Observatories (AO)] have been equipped with infrared spectrometers, which can deliver temperature profile information in clear-sky conditions. Raman lidar seems also a promising technology for future applications. The latter three measurement principles are shortly highlighted below, while the potential of microwave radiometers is discussed in detail.
-'''''Infrared spectrometer''''': Passive observations in the infrared can be used to obtain temperature profile information. ”Passive” in this sense means that the instrument only receives natural radiation of the atmosphere without actively emitting any radiation itself. High spectral resolution infrared observations contain information on the vertical profile of temperature due to the spectral absorption features of carbon dioxide. If homogeneous mixing of carbon dioxide is assumed, the changes of the corresponding line shapes can solely be attributed to the vertical temperature structure, e.g. in the spectral region around <math>14 \mu m</math>. Löhnert et al. (2009) demonstrated that an infrared spectrometer can provide more than twice the information on the temperature profile than a zenith-looking microwave profiler during clear-sky cases (Fig. 1). However their profiling capability during the presence of clouds is limited because measurements are easily saturated in the presence of even very low-liquid water content clouds. Also, in clear-sky conditions infrared spectrometer methods need information on aerosol loading and trace gases in order to infer thermodynamic profiles with sufficient accuracy. Additionally, their calibration requires continuous monitoring and robust all-weather operation currently still proves difficult. Currently, only a few instruments are measuring worldwide for research purposes and no sophisticated network structure has yet been conceived.
+'''''Infrared spectrometer''''': Passive observations in the infrared can be used to obtain temperature profile information. ”Passive” in this sense means that the instrument only receives natural radiation of the atmosphere without actively emitting any radiation itself. High spectral resolution infrared observations contain information on the vertical profile of temperature due to the spectral absorption features of carbon dioxide. If homogeneous mixing of carbon dioxide is assumed, the changes of the corresponding line shapes can solely be attributed to the vertical temperature structure, e.g. in the spectral region around <math>14 \mu m</math>. Löhnert et al. (2009) demonstrated that an infrared spectrometer can provide more than twice the information on the temperature profile than a zenith-looking microwave profiler during clear-sky cases (Fig. 3.1.1). However their profiling capability during the presence of clouds is limited because measurements are easily saturated in the presence of even very low-liquid water content clouds. Also, in clear-sky conditions infrared spectrometer methods need information on aerosol loading and trace gases in order to infer thermodynamic profiles with sufficient accuracy. Additionally, their calibration requires continuous monitoring and robust all-weather operation currently still proves difficult. Currently, only a few instruments are measuring worldwide for research purposes and no sophisticated network structure has yet been conceived.
-[[File:Tprofexam.gif|200px|thumb|left|'''Figure 1''': Profiles of temperature for a summer and winter case at Payerne, Switzerland. Shown are radiosonde measurements (black), microwave retrievals using zenith measurements only (green), and infrared spectrometer retrievals (red). Adapted from Löhnert et al. (2009).]]
+[[File:Tprofexam.gif|200px|thumb|left|'''Figure 3.1.1''': Profiles of temperature for a summer and winter case at Payerne, Switzerland. Shown are radiosonde measurements (black), microwave retrievals using zenith measurements only (green), and infrared spectrometer retrievals (red). Adapted from Löhnert et al. (2009).]]
 '''''RASS''''': Radio Acoustic Sounding Systems are able to measure the speed of sound waves as a function of height, from which the profile of the atmospheric virtual temperature can be derived (Wilczak et al., 1996). A RASS consists of a [[:Radar_wind_profiler | wind profiler radar]] combined with an acoustic source. The transmitted sound waves create artificial inhomogeneities in the refractive index field, which propagate with the speed of sound. Due to its sensitivity to refractive index variations, the wind profiler can measure the speed of sound. Since the speed of sound is dependent on temperature and humidity, the profile of virtual temperature can be retrieved. Depending on the configuration of the system a vertical resolution on the order of 100 to 500 m can be obtained with absolute uncertainties below 1K. The most important source of uncertainty is caused by turbulent vertical air motion. The measured speed of sound is the true speed of sounded added to the background vertical air motion. To compensate for this error most RASS systems measure the acoustic speed and the vertical air speed simultaneously. However, whether this correction is applied in real time depends on the data processing of each specific system. Due to the strong attenuation of the acoustic signals, the vertical range of RASS is generally lower than that of the wind profilers. Depending on system and the atmospheric conditions, RASS can profile virtual temperature up to heights ranging from 0.5 to 4 km.
-Only a few (how many?) of the 31 wind profilers within E-WINPROF are currently equipped with RASS technology. These data are processed simultaneously to the wind vector profiles, however are not further injected further into any forecasting system. Currently there are no plans for expanding the spatial coverage of RASS technology within E-WINPROF, nor for assimilating this data into NWP. However, a combination with microwave profiler at the E-WINPROF sites could help deriving an optimized temperature product throughout the full depth boundary layer.
+Only a few of the 31 wind profilers within E-WINPROF are currently equipped with RASS technology. These data are processed simultaneously to the wind vector profiles, however are not further injected further into any forecasting system. Currently there are no plans for expanding the spatial coverage of RASS technology within E-WINPROF, nor for assimilating this data into NWP. However, a combination with microwave profiler at the E-WINPROF sites could help deriving an optimized temperature product throughout the full depth boundary layer.
 '''''Raman Lidar''''': [[:Raman_Lidar | Raman Lidar]] uses the scattering properties of molecules and aerosols to derive profiles of water vapor, aerosols and temperature with a high vertical and temporal resolution. Raman Lidars can cover an altitude range from a few hundreds of meters to the lower stratosphere. In contrast to classical backscatter Lidar that relies on elastic scattering, Raman Lidar makes use of the ''inelastic scattering'' where the scattering molecule changes its vibrational and/or rotational energy state and by this changes the wavelength of the scattered photon. The change in wavelength depends on the two involved energy levels and is specific for the scattering molecule. Since the population of the energy states follows a Boltzman distribution, the Raman backscatter coefficient depends on temperature, which states the physics behind the rotational Raman technique to measure atmospheric temperature (Vaughan et al., 1993).
@@ Line 147: / Line 127: @@
 [[:Microwave_radiometer | MicroWave Radiometers (MWR)]] for temperature profiling measure passively at several frequencies along the [[:MWR_Fundamentals#Microwave_absorption_and_emission_of_the_troposphere|60-GHz oxygen absorption complex]] from the ground as well as from space. A clear advantage of using passive microwave measurements for temperature profiling is the semi-transparency with respect to liquid water clouds. Microwave signals around 50-60 GHz do not saturate due to clouds yielding that profiles of temperature may be derived is cloudy and clear-sky cases.
 The spectral absorption features of oxygen in the microwave region allow for retrieving information on the vertical structure of temperature. The homogeneous mixing of oxygen within the troposphere results in the fact that changes of the corresponding line shapes can solely be attributed to the vertical temperature structure. From the ground, observations are typically taken in zenith direction at about five to ten frequency channels from 50–60 GHz. Channels in the center of the absorption band are highly opaque and the observed brightness temperature (TB) is close to the environmental temperature. For frequencies further away from the center the atmosphere is less opaque and the signal systematically originates additionally from higher atmospheric layers. For ground-based observations the weighting functions at the different frequencies all decrease continuously with height and limit the vertical resolution rather than the radiometric noise. By observing the atmosphere under different elevation angles, additional information about the temperature of the lowest kilometer can be gained. One-channel systems operating around 60 GHz have been developed (Kadygrov and Pick, 1998), which derive profile information from elevation scanning when assuming horizontal homogeneity of the atmosphere. In this case, the lower the elevation angle measurement, the lower the height from which the temperature information originates. Since these TB vary only slightly with elevation angle, the method requires a highly sensitive MWR that is typically realized by using wide bandwidths up to 2 GHz. Since the use of a single highly opaque channel limits the information content to altitudes below 600 m, combined multi-channel and multi-angle observations can be used (Crewell and Löhnert, 2007) improving the accuracy in the lowest 1500 m.
-Quantitative retrieval accuracies as well as typical values of vertical resolution for microwave temperature profiling of the lower troposphere are summarized in Tab. 1. Generally, profiles can be derived up to 4 km height above ground with a high vertical resolution at the surface, which rapidly decreases above 1.5 km height. This implies that close-to-the-surface inversion can be observed very well while elevated or multiple inversions are difficult to capture.
+Quantitative retrieval accuracies as well as typical values of vertical resolution for microwave temperature profiling of the lower troposphere are summarized in Tab. 3.1.1. Generally, profiles can be derived up to 4 km height above ground with a high vertical resolution at the surface, which rapidly decreases above 1.5 km height. This implies that close-to-the-surface inversion can be observed very well while elevated or multiple inversions are difficult to capture.
-Text here
 {| class="wikitable"
-!colspan="6"|Table 1: MWR characterization for temperature profiling
+!colspan="6"|Table 3.1.1: MWR characterization for temperature profiling
 |-
 | Temporal resolution
 | Height range
-| Idependent pieces of information
+| Independent pieces of information
 | Vertical resolution
 | Accuracy
@@ Line 171: / Line 150: @@
 |}
-The accuracies (Standard DEViation STDEV with respect to radiosonde) shown in Fig. 2 underline the potential of MWR for temperature profiling during clear and cloudy situations. After the an offset correction, STDEV values are within 0.4 to 1.4 K in the lowest 2 km and increase to 1.7 K at 4 km. Above this height only 5% independent information originates from the radiometer measurement itself. The high accuracies below 1 km are primarily due to the information contained in the elevation scans (Löhnert et al. 2009).
+The accuracies (Standard DEViation STDEV with respect to radiosonde) shown in Fig. 3.1.2 underline the potential of MWR for temperature profiling during clear and cloudy situations. After the an offset correction, STDEV values are within 0.4 to 1.4 K in the lowest 2 km and increase to 1.7 K at 4 km. Above this height only 5% independent information originates from the radiometer measurement itself. The high accuracies below 1 km are primarily due to the information contained in the elevation scans (Löhnert et al. 2009).
-[[File:Terror.jpg|400px|thumb|left|'''Figure 2''': Temperature profile differences (BIAS and STDEV) during all-sky conditions from August 2006-December 2009 between MWR and radiosonde measurements at Payerne, Switzerland aerological station. Black lines show the retrieval results without using the systematic TB offset correction while green lines show the results applying the systematic TB offset correction (OC). A total number of 2107 matching MWR/radiosonde cases were considered; in 1816 cases the MWR measurements passed the quality control and are evaluated in the plot. Adapted from Löhnert and Maier 2012.]]
+[[File:Terror.jpg|400px|thumb|left|'''Figure 3.1.2''': Temperature profile differences (BIAS and STDEV) during all-sky conditions from August 2006-December 2009 between MWR and radiosonde measurements at Payerne, Switzerland aerological station. Black lines show the retrieval results without using the systematic TB offset correction while green lines show the results applying the systematic TB offset correction (OC). A total number of 2107 matching MWR/radiosonde cases were considered; in 1816 cases the MWR measurements passed the quality control and are evaluated in the plot. Adapted from Löhnert and Maier 2012.]]
-A further way to characterize accuracy and vertical resolution of passive remote sensing methods is to evaluate the degrees of freedom for signal that state the number of independently vertically resolved levels of temperature (or humidity or other) that can be determined from the measurements (Hewison (2007)). This number of independent pieces of information depends to some degree on the number of spectral channels of the observations, the noise levels and the spectral location of the channels, but also depends strongly on the spectral characteristics of the absorption lines observed. As shown in Tab. 1, microwave radiometers using a multi-frequency, multi-angle approach are able to give 4 independent pieces of temperature information in the lower troposphere (here up to 4 km).
+A further way to characterize accuracy and vertical resolution of passive remote sensing methods is to evaluate the degrees of freedom for signal that state the number of independently vertically resolved levels of temperature (or humidity or other) that can be determined from the measurements (Hewison (2007)). This number of independent pieces of information depends to some degree on the number of spectral channels of the observations, the noise levels and the spectral location of the channels, but also depends strongly on the spectral characteristics of the absorption lines observed. As shown in Tab. 3.1.1, microwave radiometers using a multi-frequency, multi-angle approach are able to give 4 independent pieces of temperature information in the lower troposphere (here up to 4 km).
 Note that temperature profiles measurements can be derived with temporal resolutions of 15 min and smaller. If an operation mode of permanent elevation scanning were chosen, temperature profiles could be derived every 2-3 minutes, however the simultaneous retrieval of integrated water vapor and cloud liquid water path (IWV, LWP) water requires periods of zenith observations in between.
 ==== Operational performance and technical implementation ====
-Rapid technological development for MWRs in the last two decades has brought forward a generation of commercially available instruments, which can, on long-term time periods, measure autonomously under varying weather conditions. Within [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]), which was initiated through EG-CLIMET, a large part of the European and US-American MWR users have linked together under the aspects of harmonization of measurement modes, data formats, meteorological parameter retrieval, advice for operations, etc. Table 2 gives an overview of the identified advantages, challenges and limitations of the proposed microwave temperature profiling system.
+Rapid technological development for MWRs in the last two decades has brought forward a generation of commercially available instruments, which can, on long-term time periods, measure autonomously under varying weather conditions. Within [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]), which was initiated through EG-CLIMET, a large part of the European and US-American MWR users have linked together under the aspects of harmonization of measurement modes, data formats, meteorological parameter retrieval, advice for operations, etc. Table 3.1.2 gives an overview of the identified advantages, challenges and limitations of the proposed microwave temperature profiling system.
-Driven by the demands stated by MWRnet, Löhnert and Maier (2011) have carried out a study to define quality control measures for operational MWR measurements. A critical point to be addressed is the automated detection/removal of liquid of frozen water on the instrument radome to guarantee uninterrupted performance also during precipitation conditions. Also, operational MWR measurements need to be monitored permanently during clear sky conditions using simple non-scattering radiative transfer models as reference for calibration stability. Such monitoring is necessary to identify possible TB offsets. TB offset corrections are essential for providing an optimized temperature profile product. Fig. 2 shows typical systematic differences that range between -0.6 and +0.3 K in the lowest 4 km if a TB offset correction is not applied. After applying the correction the overall temperature bias is in the range +-0.1 K. With respect to the WMO User Requirements for high-resolution NWP, microwave profilers can fulfill the standards for temperature profiling if operators agree on standardized calibration and operation procedures within a network such as MWRnet.
+Driven by the demands stated by MWRnet, Löhnert and Maier (2012) have carried out a study to define quality control measures for operational MWR measurements. A critical point to be addressed is the automated detection/removal of liquid of frozen water on the instrument radome to guarantee uninterrupted performance also during precipitation conditions. Also, operational MWR measurements need to be monitored permanently during clear sky conditions using simple non-scattering radiative transfer models as reference for calibration stability. Such monitoring is necessary to identify possible TB offsets. TB offset corrections are essential for providing an optimized temperature profile product. Fig. 3.2.2 shows typical systematic differences that range between -0.6 and +0.3 K in the lowest 4 km if a TB offset correction is not applied. After applying the correction the overall temperature bias is in the range +-0.1 K. With respect to the WMO User Requirements for high-resolution NWP, microwave profilers can fulfill the standards for temperature profiling if operators agree on standardized calibration and operation procedures within a network such as MWRnet.
 {| class="wikitable"
-!colspan="6"|Table 2: MWR performance for temperature profiling
+!colspan="6"|Table 3.1.2: MWR performance for temperature profiling
 |-
 | Advantages
@@ Line 208: / Line 187: @@
 A network of microwave profilers bears potential for improving short-term weather forecasts as well as nowcasting applications. While the advantages of high temporal resolution and un-manned routine observations must be stressed, a limited vertical resolution (with respect to radiosondes) and corresponding random error inherent within the measurement principle must be kept in mind. Microwave profilers allow the addition of information on the stability development in the boundary layer between two consecutive radiosondes launched typically at 12 hourly intervals. This is particularly important during weather conditions that are triggered by the boundary layer, when timely soundings are crucial for accurate local forecasting.
-Microwave profilers state current emerging technology that will be able to provide operational and quality controlled temperature profiles in the near future. Note that most microwave profilers are also capable of providing humidity and cloud liquid water content informatio (see sections [[:Final_Report#Humidity_profile|4.2]] and [[:Final_Report#Liquid_clouds | 4.7]]). Within EG-CLIMET MWRnet has been established as a prototype of a worldwide microwave radiometer network setting up common calibration and operation procedures for microwave radiometers to guarantee continuous, unified and quality-controlled temperature profiles. In this respect EG-CLIMET recommends the following:
+Microwave profilers state current emerging technology that will be able to provide operational and quality controlled temperature profiles in the near future. Note that most microwave profilers are also capable of providing humidity and cloud liquid water content informatio (see sections [[:Final_Report#Humidity_profile|3.2]] and [[:Final_Report#Liquid_clouds | 3.7]]). Within EG-CLIMET MWRnet has been established as a prototype of a worldwide microwave radiometer network setting up common calibration and operation procedures for microwave radiometers to guarantee continuous, unified and quality-controlled temperature profiles. In this respect EG-CLIMET recommends the following:
 *Further '''consolidation of MWRnet''' to be able to provide near-real-time, quality controlled temperature profiles on an openly available platform in the near future.
@@ Line 218: / Line 197: @@
 === Humidity profile ===
-Contributors: N. Cimini, H. Czekala, U. Löhnert, J. Güldner, O. Maier, ...
 Water vapor is one of the most relevant component of the atmosphere, controlling both weather and climate and playing a central role in atmospheric chemistry. Water vapor is the dominant greenhouse gas in the Earth's atmosphere, contributing for 2/3 of the whole green-house effect. The distribution of water vapour is highly variable, both in time and space, spanning more than 3 orders of magnitude (in terms of ppmv) in the vertical distribution over the troposphere.
@@ Line 229: / Line 207: @@
 As a conseguence, the humidity in the lower troposphere (including the planetary boundary layer) is highly under-observed.
-The [http://www.wmo-sat.info/db/ WMO Observing Requirements Database] sets the goal, breakthrough, threshold values for the uncertainty, observing cycle, horizontal and vertical resolution for lower tropospheric specific humidity observations, as reported in Table 1.
+The [http://www.wmo-sat.info/db/ WMO Observing Requirements Database] sets the goal, breakthrough, threshold values for the uncertainty, observing cycle, horizontal and vertical resolution for lower tropospheric specific humidity observations, as reported in Table 3.2.1.
 {| class="wikitable"
-!colspan="5"|Table 1: WMO Observing Requirements for specific humidity profiling in the lower troposphere
+!colspan="5"|Table 3.2.1: WMO Observing Requirements for specific humidity profiling in the lower troposphere
 |-
 | '''CLIMATE'''
@@ Line 296: / Line 274: @@
 ==== Available Techniques ====
-'''''What is the instrument (combination) most suited for the retrieval of your parameter and why was it chosen?'''''
 Tropospheric humidity profiles may be measured by in-situ soundings and several ground-based remote sensing techniques, including the following:
-* Infrared spectrometers
+* Infrared spectrometer
 * Raman lidar
 * Differential Absorption Lidar (DIAL)
 * GNSS tomography
-* MWR operating at 20-30 GHz
+* MWR humidity profilers
-* Other ??
-Some of the [http://www.actris.net/Stations/tabid/4319/language/en-GB/Default.aspx European Atmospheric Observatories (AO)] are equipped with infrared spectrometers, which can deliver humidity profile information in clear-sky conditions. Also, most of the lidar stations belonging to the European network [http://www.earlinet.org/ EARLINET] deploy Raman lidars for humidity profiling, while DIAL systems have still relatively sparse distribution. Microwave radiometer profilers have wider distribution in Europe, recently organized within the International Microwave Radiometer Network [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]. Water vapor tomography based on Global Navigation Satellite System (GNSS) relies on ground-based GNSS receivers, which have a much higher density with respect to the other instrumentation above, e.g. [http://www.epncb.oma.be/ EUREF].
+Some of the [http://www.actris.net/Stations/tabid/4319/language/en-GB/Default.aspx European Atmospheric Observatories (AO)] are equipped with infrared spectrometers, which can deliver humidity profile information in clear-sky conditions. Also, most of the lidar stations belonging to the European network [http://www.earlinet.org/ EARLINET] deploy Raman lidars for humidity profiling, while DIAL systems have still relatively sparse distribution. Microwave radiometer (MWR) profilers have wider distribution in Europe, recently organized within the International Microwave Radiometer Network [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]. Water vapor tomography based on Global Navigation Satellite System (GNSS) relies on ground-based GNSS receivers, which have a much higher density with respect to the other instrumentation above, e.g. [http://www.epncb.oma.be/ EUREF].
 The principles, advantages and limitations of these techniques are shortly introduced below, while the potential of microwave radiometers is discussed in more detail.
-'''''Infrared spectrometer''''': Passive observations in the infrared can be used to obtain humidity profile information, similarly to temperature. High spectral resolution infrared observations contain information on the vertical profile of water vapor due to its spectral absorption features in the spectral region within <math>8-13 \mu m</math> and around <math>18 \mu m</math>. Löhnert et al. (2009) demonstrated that an infrared spectrometer can provide more degrees of freedom for signal (DFS), i.e. piece of independent information, on the humidity profile than a zenith-looking microwave profiler (Fig. 1), though the first depends more on the total water vapour content and it is limited to clear-sky only. Also, in clear-sky conditions infrared spectrometer methods need information on aerosol loading and trace gases in order to infer thermodynamic profiles with sufficient accuracy.
-'''Performances, advantages, limitation'''
-[[File:DFS_MidLat_Tropics.png|300px|thumb|left|'''Figure 1''': The distribution of DFS in zenith spectral MWR observations (MZ), elevation scanning MWR observations (ME), and Infrared spectrometer (AE) observations for profiles of temperature (left) and water vapor (right) at a mid-latitude (Payerne, top) and tropical (Darwin, bottom) site. Adapted from Löhnert et al. (2009).]]
-'''''Raman LIDAR''''': Raman lidar is a very powerful method to measure tropospheric water vapor profiles. With a temporal resolution of typically 30 min and a vertical resolution in the order of meters, Raman lidars are able to resolve the extremely high variability of water vapor (Fig.2). The measurement principle and the inversion are described in [[Raman Lidar]]. The relative random error is reported in the range of 2 to 10% depending on altitude and background noise level (daylight). The water vapor profile has to be calibrated with an external measurement like radiosonde, or, as mentioned above, other remote sensing measurements like MWR. Raman lidar water vapor measurements are only possible under non-precipitating conditions and below clouds.
+'''''Infrared spectrometer''''': Passive observations in the infrared can be used to obtain humidity profile information, similarly to temperature. High spectral resolution infrared observations contain information on the vertical profile of water vapor due to its spectral absorption features in the spectral region within <math>8-13 \mu m</math> and around <math>18 \mu m</math>. The so-called “onion-peeling” method has been used for over a decade for temperature and humidity profiling from infrared spectrometers (Smith et al., 1999; Feltz et al., 1998). This technique doesn’t yield information on the error covariance matrix of the retrieved profiles, thereby making it difficult to assimilate the data into a numerical model. More recently  Optimal Estimation (OE) methods have been used. This iterative technique uses a priori information,
-'''Performances, advantages, limitation'''
+together with the sensitivity of the forward model, to retrieve the entire profile of temperature and humidity simultaneously, providing the uncertainty covariance matrix of the retrieved temperature and humidity profiles (Feltz et al., 2005). A long history of infrared spectrometer observations exist, with nearly two dozen systems deployed world-wide, many of which are providing long-term monitoring.
-[[File:RamanWaterVapor.png|300px|thumb|right|'''Figure 2''': 2D time seris of water vapor mixing ratio above Payerne, Switzerland, measured by Raman lidar.]]
+[[File:DFS_MidLat_Tropics.png|300px|thumb|left|'''Figure 3.2.1''': The distribution of DFS in zenith spectral MWR observations (MZ), elevation scanning MWR observations (ME), and Infrared spectrometer (AE) observations for profiles of temperature (left) and water vapor (right) at a mid-latitude (Payerne, top) and tropical (Darwin, bottom) site. Adapted from Löhnert et al. (2009).]]
+[[File:Hum_RMSE_BIAS_Payerne_Darwin_from_Lohnert2009.png|300px|thumb|left|'''Figure 3.2.2''': Simulated humidity profiling performances (left: root-mean-square-error; right: bias) from Microwave radiometer zenith observations (MZ), infrared spectrometer observations (AE), two different combined microwave and infrared retrievals (MZAE and MZAE4), and a priori (APR) at a mid-latitude (Payerne, top) and tropical (Darwin, bottom) site. Adapted from Löhnert et al. (2009).]]
+'''Performances''': An infrared spectrometer can provide more degrees of freedom for signal (DFS), i.e. piece of independent information, on the humidity profile than a zenith-looking microwave profiler, as demonstrated by Löhnert et al. (2009) (Fig. 3.2.1), though the first depends more on the total water vapour content and it is limited to clear-sky only. Simulated results in Figure 3.2.2 (adapted from Löhnert et al., 2009) show that in clear sky, humidity profiles from infrared spectrometer (AE, in red) are 30-50% more accurate than those provided by microwave radiometer (MZ, in green) for a midlatitude site (top), while much less pronounced for a tropical site (bottom), where MZ actually outperforms AE above 2 km.
+'''Advantages''': Infrared spectrometers offer relatively high information content on the vertical profile of water vapor related to other passive profilers. Due to their calibration approach, both the absolute calibration and the sensitivity of the instrument is monitored, which makes these observations particularly well suited for long-term observations that can be used to develop climatology and trend analyses (Gero and Turner, 2011). Infrared spectrometers can operate day and night.
+'''Limitations''': One limitation to humidity profiling with ground-based infrared spectrometers is the presence of clouds above the instrument. Also, in clear-sky conditions infrared spectrometer methods need information on aerosol loading and trace gases in order to infer thermodynamic profiles with sufficient accuracy. Retrievals of thermodynamic profiles from ground-based IR observations in precipitating conditions are not possible. Another limitation is the low vertical resolution of the humidity profiles, which is higher than for microwave radiometers, but still much lower than for active sensors (as lidars).  Infrared spectrometers need to be housed at laboratory temperatures leaving the front end in the ambient environment, which requires a proper infrastructure. These systems are typically configured to only view the atmosphere in the zenith direction.
+'''''Raman LIDAR''''': Raman lidar is a very powerful method to measure tropospheric water vapor profiles. The measurement principle and the inversion are described in [[Raman Lidar]]. The water vapor profile has to be calibrated with an external measurement like radiosonde or other remote sensing measurements like MWR. Only recently, new methods have removed this requirement by using a NIST traceable light source to determine the calibration with less than 3% relative uncertainty (Venable et al., 2011).
+[[File:RamanWaterVapor.png|300px|thumb|right|'''Figure 3.2.3''': 2D time series of water vapor mixing ratio above Payerne, Switzerland, measured by Raman lidar.]]
+'''Performances''': With a temporal resolution of typically 30 min and a vertical resolution in the order of meters, Raman lidars are able to resolve the extremely high variability of water vapor (Fig.3.2.3). The relative random error is reported in the range of 2 to 10% depending on altitude and background noise level (daylight).
+'''Advantages''': The Raman lidar system gives very high vertical and temporal
+resolution profiles of water in the troposphere. Unlike passive remote sensing instruments that require inversion schemes, the Raman lidar technique allows for a direct method of profiling water vapor mixing ratio amounts. Furthermore, for each profile, accurate estimates of the error covariance matrix can be determined in dependence of weather conditions.
+'''Limitations''': Up to now, no commercial Raman water vapor lidars exist. The exisiting systems for applications in research and operational meteorology are mostly prototypes and require an important maintenance effort to achieve a high data availability. Raman lidar water vapor measurements are only possible under non-precipitating conditions and below clouds. Because of the solar radiation interference, the daytime profiling capability is limited; for most systems this maximum daytime altitude for the water vapor mixing
+ratio profile is about 4-6 km. These laser systems require temperature controlled housing for optimal operation. Other protective designs from rain and/or hail need to be installed to safeguard the telescope and associated electronics. The incomplete overlap of the laser beam and the receiver telescope field of view limits the first usable range to some 100 meters, depending on the lidar design properties.
+'''''DIAL''''': The Differential Absorption Lidar (DIAL) is a powerful technique to measure water vapor profiles without the need of a external calibration source. In fact, water vapor profiles are retrieved by measuring the differential absorption in the backscatter signals at two close wavelengths: a water vapor DIAL transmit laser pulses at two wavelengths, one on a water vapor absorption line and the other outside the absorption line. The two wavelengths are chosen close enough to consider the scattering by molecules and particles essentially equal at the two wavelengths. Therefore, any difference in the lidar backscatter can be entirely attributed to water vapor absorption. The ratio of the backscatter measured at both wavelengths as a function of range can be directly linked to the profile of water vapor concentration. Ground based DIAL systems have
+been demonstrated recently for quasi-operational observations.
+'''Performances''': High-power DIAL systems demonstrated the highest accuracy and resolution of all water-vapor remote sensing technologies yet. The accuracy is mainly determined by laboratory measurements of the water-vapor absorption cross section in the wavelength range of interest.
+'''Advantages''': Obviously, no calibration of the DIAL system is required. The combination of spatial and temporal resolution up to the upper troposphere (few 100 m and min) fulfills the requirements for data assimilation in mesoscale models during daytime and nighttime. Low-power compact DIAL systems are interesting and affordable options for future water vapor remote sensing networks.
+'''Limitations''': DIAL systems are affected by the overlap issue (same as the Raman lidar above) in the first some 100 meters. Current instruments are quasi-operational. High-power DIAL systems are expensive and typically require significant scientific technical expertise. Work is ongoing to improve low power DIAL systems to enable daytime operation in regions of high water vapor. Water vapor profiling DIAL systems are not commercially available yet.
+'''''GNSS Tomography''''': Remote sensing of the atmosphere with the microwave signal of the Global Navigation Satellite Systems (GNSS) has become a well-established field of research. The primary use of these signals is the positioning of receiving antennas on or within several 100 kilometers around the earth. The waves passing the atmosphere are affected by the ion concentration in the ionosphere and by the air density in the lower stratosphere and in the troposphere. These influences can be retrieved to a certain degree in the processing of the GNSS data with sophisticated software packages, yielding for example an integral measure of the water vapor content above a GNSS station. With a receiver network, the integral measure can be used to reconstruct a 3D field of wet refractivity, which depends on both atmospheric temperature and humidity (water vapor pressure). The spatial resolution of such a field depends on the number of stations that are deployed. In regions with complex orography, where the terrain allows stations to be placed at various heights above mean sea level, it is possible to retrieve vertical information on the wet refractivity field in the available vertical range and at a very limited resolution above the top station of the network (Champollion et al., 2005; Perler et al., 2011).
+The International Association of Geodesy has set up a  Sub-Commission on Remote sensing and modeling of the atmosphere with the objectives, among others, to investigate the development and enhancement of the GNSS-based sounding techniques, e.g. neutral atmosphere/ionosphere tomography, GNSS reflectometry/scatterometry for altimetry, meteorology, and soil moisture. The new GNSS signals’ structures for GNSS based atmospheric remote sensing are also studied and additional platforms for GNSS based atmospheric remote sensing (buoys, aircrafts, balloons, more dense ground networks, Low Earth Orbiting constellations) are suggested.
-'''''DIAL''''': The Differential Absorption Lidar (DIAL) is a powerful technique to measure water vapor profiles without the need of a external calibration source. In fact, water vapor profiles are retrieved by measuring the differential absorption in the backscatter signals at two close wavelengths: a water vapor DIAL transmit laser pulses at two wavelengths, one on a water vapor absorption line and the other outside the absorption line. The two wavelengths are chosen close enough to consider the scattering by molecules and particles essentially equal at the two wavelengths. Therefore, any difference in the lidar backscatter can be entirely attributed to water vapor absorption. The ratio of the backscatter measured at both wavelengths as a function of range can be directly linked to the profile of water vapor concentration.
+'''Performances''': The capability of the tomography to investigate the diurnal cycle of water vapor in a coastal area was shown by (Bastin et al., 2007). (Bender et al., 2011) demonstrate that near real-time processing of a large GNSS station network in Germany with dedicated tomography software is possible and show a qualitative comparison to a NWP model analysis. Another study assesses the uncertainty of the tomographic reconstruction for the wet refractivity at Payerne for a one year study period to be 10 mm km-1 at the ground and 6 mm km-1 at 4500 above m.s.l. (Perler, 2011). (Nilsson et al., 2007) arrives at 4-5 mm km-1 absolute difference to a radiosonde reference and an accuracy of 10% most of the time for the refractivity in the lower 2km of the troposphere. Recent investigations combining wet refractivities from GNSS with temperature profiles of V-band radiometers to derive humidity profiles (Hurter and Maier, 2012) show temporal resolution and a quality comparable to remote sensing with a K-band microwave radiometer, with a vertical resolution being representative of meteorological events in the boundary layer.
-'''Performances, advantages, limitation'''
+'''Advantages''': Rather simple deployment of passive, stable all-weather instruments, high data availability, financing being shared with other applications (GNSS reference networks for positioning) and low maintenance make GNSS an attractive source of information for the spatial distribution of water vapor in mountainous topography. Furthermore, its spatial and temporal resolution is somewhat in between the other available water vapor measurement techniques and could bridge the sampling gap between those techniques.
+'''Limitations''': Derivation of humidity from GNSS requires an accurate 3D field of atmospheric temperature. Therefore, tomography retrievals are currently not judged as the best way to insert information about humidity into NWP models. Instead the integration of humidity information from GNSS data in NWP models might be more successful with the assimilation of path delays, which could be accomplished with a statistical data assimilation scheme (such as 3DVAR, 4DVAR or ensemble kalman filter) in a mathematically thorough way and using information on model and observation uncertainty. Results from assimilation tests using GPS derived slant water vapor are for example given in (de Haan and van der Marel, 2008). The forward operator to be implemented into a NWP model corresponds to the operator used in the water vapor tomography. Experience gained therein can thus help to assimilate path delays.
-'''''GNSS Tomography''''': GNSS (Global Navigation Satellite System) receivers are able to deliver integrated atmospheric water vapor information at temporal resolution of ~30 minutes. With a receiver network, this information can be used to reconstruct a 3D field of wet refractivity, which depends on both atmospheric temperature and humidity (water vapor pressure). The spatial resolution of such a field depends on the number of antennas that are deployed. In regions with complex orography, where the terrain allows antennas to be placed at various heights above mean sea level, it is possible to retrieve vertical information on the wet refractivity field in the available vertical range.
-'''Performances, advantages, limitation'''
-'''''MWR''''': Water vapour has distinct spectral features at 22.235 and 183 GHz. Dual channel ground-based MWR make use of the rotational line at 22.235 GHz to derive the vertically integrated water vapour (IWV). Within this method one channel measures at a frequency close to the line centre (around 24 GHz) where water vapour absorption is almost independent of height. In clear-sky conditions, the observed brightness temperature is approximately proportional to IWV. The second channel is located in a window region where water vapour and oxygen absorption are relatively low (for example 31.4 GHz), and the emission is related to the presence of liquid clouds. The two-channel combination is thus able to retrieve simultaneously IWV and the liquid water path (LWP), which is the vertically integrated liquid water density. Specifications of the accuracy vary between 0.3 and 1 kg m-2 for IWV and 20 to 30 gm-2 for LWP. Sometimes microwave IWV measurements from the ground are used to scale radiosonde or water vapor lidar measurements (e.g., Turner et al., 2003 and Turner and Goldsmith, 1999). Improvements in accuracy can be made by using additional frequencies with higher sensitivity to liquid water (i.e. 90 GHz) to further constrain the retrieval problem (Crewell and Löhnert, 2003).
+'''''MWR''''': Water vapour has distinct spectral features at 22.235 and 183 GHz. Dual channel ground-based MWR make use of the rotational line at 22.235 GHz to derive the vertically integrated water vapour (IWV). The two-channel combination is thus able to retrieve simultaneously IWV and the liquid water path (LWP). Water vapour profiles are derived from microwave profilers that measure the atmospheric emission at several frequencies along the wings of pressure-broadened rotational lines. From the ground the 22.235 GHz line is usually used whereas at low humidity conditions the strong 183 GHz water vapour line is more suitable (Cimini et al., 2010). Microwave radiometers have been run operationally for multiple years in a wide range of different environments, from the tropics (+40°C) to the Arctic (-35°C). MWR technology has matured so far that more than a hundred systems operate continuously worldwide.
-Water vapour profiles are derived from microwave profilers that measure the atmospheric emission at several frequencies along the wings of pressure-broadened rotational lines. From the ground the 22.235 GHz line is usually used whereas at low humidity conditions the strong 183 GHz water vapour line is more suitable (Cimini et al., 2010). With a pressure broadening of about 3 MHz/hPa tropospheric profiling can be realized with several channels spaced by a few GHz along the line. However, the vertical resolution of water vapour profiles is relatively low, with approximately 1 to 3 DFS (Fig.1), as shown in Löhnert et al. (2009).
+'''Performances''': Specifications of the accuracy vary between 0.3 and 1 kg/m2 for IWV and 20 to 30 g/m2 for LWP. Improvements in accuracy can be made by using additional frequencies with higher sensitivity to liquid water (i.e. 90 GHz) to further constrain the retrieval problem (Crewell and Löhnert, 2003). Typical root-mean-square difference with respect to radiosonde are 0.7-1.5 g/m3 up in the first 5 km, depending upon IWV, and decreasing with water vapor content above that (Fig.3.2.2). With a pressure broadening of about 3 MHz/hPa tropospheric profiling can be realized with several channels spaced by a few GHz along the line. However, the vertical resolution of water vapour profiles is relatively low, with approximately 1 to 3 DFS (Fig.3.2.1), as shown in Löhnert et al. (2009).
+'''Advantages''': Microwave radiometers can provide unattended measurements of water vapor at high temporal resolution (<30s) during all weather conditions except during precipitation. They are passive instruments requiring no transmitted power. Day- and night-time operation are equivalent performances. Hardware components are rather reliable over several years.
+Unlike for temperature profiling, elevation scanning is not beneficial for water vapor retrievals, but azimuth scans are useful to characterize site representativeness in terms of humidity and cloud variability (Kneifel et al., 2009), and to estimate water vapor gradients (Schween et al., 2011), though reducing zenith observation time.
+Sometimes microwave IWV measurements from the ground are used to scale radiosonde or water vapor lidar measurements.
+The combination of few scanning radiometers is also proposed for tomography of water vapor (Padmanabhan et al., 2009) and cloud liquid (Huang et al., 2008).
+'''Limitations''': The number of degrees of freedom in the microwave retrieval is low (generally <2 independent pieces of information, Fig. 3.2.1), and thus the vertical resolution of humidity retrievals. The absolute calibration of MWR still poses some challenges. Tipping curve calibrations (Han and Westwater, 2000) require homogeneous conditions which may be difficult to find in practice. Cryogenic liquid nitrogen (LN2) calibrations suffer from uncertain knowledge of the liquid nitrogen refractivity and practical issues over handling, transportation, and operator safety.
+Due to the increased use of wireless communication, Radio Frequency Interference (RFI) may appear even at protected frequencies, e.g., 24 GHz.
+The main practical limitation to these microwave radiometer observations is the need to keep liquid
+water off of the radome, as this could contaminate the atmospheric retrievals. Operational MWRs are equipped with rain and dew mitigation techniques, typically hygroscopic windows, blowers, and heaters. Radiometer periphery is likely to be subject of damage. Inspection by eye and cleaning of external components, i.e., radome and infrared gold mirror, is recommended every couple of months. The quality of the radome can be affected by birds, UV radiation, etc., requiring replacement roughly every year.
 ==== Retrieval algorithms and errors ====
 Humidity profiling by [[:Microwave_radiometer | MicroWave Radiometers (MWR)]] relies on the passive measurement of thermal emission by atmospheric water vapor. The water vapor absorption line at 22.235 GHz is mostly used, though the higher sensitive 183.3 GHz line is also used in dry environments. A clear advantage of using passive microwave measurements with respect to the other techniques is that humidity profiles can be retrieved also in cloudy conditions, as the emission of ice clouds is negligible and the contribution of liquid water clouds can be effectively accounted for.
-From the ground, observations are typically taken in zenith direction at about five to ten frequency channels from 20–30 GHz. Channels closer to the line center correspond to higher absorption (i.e. higher brightness temperature). The atmospheric opacity at these channels is relatively low (<math>\sim 0.1</math>, see a typical [[:MWR_Fundamentals#Microwave_absorption_and_emission_of_the_troposphere|10-100 GHz opacity spectrum]]) and thus the radiation comes from throughout the atmosphere and beyond. Consequently, the weighting functions at the different frequencies are quite constant with height and do not change shape significantly with elevation angle. Therefore, water vapor retrievals from MWR are characterized by low vertical resolution; approximately 1 to 3 DFS are available, slightly depending on water content and almost independently on elevation angle (see Fig.1), as shown in Löhnert et al. (2009). However, combined multi-channel and multi-angle observations are often used to better constrain the retrieval problem and improve tha accuracy (Crewell and Löhnert, 2007).
+From the ground, observations are typically taken in zenith direction at about five to ten frequency channels from 20–30 GHz. Channels closer to the line center correspond to higher absorption (i.e. higher brightness temperature). The atmospheric opacity at these channels is relatively low (<math>\sim 0.1</math>, see a typical [[:MWR_Fundamentals#Microwave_absorption_and_emission_of_the_troposphere|10-100 GHz opacity spectrum]]) and thus the radiation comes from throughout the atmosphere and beyond. Consequently, the weighting functions at the different frequencies are quite constant with height and do not change shape significantly with elevation angle. Therefore, water vapor retrievals from MWR are characterized by low vertical resolution; approximately 1 to 3 DFS are available, slightly depending on water content and almost independently on elevation angle (see Fig.3.2.1), as shown in Löhnert et al. (2009). However, combined multi-channel and multi-angle observations are often used to better constrain the retrieval problem and improve tha accuracy (Crewell and Löhnert, 2007).
-In Tab.2 reports a summary of the quantitative retrieval accuracies and typical values for vertical resolution for microwave humidity profiling.
+In Tab.3.2.2 reports a summary of the quantitative retrieval accuracies and typical values for vertical resolution for microwave humidity profiling.
 {| class="wikitable"
-!colspan="6"|Table 2: MWR characterization for humidity profiling
+!colspan="6"|Table 3.2.2: MWR characterization for humidity profiling
 |-
 | Temporal resolution
 | Height range
-| Idependent pieces of information
+| Independent pieces of information
 | Vertical resolution
 | Accuracy
@@ Line 347: / Line 352: @@
 incresing with height from 0.5 to 3 km in the troposphere (defined as the inter-level covariance)
 |
-*0.5-1.0 g/m3 in lowest km
+*0.5-1.5 g/m3 in lowest km
 *<0.5 g/m3 above 2 km
 |}
-MWR water vapor retrievals are usually validated against radiosonde measurements. Statistics (mean and rms) of the difference between MWR retrievals and radiosonde measurements are used to quantify the accuracy of MWR retrievals, though these include the radiosonde representativeness error as well. Typical results are shown in Fig. 2 for a 1-year dataset collected in Lindenberg during clear and cloudy situations. Typical rms are within 1 g/m3 in the first 2 km and less than 0.5 above that. Rms difference slightly decrease when the sistematic difference is removed a posteriori.
+MWR water vapor retrievals are usually validated against radiosonde measurements. Statistics (mean and rms) of the difference between MWR retrievals and radiosonde measurements are used to quantify the accuracy of MWR retrievals, though these include the radiosonde representativeness error as well. Typical results are shown in Fig. 3.2.4 for a 1-year dataset collected in Lindenberg during clear and cloudy situations. Typical rms are within 1 g/m3 in the first 2 km and less than 0.5 above that. Rms difference slightly decrease when the sistematic difference is removed a posteriori.
-[[File:Stat_DWD_WV_2004.png|400px|thumb|left|'''Figure 2''': Statistics of humidity profile differences (mean and rms) during all-sky conditions from September 2004-August 2005 between MWR and radiosonde measurements at the DWD Meteorological Observatory in Lindenberg, Germany. The retrieval results using a Neural Network (NN) retrieval approach are shown in blue (solid: mean; dashed: std). The results for a "a-posteriori" regression are shown in red (solid: mean; dashed: std), demonstrating the potential after the bias removal. The black line show the std (i.e. the variability) of the whole set of radiosonde water vapor profiles. A total number of 1171 matching MWR/radiosonde cases have been considered in the plot. Courtesy of J. Güldner, DWD.]]
+[[File:Stat_DWD_WV_2004.png|400px|thumb|left|'''Figure 3.2.4''': Statistics of humidity profile differences (mean and rms) during all-sky conditions from September 2004-August 2005 between MWR and radiosonde measurements at the DWD Meteorological Observatory in Lindenberg, Germany. The retrieval results using a Neural Network (NN) retrieval approach are shown in blue (solid: mean; dashed: std). The results for a "a-posteriori" regression are shown in red (solid: mean; dashed: std), demonstrating the potential after the bias removal. The black line show the std (i.e. the variability) of the whole set of radiosonde water vapor profiles. A total number of 1171 matching MWR/radiosonde cases have been considered in the plot. Courtesy of J. Güldner, DWD.]]
-'''''Results for 1DVAR'''''
 ==== Operational performance and technical implementation ====
@@ Line 362: / Line 366: @@
 However, the current MWR technology is such that receivers are stable over long periods (months), thus  tipping curve and cryogenic calibrations are recommended only few times a year. For avoiding long periods of miscalibration, an operational protocol (including severe quality criteria and a testing period) shall be adopted before accepting the calibration coefficient updates.
 Operational MWR measurements need to be monitored routinely during clear sky conditions using simple non-scattering radiative transfer models as reference for calibration stability. Such monitoring is necessary to identify the presence of possible measurement bias, which can be subsequently removed for providing an the best humidity profile product.
-Advantages, challenges and limitations of humidity profiling with MWR are summarised in Table 3.
+Advantages, challenges and limitations of humidity profiling with MWR are summarised in Table 3.2.3.
 {| class="wikitable"
-!colspan="6"|Table 3: Advantages, challenges and limitations of MWR humidity profiling
+!colspan="6"|Table 3.2.3: Advantages, challenges and limitations of MWR humidity profiling
 |-
 | Advantages
@@ Line 393: / Line 397: @@
 ==== Summary and recommendations ====
-'''''Summarize your findings and state your recommendations for updating existing observing systems. Try to formulate in bullets'''''
+Recommendations similar to as for temperature profiling (see section [[:Final_Report#Temperature_profile|3.1]]) apply for humidity profiles.
+Due to the suitability for 24/7 nearly all-weather operational measurements and widespread European distribution, microwave profilers have been chosen within EG-CLIMET as the most effective and network-ready instrumentation for humidity profiling, fulfilling potentially most (but not all) of the WMO User Requirements. In fact, limited vertical resolution and corresponding smoothing error are inherent in the passive measurement principle.
+Note that most microwave profilers are also capable of providing temperature profiles and cloud liquid water path (see sections [[:Final_Report#Temperature_profile|3.1]] and [[:Final_Report#Liquid_clouds | 3.7]]) and thus provide additional information on atmospheric stability, continuously within consecutive radiosondes launched typically at 12 hourly intervals.
+Within EG-CLIMET, MWRnet has been established as a prototype of an international microwave radiometer network setting up common calibration and operation procedures to guarantee continuous, harmonized and quality-controlled observations and retrieved profiles, with uncertainties.
+In order to prove the value of MWR measurements for NWP and climate studies, EG-CLIMET recommends the following:
+* Further '''consolidation of MWRnet''' to be able to provide near-real-time, quality controlled humidity (and temperature) profiles on an openly available platform in the near future.
+* Consideration of microwave radiometers within the EUMETNET E-PROFILE project, as a powerful tool for providing high temporal resolution IWV, LWP, and temperature and humidity profiles.
+* Evaluation of observations impact by means of '''Observation System Simulation Experiments''' (OSSE) in collaboration with national weather services (see discussion in the temperature profile [[:Final_Report#Summary_and_recommendations| summary and recommendations]] section).
+* Large and coordinated international experiments (e.g. LAUNCH, COPS, HyMeX), should be exploited to carry out '''Observation System Experiment''' (OSE) to characterize MWR data impact into the analysis and forecast. For example, using ground-based water vapor lidar observations during the LAUNCH 2005 measurement campaign, Grzeschik et al. (2008) showed a downstream impact on forecasted humidity within a four-hour time window after assimilation. Similar impact studies are ongoing within MWRnet in cooperation with the [http://www.hymex.org/ HyMeX] project.
 === Wind profile ===
-Contributors: C. Gaffard, V. Lehmann
 ==== Fundamentals ====
@@ Line 406: / Line 422: @@
 : <math>V_r=u \cdot\sin\theta\cos\phi+v\cdot\cos\theta\cos\phi+w\cdot\sin\phi</math> &#x00A0;&#x00A0;&#x00A0;&#x00A0;{{EquationRef|x = 1|Eq. 1}}
-with the radar or lidar beam having an elevation angle <math>\phi</math> and an azimuth angle <math>\theta</math> (see figure 1) , three different directions of observation that are not coplanar are the minimum necessary to determine all three wind components.
+with the radar or lidar beam having an elevation angle <math>\phi</math> and an azimuth angle <math>\theta</math> (see figure 3.3.1) , three different directions of observation that are not coplanar are the minimum necessary to determine all three wind components.
-[[File:Volume.png|700px|thumb|right|Figure 1: Sketch of volume scan strategy showing the polar coordinate system being the basis for Eq. 1]]
+[[File:Volume.png|700px|thumb|right|Figure 3.3.1: Sketch of volume scan strategy showing the polar coordinate system being the basis for Eq. 1]]
 ==== Retrieval Algorithms and Errors ====
 A scan strategy widely used by radar wind profilers and vertically pointing Doppler lidars is the Doppler Beam Swinging Technique (DBS), using for example four orthogonal azimuth directions at some elevation close to the vertical and a fifth measurement for the vertical itself.
-Another technique in this vein has been proposed by Lhermitte and Atlas for precipitation Doppler radars, but of course also applicable to every other dopplerized remote sensing technique, makes use of a full circle scan in azimuth (R.M. Lhermitte, D.A. Atlas, 1961; R.M. Lhermitte 1962). The technique is called Velocity Azimuth Display (VAD), since in the days when fast personal computers were not ubiquitous the horizontal wind and the particle fall velocity were extracted from the actual display of the range gated Doppler shift over azimuth (as an example see figure 2).
+Another technique in this vein has been proposed by Lhermitte and Atlas for precipitation Doppler radars, but of course also applicable to every other dopplerized remote sensing technique, makes use of a full circle scan in azimuth (R.M. Lhermitte, D.A. Atlas, 1961; R.M. Lhermitte 1962). The technique is called Velocity Azimuth Display (VAD), since in the days when fast personal computers were not ubiquitous the horizontal wind and the particle fall velocity were extracted from the actual display of the range gated Doppler shift over azimuth (as an example see figure 3.3.2).
-[[File:VAD.png|630px|thumb|right|Figure 2: Example of a Velocity Azimuth Display, the corresponding radial wind field is shown in the small box]]
+[[File:VAD.png|630px|thumb|right|Figure 3.3.2: Example of a Velocity Azimuth Display, the corresponding radial wind field is shown in the small box]]
 Although the trained observer may be able to extract also characteristics of inhomogeneous wind fields, the general approach would be to fit the parameters u, v and w (w being dominated by the fall velocity of rain drops in the case of weather radar) to Eq.1.
@@ Line 447: / Line 463: @@
 +\cos\theta\cos\phi(r\sin\phi-z_0)\cdot (v'_z+w'_y)\end{align}</math>
-Thus, there are a maximum of nine parameters that can be obtained by fitting Eq. 8 to the volume velocity data for each altitude gate. As an example for one of these parameters, a plot of a vertical profile of the horizontal wind is shown in figure 3. Particularly for the horizontal wind, it is also common to plot [[Wikipedia:station model|wind barbs]] for each altitude gate. This can be conviently displayed as a time series (figure 4).
+Thus, there are a maximum of nine parameters that can be obtained by fitting Eq. 8 to the volume velocity data for each altitude gate. As an example for one of these parameters, a plot of a vertical profile of the horizontal wind is shown in figure 3.3.3. Particularly for the horizontal wind, it is also common to plot [[Wikipedia:station model|wind barbs]] for each altitude gate. This can be conviently displayed as a time series (figure 3.3.4).
-[[File:VVP2.png|630px|thumb|right|Figure 3: Profile of horizontal wind, similar plots could be shown for other paramters extracted from a volume scan by fittinbg Eq. 8 to it.]]
+[[File:VVP2.png|630px|thumb|right|Figure 3.3.3: Profile of horizontal wind, similar plots could be shown for other paramters extracted from a volume scan by fittinbg Eq. 8 to it.]]
-[[File:VVP1.png|630px|thumb|right|Figure 4: Time series of wind barbs as a function of altitude (time: abscissa, altitude: ordinate). This plot has the advantage that the direction of the horizontal wind can be displayed as well.]]
+[[File:VVP1.png|630px|thumb|right|Figure 3.3.4: Time series of wind barbs as a function of altitude (time: abscissa, altitude: ordinate). This plot has the advantage that the direction of the horizontal wind can be displayed as well.]]
 It is worthwhile noting that horizontal vorticity &eta; (the vertical component of the curl of the velocity field, Eq. 9) cannot be extracted, since u'<sub>y</sub> and v'<sub>x</sub> only appear summed together.
@@ Line 467: / Line 483: @@
 However, if derivatives of the wind field are to be extracted in addition to the horizontal wind using VVP, one has to be aware that the corresponding matrix used in the fit is generally prone to be ill-conditioned, i.e. the solution varies too strongly with a variation of the arguments with respect to round-off errors due to the finite precision of floating point numbers, or, stated more formally, the [[Wikipedia : condition number| condition number]] C given by the ratio of the largest and the smallest singular value of the matrix X<sup>T</sup>X encountered in the [[Wikipedia:least squares|least square fit]] procedure is too large, meaning roughly that log<sub>10</sub>(C) is greater than the machine size precision (for more information see e.g. [http://mathworld.wolfram.com/ConditionNumber.html Wolfram Mathworld]). For this reason, Nan et al. have suggested an algorithm called SVVP (S for “stepped”) to overcome this problem [http://www.springerlink.com/content/3x11476p75w341qv/ (Nan et al., 2007)].
-==== Performance ====
+==== Operational performance and technical implementation ====
 The methods presented here are not only different analysis methods, but also imply different scan strategies. Therefore, a trade-off has to be made in order to reconcile update rate, accuracy, representativeness and the possibility to obtain additional information about the nature of the wind field. For weather radars, wind profile quality has been compared by Holleman [http://journals.ametsoc.org/doi/pdf/10.1175/JTECH1781.1 (Holleman, 2005)] for different versions of VAD and the VVP methods. He used two different VAD methods (VAD1: Fourier expansion terminated after the third term, VAD2: Fourier expansion terminated after fifth term) and three different VVP methods with three, six and all nine parameters (VVP1: only wind profile (u<sub>0</sub>,v<sub>0</sub>,w<sub>0</sub>); VVP2: divergence, stretching deformation and shearing deformation in addition to wind profile; VVP3: all parameters from VVP2  along with the vertical derivatives). In fact, only wind profiles obtained from VAD1 have been used for comparison with VVP1 and VVP2, since the single parameters have no effect on each other in value and magnitude of error due to the orthogonality of the basis functions of the expansion and the evenly spaced azimuthal intervals. This is of course not the case for the VVP methods. It must be noted, that the VAD data are not obtained from one azimuth circle, but from the same volume data as the VVP products. The difference is only that in the case of VAD the least square fit has been applied to all azimuth circles individually, whereas for the VVP product the volume data have been subjected to the fit at once. Therefore, the effect of using more data for the VVP than for the VAD is eliminated. During the study data from the KNMI C-band Doppler Weather Radar in DeBilt (Meteor AC360), Radiosonde launches in DeBilt and data from the HIRLAM model (Unden et al. 2002) have been compared for nine months. Products have been generated using the Rainbow&reg; 5 software. The conclusion is that the VVP method is superior to VAD in general. Furthermore, the VVP1 method provides the best horizontal wind values which is attributed to noise fitting due to the non-orthogonality of the basis functions of the fit for VVP2 and VVP3 (and therefore linear dependencies between them).  The VVP1 minus background statistics have been found to be at least as good as those of the radiosonde profiles.
-==== User Requirements ====
+==== Summary and recommendations ====
-==== Executive Summary ====
+'''Original Contributions Made by EG-CLIMET Action'''
+{|cellpadding="20" cellspacing="0"
+|-
+|style="width:200px;vertical-align:top;" | '''Bird echo filter'''
+A Gabor filter has been incorporated in the standard wind profiler software to remove the intermittent echoes due to bird migration.
+Courtesy, V. Lehmann (DWD).
+|[[File:Sar.1.jpg|300px|frameless|center]]
+|-
+|style="width:200px;vertical-align:top;" | '''Spectral filtering'''
+Correction of false wind retrievals due to clutter, radio frequency interference and rain events using improved spectral processing which has now been incorporated in the standard wind profiler software.
+Spurious wind retrievals from the profiler at South Uist on 2 June 2011 are identified by the red boxes.
+Courtesy, R. Leinweber (DWD) / C. Gaffard (MetOffice).
+|[[File:Sar.2.jpg|350px|frameless|center]]
+|-
+|style="width:200px;vertical-align:top;" | '''Impact for NWP'''
+It has been demonstrated that strategically placed wind profilers (WP) have a greater impact than radio sondes (RS) in reducing errors in the forecast in the UK (upper) and Germany (lower). The errors are expressed in terms of total dry energy.  The analysis used the FSO (Forecast Sensitivity to Observations) technique (Cardinali, 2009) which can identify the contribution to the reduction in the forecast error of specific observations when assimilated into the model.
+Courtesy, R. Leinweber (DWD) / C. Gaffard (MetOffice).
+|[[File:Sar.3a.jpg|200px|frameless|center]]
+[[File:Sar.3b.jpg|300px|frameless|center]]
+|}
+'''Future prospects:'''
+Following EG-CLIMET presentations to EUCOS, the body responsible for the European observing system, E-PROFILE has been launched which will run from 2013-2017 with a kick-off meeting in April-May 2014. E-PROFILE will be responsible for Wind Profiler data quality and for coordinating real time exchange of backscatter profiles from lidars and ceilometers.
+The FSO work above has established that Wind Profilers can have a positive effect in improving weather forecasts but only for those instruments where rigorous data quality control procedures have been implemented. FSO has the advantage that it can identify which profilers are performing well and those which are not, and also  the advantage of siting wind profilers in data sparse location.   E-PROFILE will take this work further.
 === Aerosol Backscatter and Extinction profile ===
-Contributors: I. Mattis, D. Nicolae, O. Cox
-The atmosphere contains a wide range of constituents extending from atoms and molecules (Angstrom range d ~ 1E-3 ... 1E-4 μm) to aerosols (d ~ 1E-2 ... 5 μm), cloud water droplets and ice crystals (d ~ 1 ... 15 μm and even larger). Evaporation, condensation, coagulation, absorption, desorption, and chemical reactions change the atmospheric aerosol composition on short timescales. Aerosol concentrations in the atmosphere vary widely with altitude, time, and location.
+The transmission of the atmosphere is highly dependent upon the wavelength of the spectral radiation,  and upon the composition and speciﬁc optical properties of the constituents in the atmosphere. The prominent spectral features in the atmosphere's transmission spectrum are primarily due to absorption bands and individual absorption lines of the molecular gases in the atmosphere,  while a portion of the slowly varying background transmission is due to aerosols.
-The term “extinction” means the loss of light in the atmosphere from a directly transmitted beam. Two different mechanisms contribute to extinction: absorption and scattering. Aerosol extinction coefficient is a measure of attenuation of the light passing through the atmosphere due to the scattering and absorption by aerosol particles. Extinction coefficient is the fractional depletion of radiance per unit path length (also called attenuation especially in reference to radar frequencies). It has units of (1/km). The integrated extinction coefficient over a vertical column of unit cross section is called aerosol optical depth or optical thickness. Most of the aerosol particles are so weakly absorbing that their extinction is almost entirely due to scattering, rather than absorption. However, soot (carbon) particles are quite strong absorbers.
-Conform to the diffraction theory, an obstacle could be “seen” by an electromagnetic wave having a wavelength on the same magnitude as the geometric dimension of the obstacle. So, using a light beam (wavelength: nm, μm) one can detect atmospheric components, which are “invisible” for other sounding waves. The mixture of different components in the atmosphere results in a series of complex atmospheric interactions that take place with a laser beam:
-•	N2, O2 molecular elastic (λD = λL) light scattering; i.e. Rayleigh diffusion (λL >> d, where d is the molecular diameter)
+Recent estimations on the possible impact of aerosols on the radiative forcing (assumed cooling effect) in a global average are of the same order of magnitude as the CO2 effect (warming effect). A full understanding of the role of aerosols is important for improving weather forecasting and understanding climate change. They scatter and absorb both incoming and outgoing radiation (direct effect), and influence cloud formation, their microphysical properties and lifetime (indirect effect). The amount of radiation that is scattered and the directions of scatter, as well as the amount of radiation absorbed, varies with aerosol composition, size, and shape. Thus, the measurements of aerosol optical properties (aerosol backscatter  and extinction  coefficients at various wavelengths) contribute to the quantification of the radiative forcing, but also to the estimation of particle's physical properties, by inversion of the spectral optical data.
-•	Aerosol elastic (λD = λL) light scattering; i.e. Mie scattering (λL ~ d, where d is the diameter of the particle)
+*'''The backscatter coefficient''' is a measure of the fraction of incident radiation that is scattered directly back toward the source.
+*'''The extinction coefficient''' is a measure of attenuation of the light passing through the atmosphere due to the scattering and absorption by atmospheric components (aerosols, molecules). The extinction coefficient is the sum of the absorption coefficient and the scattering coefficient, and generally depends on wavelength and temperature.
-•	N2, O2 and H2O molecular inelastic (λD ≠ λR) light scattering; i.e. Raman scattering (λL >> d, with d the molecular dimension)
+''Applications'': Atmospheric correction for satellite imagery; air quality; health and environment; monitoring of volcanic eruptions and forest fire; Earth radiation budget; radiative transfer models; climate change; aviation safety; visibility.
-•	Gas and aerosol absorption (if the radiation at λL is absorbed by atmospheric molecules or by compounds forming the aerosols
+==== User requirements and benefits ====
-•	Fluorescence of bioaerosols
+User requirements and benefits of measuring the backscatter and the extinction coefficient, especially using ground-based remote sensing techniques are described in the WMO's document [http://www.wmo.int/pages/prog/www/IMOP/publications/IOM-109_TECO-2012/Session5/K5_02_Thomas_Ceilometers_Lidars.pdf" Transitioning to operations: lidars and ceilometers"] (W. Thomas, DWD, June 2012). Conform to this document: "Atmospheric profiling from ground-based remote sensing instruments has reached a level of maturity making it possible to gather routinely information about the atmospheric state. Recent improvements of data assimilation techniques pave the way for ingesting profile data into models for numerical weather prediction, thus supporting and fostering the operational use of such instruments and measurements. Further applications are long-term monitoring thus climate research at global and regional level and observations of long-range transport phenomena. Current networks are however heterogeneous with respect to the spatial density of instruments, remote sensing capabilities of instruments and products. Consequently, first steps have recently been undertaken to harmonize data and products and to close the gap between research-oriented operations and application-oriented operations."
-Lidar makes use of a laser to excite backscattering in the atmosphere. This backscattered signal is observed using a telescope receiver, which collects the light and send it to the receiver optics. The role of the optical chain is to select specific wavelengths, split between them and direct them to photodetectors, which further convert the optical signal into electrical signals. These are recorded as a function of time by analog-to-digital converters and/or photon counting devices.
+User requirements refer to '''data accuracy''' and '''data availability'''. From this point of view, lidars are providing the best accuracy (relative error better than 10%) while lacking continuous operation. On the contrary, ceilometers are all-weather continuous operation instruments, but are lacking the accuracy in retrieving (especially) the extinction profile. Intermediate lidar products are now available with Nitrogen Raman detection capability and have shown a good data availability with a low maintenance thanks to the use of diode-pump lasers.  According to Heese et al. (2010), a combination of different instrument types seems feasible as well as appropriate for a prototype aerosol profiling (backscatter and extinction profiles, plus subsequent parameters) near-real-time system that bridges between research-based and operational aerosol observations. The retrieval of first backscatter profiles and secondly extinction profiles (and further mass extinction coefficients) from routine ceilometer measurements is in principal possible, provided that additional measurements are available (sun photometer, advanced Lidars) and that the instrument was calibrated. Note that the conversion of ceilometer data into backscatter and extinction coefficients is associated with large error bars and limited to 4-5 km in daytime conditions. This method is described in Flentje et al. (2010). Elastic backscatter lidars equipped with nitrogen Raman channels are another way to retrieve backscatter and extinction coefficients profiles independently and without assumptions on particle type. As operational lidar products are now available with nitrogen Raman detection capability, these instruments offer an accurate way to self-calibrate the optical extinction profile without any coupling to other sensors. With respect to hazardous aerosol layers (after volcanic outbreaks, dust storms, forest fires) and thanks to continuous monitoring such network may also act as a warning and tracking system of atmospheric particles.
-[[File:1.jpg|thumb|400px|left]]
+==== Available techniques ====
+There are several techniques to measure the backscatter coefficient and the extinction coefficient (or at least its integral over a measurement path). [[File:2.jpg|thumb|400px|right|'''Figure 3.4.1''': Multiwavelength Raman lidar operating at the National Institute of R&D for Optoelectronics, Romania]]
+'''Scattering instruments''' are used to measure a basic optical property of the air sample: the volume scattering function. Scattering instruments include integrating nephelometers, backscatter meters, forwardscatter meters, and polar nephelometers. '''Integrating nephelometers''' perform a ''point measurement'' of the light scattered over a range of angles and permit determination of the scattering component of extinction. The air sampled by the integrating nephelometer is enclosed and illuminated indirectly by an artificial light source, allowing automated continuous day and night operation. Nephelometers have been used in a variety of applications (Charlson et al., 1978). Since nephelometers involve point measurements, care must be taken to minimize the influence from local sources. Also, inhomogeneous impairment, such as plume blight, cannot be detected.
+'''Photometers''' measure light intensity using a photodetector, which converts brightness into representative electric signals. By the use  of combinations of lenses and filters, different optical properties may be determined. '''Sun photometers''' are photometers pointing at the Sun. Recent sun photometers are automated instruments incorporating a Sun-tracking unit, an appropriate optical system, a spectrally filtering device, a photodetector, and a data acquisition system. These instruments measure the solar radiance after the absorption / scattering from the atmosphere, at several wavelengths. The integral of the extinction coefficient (AOD), as well as other ''column'' optical and microphysical parameters can be extracted from multiwavelength sun photometer data.
+'''Transmissometers''' are instruments which measure the amount of light transmitted from a specified source (artificial) to a receiver, allowing the direct calculation of the average extinction coefficient of the air along the instrument ''path''. When transmissometers are used in very clean atmospheres, their critical sensitivity to atmospheric turbulence can introduce error. Additionally, these instruments are usually limited to a single wavelength and not very portable.
+'''Lidar''' provides a method of directly measuring the optical properties of atmospheric aerosol distributions, as well as of other atmospheric parameters or components (molecules and fluorescent species, wind velocity and direction, temperature and water vapor) as ''profiles''. Lidar makes use of a laser to excite backscattering in the atmosphere. This backscattered signal is observed using a telescope receiver, which collects the light and send it to the receiver optics. The role of the optical chain is to select specific wavelengths, split between them and direct them to photodetectors, which further convert the optical signal into electrical signals. These are recorded as a function of time by analog-to-digital converters and/or photon counting devices. Each lidar signal represents, therefore, the spatial variation of the measured parameter, i.e. the vertical, slant or horizontal profile of the variable.
+Interaction of the laser beam with the atmosphere is complex. Multiple phenomena are produced simultaneously, both elastic (i.e. at the same wavelength: Mie and Rayleigh scattering) and inelastic (i.e. at a different wavelength: vibrational and rotational Raman, fluorescence). Thereby, the set-up of the lidar is application-driven. The backscatter coefficient can be measured using simple '''elastic backscatter lidars''' and several types of '''ceilometers''', although some assumptions has to be made (see the "Retrieval algorithms and errors" sub-section). For the measurement of the extinction coefficient, '''inelastic (vibrational or rotational) Raman''' detection is generally used. The combination of the two gives independent estimation of both parameters. '''High Spectral Resolution Lidars''' take advantage of the spectral distribution of the lidar return signal to discriminate aerosol and molecular signals and thereby measure aerosol extinction and backscatter independently. '''Multi-wavelength''' detection is also recommended in order to extract supplementary information (e.g. intensive optical parameters such as Angstrom exponent, color indexes and color ratios, or microphysical properties such as size distribution, complex refractive index and single scattering albedo.
+{| class="wikitable"
+!colspan="4"|Table 3.4.1: Advantages and limitations of the various aerosol lidar types
+|-
+| '''Lidar type'''
+| '''Principle'''
+| '''Retrieved parameters'''
+| '''Limitations'''
+|-
+| General
+|
+*Scattering (Mie, Rayleigh, Raman)
+|
+*Backscatter and / or extinction coefficient
+|
+*Incomplete overlap (at low range)
+*Signal-to-noise ratio (at far range)
+*Saturation (at high extinction values)
+*Multiple scattering (fog, rain, clouds)
+*Estimation of the atmospheric density
+|-
+| Ceilometers
+|
+*Mie and Rayleigh elastic scattering
+|
+*Backscatter coefficient
+|
+*Assumption on the lidar ratio (backscatter/extinction)
+*Calibration value (backscatter coefficient at far range)
+*Daytime signal-to-noise ratio
+*Combination with othe sensors required for the calibration of backscatter coefficient
+|-
+| Elastic backscatter
+|
+*Mie and Rayleigh elastic scattering
+|
+*Backscatter coefficient
+|
+*Assumption on the lidar ratio (backscatter/extinction)
+*Calibration value (backscatter coefficient at far range)
+|-
+| Elastic backscatter and Raman (vibrational / rotational)
+|
+*Mie and Rayleigh elastic scattering
+*Raman inelastic scattering
+|
+*Extinction coefficient
+*Backscatter coefficient
+|
+*Calibration value (backscatter coefficient at far range)
+*Daytime signal-to-noise ratio
+|-
+| Multi-wavelength Raman
+|
+*Mie and Rayleigh elastic scattering
+*Raman inelastic scattering
+|
+*Extinction coefficient
+*Backscatter coefficient
+*Angstrom exponent
+*Size distribution
+|
+*Calibration value (backscatter coefficient at far range)
+*Daytime signal-to-noise ratio
+|-
+| High Spectral Resolution
+|
+*Aerosol and molecular (spectral separation) scattering
+|
+*Extinction coefficient
+*Backscatter coefficient
+|
+*Temperature stability of the ethalons
+*Accurate estimation of the instrument's function
+|}
+Lidars provide important advantages in the determination of the backscatter and extinction coefficients:  high spatial resolution (1 value each 3 - 60 m), high temporal resolution (1 profile each 1 - 60 min), high dynamic range (0.2 ... 15 km). There are two important types of errors associated to the measurement of the backscatter and extinction coefficients from lidar: a) instrumental errors due to technological limitations (both at components' level and their integration); b) retrieval errors due to the non-determination of the lidar equation (not exhaustive, see Section "Retrieval algorithms and errors"). Nevertheless, the quality assurance program developed by the European Aerosol Research LIdar NETwork [http://www.earlinet.org EARLINET] made possible the estimation of the backscatter and extinction profiles with an uncertainty less than 10%, which is proper for microphysical inversion and climatological studies. The range in which this uncertainty threshold is kept depends on the individual lidar systems (the signal-to-noise ratio of the channels).
+==== Retrieval algorithms and errors ====
 Whatever the set-up of the lidar system, the magnitude of the received lidar signal is proportional to the number density of the atmospheric diffusers (molecules or aerosols), their intrinsic properties (i.e. probability of interaction with the electromagnetic radiation at the laser wavelengths, called cross–section value) and with the laser incident energy (Measures, 1992). Therefore, obtaining information about the aerosols means to find solutions of the equation which relates the characteristics of the received and emitted signal, and the propagation medium. The form of the equation depends of the interaction type. The basic lidar equation takes into account all forms of scattering and can be used to calculate the signal strength for all types of lidar, except those that employ coherent detection.
+The propagation of light in an inhomogeneous medium is well described by the electromagnetic theory.
-[[File:2.jpg|thumb|200px|right]]
+The detected light backscatter power at the wavelength λD from a distance R can be expressed as follows (Nicolae, 2010):
+[[File:e-1.png|400px|left]]
+where RCS is the range corrected signal of the lidar and Cs is the instrument function.
-The detected light backscatter power S(λD,R) at the wavelength λD from a distance R can be expressed as follows (Nicolae, 2010):
-[[File:e-1.png|400px|center]]
-where RCS is the range corrected signal [[File:e-2.png|180px]]  and CS is the instrument function .
 The atmospheric backscatter coefficient  [[File:e-3.png|80px]] is a key element of the lidar equation, and is proportional to the cross section of the involved physical process and to the number density of the atmospheric active diffusers (i.e. atoms, molecules, particles, clouds) in the probed volume.
-[[File:e-4.png|200px|center]]
+The atmospheric transmittance from the transmitter to the probed volume and from the probed volume to the receiver, respectively, are expressed as the integrals of the atmospheric extinction coefficient and may be different on the two directions of the laser pulses, as is the case of the Raman backscatter radiation (λD = λR ≠ λL). The atmospheric extinction coefficient, backscatter coefficient and the backscatter cross section refer to all possible physical interactions within the atmosphere.
-[[File:e-5.png|220px]] and [[File:e-6.png|220px]] are the atmospheric transmittance from the transmitter to the probed volume and from the probed volume to the receiver, respectively, where α(λ,R) is the atmospheric extinction coefficient and may be different on the two directions of the laser pulses, as is the case of the Raman backscatter radiation (λD = λR ≠ λL). The parameters α(λ,R), β(λ,R) and σ(λL,λD,R) refers to all possible physical interactions within the atmosphere.
-The backscattered radiation is usually detected at the laser wavelength (elastic processes) but the radiation shifted in wavelength, due to inelastic processes as the Raman effect, may be also detected. When the lidar equation is adapted to the specific process involved (i.e. Rayleigh, Mie, Raman), various atmospheric properties and parameters can be retrieved.
 Both in case of elastic backscatter lidar, and Raman lidar, the solution of the equation is not unique (Kovalev,2004), since it has two unknowns: backscatter and extinction coefficients. Combination of elastic and (vibrational) Raman channels allow to retrieve these parameters with minimum assumptions:
-[[File:e-7.png|120px|center]]
+[[File:e-7.png|120px|left]]
-where the “L” and “R” indexes correspond to laser and Raman detected wavelength, respectively, and k ranges between 0.8 and 1.2. This relation is valid if the difference between the Raman and laser wavelength is small. Nitrogen molecules are used to obtain the Raman signal, due to the fact that Nitrogen is considered a gas with constant concentration over time and has a Raman spectra easy to be separated from the Rayleigh one. In this case, the second (532 nm) and third harmonics (355 nm) of Nd:YAG laser can be used as excitation, since the associated Raman lines are close to these wavelengths: 607 nm and 387 nm, respectively.
+where the “L” and “R” indexes correspond to laser and Raman detected wavelength, respectively, and k ranges between 0 for coarse mode particles (maritime, dusts) and 1.5-2 for fine mode particles (pollution forest fires). This relation is valid if the difference between the Raman and laser wavelength is small. Nitrogen molecules are used to obtain the Raman signal, due to the fact that Nitrogen is considered a gas with constant concentration over time and has a Raman spectra easy to be separated from the Rayleigh one. In this case, the second (532 nm) and third harmonics (355 nm) of Nd:YAG laser can be used as excitation, since the associated Raman lines are close to these wavelengths: 607 nm and 387 nm, respectively.
-With this hypothesis, the aerosol extinction coefficient at the laser wavelength can be obtained by applying the natural logarithm and the derivative to the Raman lidar equation:
+With this hypothesis, the aerosol extinction coefficient at the laser wavelength can be obtained by applying the natural logarithm and the derivative to the Raman lidar equation.
-[[File:e-8.png|320px|center]]
+Molecular parameters (indices "m") can be calculated with sufficient accuracy from ground values of pressure and temperature using an atmospheric model, or radiosounding. A simple mathematical procedure applied to the couple elastic + Raman channel leads further to the retrieval of the backscatter coefficient (Mattis, 2002). With different couples of elastic and Raman channels, extinction and backscatter coefficients at several wavelengths can be computed, and therefore more products can be obtained (Müller,1999a): lidar ratios, Angstrom exponents, color ratios and even microphysical parameters such as size distribution, effective radius, complex refractive index, single scattering albedo, volume and number concentration. [[File:3.jpg|thumb|450px|left|'''Figure 3.4.2''': Backscatter, extinction and lidar ratio profiles obtained from multiwavelength Raman lidar (1064, 532 and 355 sounding wavelengths); example]]An example of the aerosol backscatter coefficient profiles (1064, 532 and 355 nm) and extinction profiles (532 and 355 nm) is shown in Fig. 3.4.2.
-[[File:3.jpg|thumb|400px|center]]
+Two kinds of errors are associated to the retrieval of the backscatter and extinction from lidar measurements: statistical errors and systematic errors.
-Molecular parameters (indices "m") can be calculated with sufficient accuracy from ground values of pressure and temperature using an atmospheric model, or radiosounding. A simple mathematical procedure applied to the couple elastic + Raman channel leads further to the retrieval of the backscatter coefficient (Mattis, 2002). With different couples of elastic and Raman channels, extinction and backscatter coefficients at several wavelengths can be computed, and therefore more products can be obtained (Müller,1999a): lidar ratios, Angstrom exponents, color ratios and even microphysical parameters such as size distribution, effective radius, complex refractive index, single scattering albedo, volume and number concentration.
+'''1. Statistical errors''' are mainly due to the to signal detection, i.e.  background of sky and dark current of detector (Theopold and Bösenberg, 1988). Directly related to this kind of error, there is the error introduced by operational procedures such as signal averaging during varying atmospheric extinction and scattering conditions (Ansmann et al., 1992; Bösenberg, 1998). Statistical errors can be assessed either by analytical propagation (Gaussian or Poison statistical distributions have to be considered), either by Monte Carlo techniques.
+'''2. Systematic errors''' generally arise from:
+a) the estimation of temperature and pressure profiles (Ansmann et al., 1992);
+b) the estimation of the ozone profiles in the UV (Ansmann et al., 1992) and in other spectral ranges;
+c) the wavelength dependence parameter k (Ansmann et al., 1992; Whiteman, 2000);
+d) the multiple scattering (Ansmann et al., 1992; Wandinger, 1998; Whiteman, 2000);
+e) the overlap function (Wandinger and Ansmann, 2002).
+Systematic errors are more difficult to estimate and this is still an open scientific issue.
+==== Operational performance and technical implementation ====
+Although lidar technique has been used for many years, recent technological developments, coupled with the implementation of modern mathematical procedures have led to a more operative use of lidar systems. Ceilometers are nowadays more and more complex and sensitive, some new products being able to detect aerosols and therefore to deliver the backscatter coefficient with the coupling of other sensors and with a large error (more than 50%). On the other hand, powerful lidars are more and more automatic and suitable for a 24/7 unmanned operation. Elastic lidars equipped with nitrogen Raman detection channel are intermediate solutions for an accurate self-calibration and an independent retrieval of backscatter and extinction coefficient profiles without any coupling to other sensors. New industrial and operational nitrogen raman lidars based on diode-pump lasers have shown a low maintenance and a high data availability. The main progresses recorded in the last years are referring to the improvement of the instruments and retrieval algorithms for:
+'''1.	the automation of the operation'''
+From an operational point of view, alignment of the laser beam into the receiver FOV is critical. Depending on the configuration, the overlap control needs to be very precise (order of 0.01 mrad) and stable with temperature. Short term fluctuations in the laser energy are usually averaged out during the integration time of the measurement. However, long term drift in the laser energy is important if the lidar is to be kept running for longer periods of time. Therefore, laser energy should be at least monitored and eventually stabilized. In case harmonics of the fundamental laser frequency are used, conversion crystals are used (SHG, THG) that alter the direction of the outgoing laser beam when they are tuned. This has to be compensated for in order to keep the overlap properly aligned. If the (generally non-eye safe) lidar is to be kept running for longer periods of time, in particular if the operator is not present from time to time, safety precautions have to be taken according to proper use of lasers outdoors. Remote control of the lidar operation (e.g. via web tools) is an option.
+'''2.	the improvement of the dynamic range'''
+Telescopes with large apertures for high troposphere and stratosphere exploration tend to have large focal lengths, which tends to reduce field of view and increase the distance at which field full overlap is reached. To overcome this problem, two receiver sets, using different telescopes (one for far range, another, with smaller aperture, shorter focal length and nearer full overlap distance, for close range), can be used. Other solutions based on specific optical components are also available in order to reduce the overlap and ensure the highest range as possible.
+Measurements can also be corrected under the full overlap height if the overlap function of the system has been measured.
+Increased dynamic range can be achieved also with combined analog and photoncounting techniques.
+'''3.	the improvement of the temporal coverage'''
+Daytime performance of (vibrational) aerosol Raman lidar can be achieved by sufficiently suppressing the daytime background and/or by increasing the emitter power. Narrowing down interference filter passband has consequences for the optical design of the receiver (angular dependence of the position of the passband transmission peak). Other solutions exist, e.g. grating/monochromators, tilt slit diaphragm. The limited acceptance angle of small bandwidth interference filters IFF determines the whole lidar optics design.
+Ceilometer detection and inversion capabilities are also limited to the lowest part of the troposphere (up to 4-5 km) in daytime conditions.
+'''4.	reducing the uncertainties of the final products'''
+The minimum recommendation for an optimized product is to add a nitrogen Raman channel to a backscatter lidar, so that both the backscatter and the extinction coefficient can be derived independently. The same can be achieved by using a HSRL system and / or a scanning lidar (multiple zenith-angle measurements). This latter technic requires a strong assumption on horizontal and temporal stability of the atmosphere. Moreover their use in operational networks has to be demonstrated. The implementation of state-of-the-art algorithms and tools for the correction of the signal as well as for the inversion of the corrected signal contributes both to reducing the uncertainties and to increasing the availability of the data. This includes:
+*signal pre-processing: cloud screening, pile-up correction,  estimation of the statistical error,  background subtraction, range correction, handling of signals measured at angle different from zenith,  correction for depolarization-dependent receiver transmission, calculation of the profile of the Rayleigh-scattering coefficient,  correction for Rayleigh-transmission, temporal averaging to create fixed time intervals, vertical smoothing up to a fixed height resolution
+*calculation of the extinction coefficient from the Raman signal: calculation of the derivative, estimation of the uncertainty of the derived extinction, determination of the overlap function
+*calculation of the backscatter coefficient from combined elastic - Raman signals: detection of the reference height, estimation of the reference value
+Significant improvements can be achieved by the automation of the lidar inversion, to avoid human error and operator subjectivity.
+==== Summary and recommendations ====
+Although satellite imagery (with its increasing temporal and spatial resolution) and satellite remote sensing will ensure in the future the growing need for knowledge of global optical properties of the atmosphere, accurate estimation of the aerosol backscatter and extinction coefficients, especially near ground and in the first atmospheric layers, can be only provided by ground-based remote sensors.
+Laser-based techniques have the main advantage of high spatial and temporal resolution. Two solutions can be retained for improving short-term weather forecasts and climate change trends analysis, as well as warning and tracking system of atmospheric particles:
+*Firstly, a network of operational lidars equipped with depolarization and nitrogen Raman detection channels are the solution for an accurate self-calibration and an independent retrieval of backscatter and extinction coefficient profiles, as well as the ability to classify the aerosols.
+*Secondly, a network of ceilometers, backed-up by multiwavelength Raman lidars and sun photometers, can be an alternative but where the operational use (24/7) of multi wavelength lidars has not been widely demonstrated and where the real capacity of ceilometers to measure above 5 km is not ensured.
+Nevertheless, current networks are however heterogeneous with respect to the spatial density of instruments, remote sensing capabilities of instruments and products.
+In this respect EG-CLIMET recommends the following:
+'''1. European and national funding agencies should invest more in the technological development''' of:
+*Nitrogen Raman lidars with depolarisation - continuous (i.e. daytime), unattended operation
+*ceilometers - multiwavelength capabilities, increasing dynamic range, increasing the signal-to-noise ratio
+*network infrastructure, storage capacity and software development, in order to build up the capacity for enhanced usage of profiling instruments
+'''2. European research ([http://www.earlinet.org EARLINET]/[http://www.actris.net ACTRIS]) and operational networks (NMHSs, UK Met. Office, DMI, DWD, FMI, KNMI, Meteo-France, SMHI etc.) should develop an optimized and fully automatically working method for a network of different instruments. They should set up working groups''' to:
+*encourage and support the set-up of measurement stations with parallel operations of ceilometers, lidars and sun photometers
+*harmonize lidar / ceilometer observations and data products/data formats
+*organize and support intercomparison campaigns for ceilometers and Lidars (involvement of EARLINET[/ACTRIS recommended)
+*define best practices for ceilometer calibration (self-calibration technique, cross-calibration with Lidars and sun photometers), quality assurance, and long-term operations
+*define a common data format for data exchange/data storage at scientific level and at operational (national weather services) level, including data policy
+*take advantage of existing algorithms and implement homogeneous automatic data processing procedures in order to increase the near-real-time capability of the networks
+*integrate European national ceilometer networks and lidar networks into GAW Aerosol Lidar Observation Network [http://alg.umbc.edu/galion/ GALION], for global coverage
+'''3. GMES “Atmosphere Core Service” initiatives (e.g. [http://www.gmes-atmosphere.eu/ MACC II]) together with European lidar and ceilometer networks should push for the use of ground-based remote sensing data''' for:
+*validating aerosol parameters of the global integrated (chemistry + dynamics) C-IFS model operated at ECMWF
+*contributing to regional models at higher spatial resolution
+*assimilating aerosol profiles into models and validation strategies
+'''4. European lidar and ceilometer networks together with [http://www.wmo.int/pages/index_en.html WMO], various expert groups (e.g. EG-CLIMET, CIMO, CBS, WEZARD) and national and international aviation control institutions (e.g. EASA, Eurocontrol, ICAO)  should set up working groups''' to:
+*support long-term monitoring of aerosol parameters/aerosol profiles
+*set up tools to make the current instrumental network available to users
+*organize data exchange procedures and data policy
+*close the gap between research-oriented operations and application-oriented operations (weather and climate, aviation safety, air quality)
 === Target classification ===
-Contributors: E. O’Connor, M. Haeffelin, U. Görsdorf, JC. Dupont
-==== Ceilometers ====
+==== Introduction ====
-Contributors: M. Haeffelin
-=== Mixing height ===
+The core instrumentation for clouds and aerosols quality controlled-observations comprises:
-Contributors: M. Haeffelin, F. Angelini, R. Lehtninen, M. Piringer
+# Lidar/ceilometer providing profiles of
+#* attenuated backscatter coefficient from aerosol and cloud
+#* linear depolarisation ratio
+# Doppler cloud radar operating at 35 or 94GHz, providing profiles of
+#* reflectivity, Z,
+#* mean Doppler velocity, v,
+#* Doppler spectral width, &sigma;<sub>v</sub>,
+#* standard deviation of the mean Doppler width, &sigma;<sub>vbar</sub>
+#* linear depolarisation ratio, LDR.
+# Microwave radiometer providing
+#* brightness temperatures at two or more wavelengths in the range 20-30 GHz
+#* derived water vapour and liquid water path
+# Additional observations
+#* surface rain rate from raingauge
+#* radiosonde profiles, or NWP model output (temperature, pressure, humidity, winds)
-==== Doppler lidars ====
+The profile of attenuated backscatter coefficient, from a lidar/ceilometer, exhibits returns from aerosol, ice and liquid. The molecular return may also be present at visible lidar wavelengths. Attenuation by liquid is severe, and the lidar signal does not penetrate liquid layers that are deeper than about 300 m, thus only reliably detecting the cloud base. Penetration through ice clouds can reach 3 km or more. The lidar depolarisation ratio potentially provides information on the shape and type of particles responsible for the lidar return.
-Contributors: E. O'Connor
+The cloud radar is sensitive to precipitation, ice, snow, insects and liquid droplets.The cloud radar is much less affected by attenuation and provides profiles of the first three moments of the Doppler spectra; reflectivity, Z; Doppler velocity; and the spread of Doppler velocities. Additionally, the variation of the mean Doppler velocity can also be calculated; this can be used for estimating the turbulent properties of the atmospheric particulate, or highlighting the random motion displayed by an insect. The linear depolarisation ratio, if available, is useful for distinguishing insects from clouds and precipitation within the boundary layer, and for identifying the location of melting ice particles.
-=== Liquid clouds ===
+==== Input datasets ====
-Contributors: G. Martucci, H. Russchenberg
+The essential instruments that must be present are vertically pointing cloud radar and backscatter lidar, together with either regular radiosonde profiles, or hourly model forecast data available over the site. Recommended but non-essential instruments are microwave radiometer (for providing liquid water path) and rain gauge.
+Processing is done one day at a time. Ideally the instruments operate continuously, but if at any time in the day radar, lidar or model data are missing then there will be a gap in the output product. The absence of data from the non-essential instruments may mean that correction for radar attenuation is not possible, but data quality flags will indicate that this is the case.
-==== Fundamentals====
+The decision regarding which instruments and auxiliary data to include in this product was made by considering those that are most used in retrieval algorithms and those that are necessary to correct for radar attenuation and flag bad data. Radar and lidar are complementary due to their very different dependence on particle size; this means that the combination of the two offers the most accurate estimates of cloud occurrence and cloud fraction (Mace et al. 1998, Hogan et al. 2001), and can also be used to retrieve particle size (Donovan et al. 2001, O’Connor et al. 2004). However, it is not the intention that all instruments at a site that could conceivably be used in a retrieval algorithm (or that might be useful for model comparison, such as broadband fluxes) should be combined into this product; instead, routines for placing other instrument data on the same time-height grid are provided for this task.
-Both aerosols and clouds cause a direct radiative forcing by scattering and absorbing solar and infrared radiation in the atmosphere. The aerosol mass load along the atmospheric column as well as the aerosol optical thickness are integrated variables that can be used to infer the aerosol direct radiative effect. In the last century, with the global increase of their average load, aerosols have most likely made a significant negative contribution to the overall radiative forcing. In fact, the IPCC fourth assessment report (IPCC, AR4, 2007) provides a -0.5 ± 0.4 W m-2 cooling effect due to the anthropogenic component of the total aerosol in the atmosphere. Through their role as nuclei of condensation, aerosols also alter warm, ice and mixed-phase cloud formation processes by increasing droplet number concentrations and ice particle concentrations. They decrease the precipitation efficiency of warm clouds and thereby cause an indirect radiative forcing associated with these changes in cloud properties. At the global scale clouds increase the reflection of incoming solar radiation from 15% to 30% with an overall forcing of about -44 W/m2. On the other hand, the reduced cloud thermal emission below clear-sky values enhances the cloud greenhouse effect by about 31 W/m² thus determining a net cooling effect of about 13 W/m² (Ramanathan et al., 1989). The determination of the global cloud radiative forcing intended as the difference between the radiation budget components for cloudy conditions and clear-sky conditions is a challenging task which remains affected by a large uncertainty. The increase in global surface temperature of 0.6°C that occurred in the last century corresponds to a change of less than 1% in the radiative energy balance between short wave (SW) absorption and long wave (LW) emission from the Earth system (Kaufman et al., 2002). Despite the critical role of this energy mechanism, the balance between cooling and warming effect due to LW and SW net fluxes in cloudy regions remains one of the largest uncertainties when assessing the aerosol indirect effect, IE (Twomey, 1977).  The reported observation that the greenhouse effect due to cloud is larger than the equivalent effect from a hundredfold increase in CO2 mixing ratio (Ramanathan et al., 1989) as well as the fact that hydrometeors size and concentration affect the cloud albedo are amongst the primarily reasons why in the last 50 years studying cloud microphysics became paramount in order to understand climate changes. The level of water vapour supersaturation and the number of cloud condensation nuclei (CCN) is also indirectly related to the cloud albedo. In polluted air the number of CCN is supposed to increase rapidly leading to increased CDNC (Twomey, 1977), nevertheless the efficiency in activating CCN into CDNC depends on a number of factors including CCN size, chemical compositions and cloud dynamics (updraft and downdraft).  There are instead no evidences of the impact of the entrainment-mixing on the activation process, although recent studies indicate homogeneous and inhomogeneous mixing as depleting mechanism for CDNC formation especially in warm cumuli (e.g. Morales et al., 2011).
+The algorithm is implemented in [http://www.mathworks.com Matlab], although future implementation in C and/or python is possible. The input datasets are read into the processing algorithm using separate functions that may make modifications depending on the particular instrument and site.
-[[File:IPCC_AR4_RadForcing.jpg|450px|thumb|left|Figure 1: : Global average radiative forcing in 2005 (5 to 95% uncertainty ranges) with respect to 1750 for CO2, CH4, N2O and other important agents and mechanisms, together with the typical geographical extent (spatial scale) of the forcing and the assessed level of scientific understanding (LOSU). Courtesy of IPPC (AR4, 2007)]]
+==== Cloud radar ====
-Global numerical models can improve the knowledge of cloud microphysics at both global and regional scales notwithstanding the large computational costs and the significant uncertainty at the smaller scales. On the other hand, numerical simulations at the regional and micro-scale (cloud-resolved scale) can resolve with explicit integration schemes and reduced computational costs the microphysical processes of cloud formation and lifetime allowing the assessment of the aerosol IE, but lose in representativeness at larger scales. Clouds and aerosols observations from networks of in situ and ground-based remote sensing instrumentation are detailed and usually better descriptions of the optical and microphysical processes than the numerical models but have limited and heterogeneous geographical cover, usually more representative of specific areas like Europe and North America. In situ measurements are usually accurate and represent a reference for the ground-based remote sensing retrieved microphysics. The need of a reference becomes important especially when the microphysics is retrieved by integrated profiles and combined methodologies using multiple sensors based on different assumptions leading to significant errors. However, in situ measurements of cloud products require in-cloud flights or radiosoundings which have high costs and can only be organized occasionally or with poor temporal resolution.
+The vertically pointing radar would typically operate continuously at 35 or 94 GHz and provides profile with a time resolution of around 10-30 seconds and a height resolution of 30-60 m (better than 100 m). The radar resolution is used as a master grid on to which all other datasets are placed. The temporal resolution of 30 s is long enough that the datasets are conveniently small to use, but short enough that cloud fraction and other parameters to be used to evaluate models are of sufficiently high precision. Essential parameters that the radar must provide are radar reflectivity factor Z and Doppler velocity &nu; (There are some sites with current and/or legacy data without Doppler velocity; the algorithm may be modified in future to cope without Doppler velocity). Radar reflectivity factor should have had the following processing applied to it:
+* Linear averaging to the resolution required.
+* Noise subtraction: the reported Z should be that of the atmospheric targets without the contribution from instrument noise and thermal emission that is present in the raw measurements.
+* Clear sky clearing: areas with no detectable atmospheric signal should be flagged (or SNR should be available). Any remaining speckle noise should be removed using masking algorithms.
+* Elimination of artefacts, such as the near field effect for instruments with large antennas, overlap effects for some bistatic systems and spurious instrument-specific echos.
-On the contrary, ground-based remote sensing instrumentation can provide the cloud microphysics with cost-effective and continuous measurements. One solution is to adopt an established reference from either in-situ observations or numerical simulations and to calibrate different retrieval techniques against the accepted reference. This is normally a two-step procedure based on (i) the calibration of different microphysical retrieval methods against the selected reference and (ii) the following iterative convergence of the calibrated methods to a common microphysics with minimized uncertainty. The literature shows that the use of synergistic information from passive and active co-located remote sensors can provide sufficient input data to retrieve the cloud microphysics based on a number of assumptions (characteristic of each method). An efficient system of measurements must ensure the operational retrieval of the main cloud microphysical variables such as cloud droplets number concentration (CDNC), effective radius (<math> R_{eff} </math> ), liquid water content (LWC), cloud albedo and cloud optical depth (COD). Several studies in the last two decades presented different methodologies capable to retrieve the microphysics of liquid clouds by combining data from ground-based remote sensing instrumentation (Fox and Illingworth, 1997; Boers et al., 2000; Liljegren et al., 2001; Dong and Mace, 2003; Boers et al., 2006; Illingworth et al., 2007; Turner et al., 2007; Brandau et al., 2010; Martucci and O'Dowd, 2011).  All together, these retrieval techniques provides the full set of required microphysical variables (i.e. LWC, CDNC, <math> R_{eff} </math> , albedo and COD), however most of them can only provide a sub-set of variables which often prevents the calculation of the  aerosols  IE unless including significant parameterizations and introducing additional uncertainty.
+Note: Although definitions and processing may be performed with Z in linear units, it is conventional to report the values in logarithmic dBZ units defined thus:
-==== Cloud Droplet Number Concentration ====
+<math>Z [dBZ] = 10 \log_{10} Z [mm^6 m^3]</math>
-Contributors: G. Martucci
-The size distribution of droplets in a liquid cloud can be determined by in-situ or laboratory studies using elctronic techniques involving the spectrometry of the samples and sorting of droplets into size bins characterized by specific number concentrations. An example of spectrometry technique is the Forward Scattering Spectrometer Probe - FSSP - it is an optical particle counters (OPCs) that detects single particles and size them by measuring the intensity of light that the particle scatters when passing through a light beam. As all in-situ measurements also the FSSP modifies the droplet size distribution by simply interacting with the droplets and can locally modify ceryain microphysical parameters like the level of supersaturation. Although very accurate the cloud droplets size distribution and number concentration (CDNC) measurement techniques are affected by errors and uncertainties of different nature and significance. A common and well-accepted way to calculate the droplet size distribution ''n''(''r'') not involving direct measurements of the droplet distribution relies on mathematical parameterizations of the size distribution. According to Levin (1954), the size distribution of droplets in liquid clouds can be represented faithfully by a log-normal distribution like the one shown here,
+The quality control algorithm attempts to flag likely ground clutter, but since the clutter behaviour can be very different for different radars it is better if it can be removed prior to being read in. Likewise, it is beneficial but not necessary for insects to have been identified; if available, the LDR parameter is an excellent discriminator. The radar should report values as low as possible above the ground. No attempt should be made to correct for attenuation. The radar should obviously be calibrated as well as possible and an indication of the likely accuracy of the calibration should be available. If necessary the appropriate factor will be applied to Z in order to conform to the following calibration convention, defined for a distribution of Rayleigh-scattering liquid water droplets in the absence of attenuation:
-<math>n(r)\,=\,\frac{N}{\sqrt{2\pi}\log{\sigma_g}} \exp{\bigg\{-\frac{(\log{r}-\log{r_g})^2}{2\log^2{\sigma_g}}\bigg\}}</math>,
+''in the absence of attenuation, a cloud at 0 &deg;C containing one million 100 &mu;m (i.e. Rayleigh scattering) droplets per cubic metre will have a reflectivity of 0 dBZ at all frequencies.''
-where ''n''(''r'') is the droplet number at radius ''r'', ''N'' is the total number of droplets, <math>\sigma_g</math> is the standard deviation of the log-normal distribution and <math>r_g</math> its mean geometric radius.
+If several reflectivity channels are available from a particular site, such as the four specialized modes used by the MMCR radars on the ARM sites (Clothiaux et al. 1999), then the one most free from artefacts will be taken, even if this is not the most sensitive. This is because the Instrument Synergy/Target Categorization product is intended to be used in automated algorithms that operate on large volumes of data without the need for significant human quality control. The Doppler velocity should have had clear sky pixels removed in the same way as Z. If necessary, the values will be inverted to ensure that the convention of positive velocities upwards is adhered to. The velocities need not be unfolded, but the folding velocity &nu;fold should be known to the algorithm. It is possible that the algorithm for locating the melting layer (see section 3.4.1) will perform poorly if the folding velocity is too small.
-An alternative way to represent the droplet size distribution (DSD) is by a mono-modal gamma-type distribution. It is indeed convenient to adopt the already known and extensively used Gamma distribution (Boers and Mitchell, 1994) in the form of,
+Other radar parameters, such as spectral width (<math>\sigma_\nu</math>), will be transferred into the output dataset. If available, the 30-s standard deviation of the 1-s mean velocities, <math>\overline{\sigma_\nu}</math> (used to estimate turbulence levels; Bouniol et al. 2003), will be used to assist in the diagnosis of ground clutter.
-<math>n(r,z)\,=\,a(z)r(z)^{\alpha}\,\exp{(-b(z)r(z))}</math>
+==== Cloud lidar ====
-where ''n'' is the droplet concentration density, ''r'' is the radius of the droplets, ''b''(''z'') is called rate parameter and ''a''(''z'') is a function of the rate parameter and the Gamma function (<math>\Gamma(\alpha)</math>).
+The cloud lidar is principally used to identify the base of liquid water clouds. Most commonly this instrument will be a ultra-violet, visible or near-infrared lidar ceilometer reporting only attenuated backscatter coefficient, &beta;. The instrument should be operated pointing between 2 and 5 degrees from zenith to avoid specular reflection from horizontally aligned pristine crystals, which could be mistaken by the algorithm for the presence of supercooled liquid water (Hogan et al. 2003b). The lidar should be calibrated as well as possible (e.g. using the technique of O’Connor et al. 2004). Units are in m-1 sr-1. Two algorithms are proposed here:
-==== Effective Radius ====
+. The CLOUDNET algorithm assumes that all signals from the lidar are due to atmospheric particulates such as cloud and aerosol, rather than Rayleigh scattering from air molecules. This is generally valid in the near infrared (e.g. 905 nm used by the Vaisala CT25K and CT75K instruments) but for lidars at visible wavelengths (e.g. 532 nm micropulse lidars used by ARM), an additional processing step is necessary to identify and flag the molecular return. Background and solar noise should also be identified and flagged in the pre-processing step.
-Contributors: G. Martucci
+. The STRAT algorithm (Morille et al. 2007) performs a target classification based on total attenuated backscatter Lidar data. STRAT identifies in each Lidar profile the following categories: (1) portion of the profile where signal-to-noise ratio is below a given threshold, (2) portion of the profile likely to be particle-free (molecular backscatter), (3) portion of the profile with aerosols or clouds (aerosol/cloud separation is available), (4) portion of the profile corresponding to the mixing layer. A configuration file must be adjusted to help optimize the performance of STRAT. STRAT operates on a single Lidar channel, but can be used for any wavelength (ultra-violet, visible or near-infrared). STRAT is developed under GPL licence and available for download at [http://www.lmd.polytechnique.fr/~strat/ STRAT software download ]
-The cloud droplets effective radius <math> R_{eff} </math> is defined as the ratio of the third to the second moment of the DSD, ''n''(''r''),
+Note that lidars with Raman or depolarisation channels are far superior in their discrimination between the various atmospheric particulates; the depolarisation ratio and the extinction are extremely useful parameters for liquid water diagnosis and cloud retrievals, and these are provided in the Instrument Synergy/Target Categorization for instruments in quasi-continual operation.
-<math>R_{eff}\,=\,\frac{\int\limits_{0}^{\infty} n(r)\,r^3\operatorname{d}r}{\int\limits_{0}^{\infty} n(r)\,r^2\operatorname{d}r}</math>
+==== Model parameters ====
-A practical way to express <math> R_{eff} </math> takes into account the expression of ''n''(''r'') in terms of the Gamma DSD by also combinig other calculations used in the past and current literature. Fox and Illingworth (1997) found an almost one-to-one relation between the RADAR reflectivity factor and reff. Based on this relation, reff can be expressed as the sixth root of the ratio between the detected RADAR reflectivity and the retrieved CDNC. Then, in case of Rayleigh approximation, the relation between  <math>\langle r(z)^6\rangle</math> and the RADAR reflectivity factor Z [mm6 m-3] is:
+At least four radiosonde profiles per day would be required from close to the site to provide adequate dynamic and thermodynamic data above the instruments. Because most sites do not have this information, we use hourly profiles from short-range model forecasts. These models assimilate the data from the radiosonde network so the temperature (''T''), pressure (''p''), humidity (''q'') and horizontal wind (''u'' and ''v'') will usually be accurate enough for our purposes. We do not make use of the cloud variables as these are to be evaluated, and will generally be much less accurate.
+Before it can be used the model output must be converted into the ''Cloudnet'' single-site model format, which includes calculation of a number of radar propagation and scattering parameters at 35 GHz and 94 GHz that depend on thermodynamic state. The variables ''T'', ''p'', ''u'' and ''v'' are then interpolated on to the time grid of the radar and provided as part of the Instrument Synergy/Target Categorization product. To conserve space, they are not interpolated in height; subsequent processing algorithms will need to do this. The following additional parameters are ingested and used by the algorithm: specific gas attenuation k<sub>g</sub> (dB km-1) (predicted from model ''q'', ''T'' and ''p'' using the line-by-line model of Liebe 1985), specific gas attenuation for saturation with respect to liquid water k<sub>gs</sub> (dB km-1) and specific liquid water attenuation k<sub>l</sub> (dB km-1 [g m3]-1), using the formulation given by Liebe et al. (1989).
-<math>\langle r(z)^6\rangle\,=\,\frac{Z(z)}{64\,N(z)}</math>,
+==== Microwave radiometer ====
-Then, using the relation between the third and the sixth moment of the DSD and using the dependence on the DSD size parameter, <math> R_{eff} </math> can be written as,
+A recommended but optional input dataset is liquid water path (LWP) derived from dual- or multi-frequency microwave radiometers. LWP is used in many retrieval algorithms for liquid water clouds. Ideally LWP will not be derived using climatologically tuned coefficients, as these can result in errors exceeding 50 g m<sup>-1</sup> and retrieved values that are negative. One method is described by Gaussiat (2004) which makes use of other sources of data to provide more accurate coefficients; lidar is used to locate the height (and therefore the temperature) of liquid cloud, and the model to provide a more appropriate humidity distribution than climatology. Also, profiles identified by the lidar to be free of liquid water cloud are used to estimate the zero offset and by interpolation across periods of cloud, to provide considerably more accurate LWP in thin cloud. This approach also has the advantage that it can produce accurate LWP even if with poorly calibrated radiometer channels.
+LWP is important for the correction of radar attenuation in liquid water clouds; at 94 GHz it can exceed 5 dB and so if correction is not performed then reliable retrievals in ice clouds above liquid clouds based on the value of ''Z'' are impossible.
+====  Rain gauge ====
-<math>R_{eff}\,=\,k_2^{-1}\,k_6^{-\frac{1}{6}}\,\bigg(\frac{Z(z)}{64\,N(z)}\bigg), \qquad k_2\,=\,\frac{\alpha^{\frac{1}{3}}\,(\alpha+1)^{\frac{1}{3}}}{(\alpha+2)^{\frac{2}{3}}}, \qquad k_6\,=\,\frac{(\alpha+3)\,(\alpha+4)\,(\alpha+5)}{\alpha\,(\alpha+1)\,(\alpha+2)}.</math>
+The presence of rain on the dish or radome of a radar can result in a large and variable attenuation (Hogan et al. 2003a), of order 10 dB, making it impossible to use the absolute value of ''Z'' with any reliability. Rain itself also extinguishes the signal and can be difficult to correct for; microwave radiometers do not provide accurate LWP estimates in rain (Crewell and Loehnert, 2003). Radar attenuation due to the melting level is also uncertain. To diagnose the presence of rain we use either a rain gauge or the radar itself. Ideally the rain gauge should have a fairly high sensitivity; tipping-bucket gauges in particular can be very slow to register the start of light rain events. The radar parameters ''Z'', ''v'', and <math>\sigma_\nu</math> in the lowest few gates can also be used to diagnose probable rain on the ground. This approach tends to be more sensitive than a rain gauge, so the rain gauge is not treated as an essential input dataset.
-The coefficients <math>k_2</math> and <math>k_6</math> depends on the shape parameter α and expresses the constant relation between the sixth and the third moment of the DSD.
+Further technical details on the algorithms can be found at [http://www.met.rdg.ac.uk/radar/cloudnet Cloudnet] home page.
-==== Liquid Water Content ====
+=== Mixing height ===
-Contributors: G. Martucci
-The degree of mixing that takes place between the uplifted cloudy air parcel and the drier environment controls the spatial (vertical) distribution of liquid water within a cloud. The cloud dynamics can then be extracted from a vertical profile of condensed liquid water through a cloudy layer especially if accompanied by a profile of temperature. Changes in the water content are paramount thermodinamically, as they lead to large energy changes. The precipitation is in fact strictly related to the temporal and spatial distribution of liquid water in the cloud. A thorough understanding of the mechanisms leading to the major themodynamic changes in the LWC facilitates an accurate calculation of the rate of growth of rain and drizzle drops as well as the assessment of ice crystal formation. This Section has for focus the liquid clouds especially the stratiform boundary layer clouds with negligible ice mass fraction. In these clouds the convection and the supersaturation values are well below the ones reached in the tropical and sub-tropical cumuli where the updraft and downdraft cycle dominates the thermodynacal effects on the LWC through the cloud.
+==== Fundamentals ====
-[[File:INSITU LWC profile.jpg|400px|thumb|left|Figure 2: : LWC by in-situ FAAM BAE-146, MACLOUD Inc, Mace Head, Ireland]]
+The mixing layer height (MLH) is the height of the layer adjacent to the ground over which pollutants emitted within this layer or entrained into it become vertically dispersed by convection or mechanical turbulence within a time scale of about one hour (Seibert et al., 2000). As shown in Figure 3.6.1, during daytime the mixing layer tends to be unstable as a result of convection and is capped by an entrainment zone. At night a shallow stable layer forms near the surface in which mixing occurs through intermittent turbulence, leaving a residual layer above.
+[[File:Mh.1.jpg|300px|thumb|left|'''Figure 3.6.1''': Structure of mixing layer from "An Introduction to Boundary Layer Meteorology", Stull, 1988]]
+MLH is an important parameter for practically all air pollution applications except probably the street scale; it is still one major uncertainty for most air quality models. Different instrumentation and different parameterizations will give variable estimates of MLH. Most desired for air pollution applications are continuous representative time series of MLH for the site of interest. As this is still difficult to achieve with routinely available instrumentation e.g. from NWS networks, also simple parameterizations or even fixed or prescribed values (day/night-time, eventually dependant on atmospheric stability) are still in use. Whereas in convective conditions, MLH is often – and rather straightforward - determined as the capping lid (elevated inversion base) of the convective boundary layer, there is more debate on how MLH is best determined in night-time stable conditions, and which physical processes are relevant for MLH evolution at night.
-For marine boundary-layer stratocumulus (Sc) clouds the LWC follows often a near-adiabatic or adiabatic profile between base and top of the cloud; aircraft in-situ measurements of marine Sc cloud above Mace Head (Ireland) during the MACLOUD field campaign (Decemeber 2010) show a typical LWC profile (Figure 2). In adiabatic conditions the LWC increases linearly from the base to the top of the cloud and can be expressed by the formula,
+As pointed out in Seibert et al. (2000), there is no ‘MLH-meters’ able to determine the MLH without uncertainties and assumptions. Furthermore, the definitions itself of Mixing Layer are dependent on the quantity employed in the definition itself. Being the mixing due to turbulence, the best definitions appear those making use of the turbulence.
+Unfortunately, direct measurements of turbulence are very complex, and its remote sensing is currently out of our reach. As a surrogate, we can alternatively measure some proxies or drivers of the turbulence, as the temperature and wind profile, the energy fluxes, the profile of pollutants.
+The remote sensing of these parameters has become now possible with a variety of instruments, and the evaluation of the MLH is then possible as well. However, some assumptions may be made according to the technique employed.
+For example, the potential temperature is used in the parcel method and related techniques (all those using the temperature profile). However, this makes sense only under convective regimes, being the potential temperature profile a proxy of convection. Mechanically-induced turbulence cannot be determined by this approach.
+Likewise, the aerosol can be used as a tracer of the mixing processes in the PBL, even though advection from long distances may complicate the scenario and make very difficult the tracking of the MLH, especially by automated algorithms. This problem lead to attribution problems that will be discussed later on.
+In case of stable boundary layer, in fact, some problems limit the applicability of remote sensing techniques to determine the MLH. One is related to the minimum altitude of reliable detection, different for each instrument and dependant on the sounding technique (sodars and mini-sodars allow the first gate to be within a few meters, while electromagnetic-related techniques usually suffer for a larger blind zone).
+[[File:Mh.2.jpg|400px|thumb|right|'''Figure 3.6.2''': Integral scale depth for potential temperature for different classes of profiles.]]
+On the other hand, the definition itself of stable boundary layer is complicated by the fact that the turbulence in the stable boundary layer is rather complex, and however weak. The SBL is usually represented as composed by two layers: the lowest, in contact with the soil, showing mostly continuous turbulence, caused by wind shear and radiative forcing. The upper layer is characterized by sporadic turbulence, caused mainly by breaking of gravity waves, presence of clouds and wind shear.
+Since the profiles are usually smooth, a good quantity for comparisons is the Integral Scale Depth of SBL, as proposed by Stull:
-<math>LWC(z)\,=\,\frac{4}{3}\,\pi\,\rho_w\,N(z)\,\langle r(z)^3\rangle</math>.
+<math>H_\xi = \frac{\int_{Z} \xi\, dz}{\xi_S}</math>
-The LWC is then proportional to the concentration of cloud droplets N (N indicates CDNC) and to the third moment of the DSD. Although the departure from purely adiabatic conditions is normally not significant for marine Sc, there are cases in which the adiabatic assumption leads to a significant overestimation of the total amount of water in the cloud and to inaccurate micriphysics. A linear modification of the above expression of the LWC includes the subadiabatic term <math>f(z)</math>. In fact, in order to provide a realistic representation of the liquid water profile through liquid clouds, the subadiabatic function <math>f(z)</math> is considered to describe the adiabatic departure at each height z:
+Where &xi; can be potential temperature, relative humidity or any other quantity with asymptotic behavior towards the free troposphere.
+This means that it is often very hard to compare MLH measurements if based on different instruments or different proxies (adapted from Stull).
-<math>LWC(z)\,=\,f(z)\,A_{ad}\,z</math>.
+==== Available Techniques ====
-This above expression for the LWC introduces the subadiabatic function <math>f(z)</math> which depends on the height ''z'' along the cloud layer and that modifies the vertical gradient of the adiabatic LWC, <math>A_{ad}</math>, by providing the subadiabatic departure along the LWC profile.Different approaches to calculate the departure correction function f(z) have been suggested in the recent literature (Boers et al., 2000; Boers et al., 2006; Brandau et al., 2010, Martucci and O'Dowd 2011) and they all use the integrated for of the LWC retrieved by a microwave-radiometer to constraint the above equation and assess the calue of <math>f(z)</math>.
+Mixing layer depth can be determined either (1) using temperature, humidity, wind and turbulence profiles from in-situ or remote sensing based vertical profiles or (2) by tracing gradients in atmospheric constituents or structures using remotely sensed vertical profiles (lidar, wind profiling radar, sodar). This is illustrated in Figure 3.6.3. '''It is important to keep in mind that the (dis)agreement between different retrievals (e.g. temperature based vs aerosol based) is driven to a large extent by the (in)consistency between the atmospheric parameters of interest (e.g. potential temperature profile vs aerosol concentration profile)'''.
+[[File:Mh.3.jpg|500px|thumb|left|'''Figure 3.6.3''': Structure of PBL for convective (left) and stable (right) cases with
+potential temperature &theta;<sub>v</sub>, wind speed M,  water vapor mixing ratio r, and pollutant concentration c, from "An Introduction to Boundary Layer Meteorology", Stull, 1988.]]
+Techniques to derive the mixing layer depth (MLD) from thermodynamic vertical profiles date back to the 1970’s. Extensive reviews are published on this topic regularly. Similarly methods to diagnostic MLD from model or analyses fields are also well described in the literature. An overview on methods how to derive MLH from measurements as well as parameterizations in meteorological pre-processors are given in Fisher et al. (1998; COST action 710). A paper by Seibert et al. (2000) provides a review and intercomparison of operational methods for the determination of the mixing height. A review of methods for urban areas is given in Piringer and Joffre (2005; COST action 715). Emeis et al. (2008) provides a review of surface-based remote sensing of the mixing-layer height. The reports reflect the status of MLH retrieval shortly before they were finalized.
-==== Liquid Water Path ====
+The table 3.6.1 summarizes tracers and instruments that can be used to estimate the depth of the mixing layer. Without being fully comprehensive, it provides a quick overview.
-Contributors: J. Gueldner
-[[File:Histogram_LWP_kl.png|700px|thumb|right|Figure 1: Histogram of MWP-derived LWP at Lindenberg observatory during 2010]]
+{| width="100%" cellspacing="0" cellpadding="5" style="border: 1px solid darkgray; background: #f9f9f9;"
+!colspan="4"|Table 3.6.1: Tracers and instruments used to estimate the depth of the mixing layer
+|- valign="top" style="background: #f2f2f2;"
+! scope="col" style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" | Tracer
+! scope="col" style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" | Instrument
+! scope="col" style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" | Pros
+! scope="col" style="border-bottom: 1px solid darkgray;" | Cons
+|- valign="top"
+| style="border-right: 1px solid darkgray;" | Temperature
+| style="border-right: 1px solid darkgray;" |
+* About the tracer:
+| style="border-right: 1px solid darkgray;" |
+* It is somehow a 'simple' parameter
+: Gives the thermodynamic status of the atmosphere
+|
+* Works well only under convective regimes. Not trivial to detect MLH under stable conditions. Multiple inversions often observed
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Radiosonde
+| style="border-right: 1px solid darkgray;" |
+* Routinely operated
+|
+* Sparse temporal resolution
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Tethered balloons
+| style="border-right: 1px solid darkgray;" |
+|
+* Typically, low resolution
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Raman Lidar
+| style="border-right: 1px solid darkgray;" |
+* High resolution
+|
+* High cost
+|-
+| style="border-right: 1px solid darkgray; border-bottom: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* MWR
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* Continuous measurements 24/7, all weather
+: High resolution between surface and 500 m
+| style="border-bottom: 1px solid darkgray;" |
+* Vertical resolution too coarse beyond 500m to capture temperature inversions
+|- valign="top"
+| style="border-right: 1px solid darkgray;" | Vertical wind
+| style="border-right: 1px solid darkgray;" |
+* About the tracer:
+| style="border-right: 1px solid darkgray;" |
+* Direct measurement of vertical motions in the convective and stable boundary layers
+|
+* Difficult to measure
+: Useless
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Doppler lidars
+| style="border-right: 1px solid darkgray;" |
+* Aerosol requested for operational instruments
+|
+* High cost, few measurements currently
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Wind profilers
+| style="border-right: 1px solid darkgray;" |
+|
+* High cost, attribution problem (Emily’s talk)
+|-
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* Sodar
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* No tracer is needed, 3D wind field
+| style="border-bottom: 1px solid darkgray;" |
+* Low height
+|- valign="top"
+| style="border-right: 1px solid darkgray;" | Aerosol
+| style="border-right: 1px solid darkgray;" |
+* About the tracer:
+| style="border-right: 1px solid darkgray;" |
+* Easy to measure with high resolution
+|
+* Presence of aerosol is required
+: Advection or removal complicates the situation
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Ceilometers
+| style="border-right: 1px solid darkgray;" |
+* Relatively inexpensive
+|
+* Overlap problems for stable layers. Attribution problems
+|-
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* Research lidars
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* Can measure turbulence using variance of signal
+| style="border-bottom: 1px solid darkgray;" |
+* Works well under convective regimes. Need of attended use and analysis
+|- valign="top"
+| style="border-right: 1px solid darkgray;" | WV
+| style="border-right: 1px solid darkgray;" |
+* About the tracer:
+| style="border-right: 1px solid darkgray;" |
+* Provides almost (Hennemuth and Lammert) the same results as aerosol
+|
+* It is difficult to measure from remote. Attribution problems
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Raman lidars
+| style="border-right: 1px solid darkgray;" |
+* High resolution (space and time)
+|
+* Expensive, not operational, needs calibration
+|-
+| style="border-right: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;" |
+* Dial lidars
+| style="border-right: 1px solid darkgray;" |
+* Absolute measurement
+|
+* Expensive, not operational
+|-
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* MWR
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* ?
+| style="border-bottom: 1px solid darkgray;" |
+* ?
+|- valign="top"
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" | Radon
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* Radon meter
+| style="border-right: 1px solid darkgray;border-bottom: 1px solid darkgray;" |
+* Direct measurement of the status of mixing
+| style="border-bottom: 1px solid darkgray;" |
+* Only in situ measurements
+: Uncertainties related to the radon immission rate
+|- valign="top"
+| style="border-right: 1px solid darkgray;" | Turbulence
+| style="border-right: 1px solid darkgray;" |
+* Sodar (+ wind)
+| style="border-right: 1px solid darkgray;" |
+* Direct measurement of thermal inhomogeneities at high resolution (&sim;m, &sim;s)
+|
+* Low altitude range (<1 km), works well only under stable conditions or weak convection
+: Uncomfortable in populated areas
+|}
-The Liquid water path (LWP) can be measured by Microwave radiometer (MWR), Cloud radar and in the case of thin clouds by Infrared radiometer (Turner, 2007).
-The estimation of LWP by ground-based microwave radiometry has a long tradition. Westwater (1978) proposed a dual-frequency radiometer with channels at the wing of the water vapor line at 22.235 GHz and in the window region at 31.65 GHz to derive the Integrated water vapor (IWV) and the LWP of the atmosphere. First tests start in 1980.
-Details of the physical background are described in the [[MWR Fundamentals]] and in various reviews as e.g. Askne and Westwater (1986).
-In summary, due to the nearly linear relation between TB and IWV as well as vs LWP, the integrated values can be derived by linear equations as follows:
+From lidars and ceilometers, the MLH may be derived using different proxies, according to the measured parameter:
-IWV = a<sub>0</sub> + a * TB
+'''Rayleigh (elastic) lidar'''
-LWP = b<sub>0</sub> + b * TB
+Provides the aerosol backscatter profile, and the MH is hence based on the assumption that ground-emitted pollutants (like the aerosol) is dispersed and mixed within the whole PBL by turbulence. Three different techniques have been proposed for the MLH determination from aerosol backscatter profiles and will be discussed in sect. (YY).
-where a and b denote the coefficient vector and TB the brightness temperatures of the radiometer. Regression coefficients are calculated mainly on the basis of training data sets consisting of concurrent TB and IWV/LWP values. Both TB and LWP are results of radiative transfer and cloud model calculations basing on a representative dataset of radiosonde observations.
+'''Raman (water) lidar'''
-The dimension of TB increases from two to higher numbers at the end of last century.
-[[File:LWP_Jan_2010.png|700px|thumb|right|Figure 2: Model and MWR LWP (top) and solar radiation balance (bottom) observed at Lindenberg observatory in January 2010]]
-First multichannel radiometers were developed to retrieve vertical structures of thermodynamic variables. Closely related was an accuracy improvement of LWP retrievals achieved by multiple regression techniques or neural networks. Löhnert and Crewell (2003) have shown by numerical experiments that the use of additional channels at about 50 GHz and 90 GHz result in better retrievals. Compared to the classical two-channel algorithm the rms-error could be reduced from about 35 gm<sup>-2</sup> to 15-20 gm<sup>-2</sup>. Therefore systematic errors due to different cloud model statistics became more important.
-Nevertheless, in spite of the technological progress uncertainties in LWP estimations remain unsettled. In a study (Turner et al., 2007) an identical data set of brightness temperatures was used to retrieve LWP by various methods and absorption models. The results are sensitive to the absorption models used as well as to the retrieval methods and cause biases of up to 40%. Hence, the combination of different active and passive sounding instruments is needed to meet user requirements.
-However, due to their capability to provide continuous observations, microwave derived LWP are widely used and well suited for a multitude of tasks:
-*Long-term observations (Validation of new methods, climate applications)
+The Raman lidar may provide the water vapor mixing ratio profile, if the suitable channel is operating. The water vapor profile may be employed as the aerosol profile, if it can be assumed produced at ground and mixed by atmospheric turbulence.
-** Figure_lwp1 gives an impression about the amount of liquid water at Lindenberg during one year. It shows a histogram of non-rejected retrievals indicating that no liquid water was observed at about 24% of the cases. For only for 8% the LWP was greater than 200 gm<sup>-2</sup>.
-*Sensor synergy ( IPT, Cloudnet)
+'''Doppler (wind) lidar'''
-*NWP model validation:
-** For validation studies LWP measurements are needed as component of a variety of continuously observed parameters. Investigations, which aim at the revealing of possible deficiencies in the model parameterization, have to rely on the long-term availability of corresponding parameters. The periods may cover time intervals ranging from months up to several years. LWP from MWP can be provided for such long periods of time. In the frame of a validation study (Vogel et al., 2011, personal communication) of operational weather forecast models (IFS, COSMO-EU) a systematic prediction error of the 2 m temperature during winter months was found. The overestimation of the noon temperature results from an error of the radiation balance at surface of about 20-40 W m<sup>-2</sup>. In order to find reasons for the overestimation the radiation balance was split into solar and thermal components. In fact, model radiation peaks appear in low stratiform clouds because their cloud water content is considerably to low compared to the MWP-derived LWP. Furthermore, if the model produces a realistic LWP then the radiance balance simulated by the IFS agrees with the observation (Figure).
-==== Indirect effect ====
+Doppler lidars provide the profile of wind (u, v, w), making it a very promising instrument for the detection of turbulence (if suitable spatial-temporal resolution is achieved), and convection through the w component. These quantities are directly connected to the turbulence processes and this kind of instrument can then provide a reliable information about the PBL dynamics. However, these instruments are still  expensive and have not reached a large diffusion yet. Moreover, the commercial wind lidars make use of the aerosol signal (which is orders of magnitude larger than the molecular one), so the presence of aerosol is, again, mandatory for a good signal-to-noise ratio and the determination of the MLH.
-Contributors: G. Martucci, H. Russchenberg
-The generally accepted way to quantify the radiative forcing due to clouds (cloud albedo forcing) is to study the change of representative cloud microphysical variables (e.g., <math> R_{eff} </math>) against a representative sub-cloud aerosol quantity (e.g., extinction). The cloud albedo depends on the cloud (geometrical and optical) thickness, the LWC and the CDNC and it is a way to express the amount of reflected and absorbed solar radiation by a cloud. The cloud albedo contributes then, as other indirect effects, to a global cooling by net removal of incoming solar radiation from the lower atmosphere (Seinfeld and Pandis, 1998; Ackerman et al., 2000, Zhao et al., 2012). McComiskey and Feingold (2007) have indicated that the radiative forcing of the aerosol indirect effects (''IE''), which is the difference in radiative flux that occurs as a result of changes in cloud properties for post- versus pre-industrial aerosol concentrations, ranges from -3 to -10 W m-2 for each 0.05 increment in ''IE'' (<math style="vertical-align:-50%;">\textstyle{IE\,=\,-\partial\ln{(R_{eff})}/\partial\ln{(\alpha})} </math> , where <math> \alpha </math> is the aerosol amount). Therefore, the accurate quantification of the aerosols ''IE'' is paramount for better prediction of climate change. In-situ airborne retrievals of the <math> R_{eff} </math> and CDNC conducted in the past have facilitated the aerosols ''IE'' assessment with satisfactory accuracy (e.g. Brenguier et al., 2000). However, aircraft campaigns are costly, labour-intensive and not suited to long-term monitoring purposes. As described by Feingold and colleagues in 2001 and 2003, the combined retrievals of the sub-cloud aerosols optical properties (e.g., extinction, <math>\sigma</math>) and the cloud microphysics allow the assessment of the ''IE''. Quantification of the IE using state-of-the-art techniques mainly relies on the inherent relation between the mean cloud droplet <math> R_{eff} </math> and the sub-cloud value of <math>\sigma</math>,
+==== Retrieval algorithms based on aerosol backscatter Lidars and ceilometers ====
-<math>IE\,=\,-\partial\ln{(R_{eff})}/\partial\ln{(\sigma})</math>
+As mentioned in sect. 3.6.2, the determination of the MLH by lidar/ceilometers consists in solving two different problems: first, the recognition of all the aerosol layers, and then the attribution of the PBL top to one of the layers found. This problem is sometimes referred to the ‘attribution problem’, and will be presented in section 3.6.4. Here the problem of the layer recognition will be discussed.
-The methodology behind eq.1 reflects the choice of using <math>\sigma</math> as widely accepted proxy for the aerosols ''IE'' assessment to represent the generic aerosol amount <math> \alpha </math>; while this relation permits to quantify the aerosols ''IE'' not only by in-situ measurements but also using ground-based remote sensors, it exposes the aerosols ''IE'' quantification to the large uncertainty usually related to the <math> R_{eff} </math> and <math>\sigma</math> retrievals. Nevertheless, the successful calibration of the microphysics retrieval methods against an established and reliable reference leading to the convergence onto a common and more accurate microphysics by iterative evaluations would reduce the uncertainty associated to the microphysical variables and provide the bedrock for an even more advanced assessment of the ''IE''.
+Almost all operational eye-safe lidars (historically known as ceilometers) make use of Rayleigh scattering to provide information about clouds and aerosols throughout the troposphere. The Rayleigh echo from molecules and aerosols allow the elastic lidars to measure the aerosol backscatter coefficient, and, with greater uncertainty, the extinction coefficient and the optical thickness. So far, the calculation of these products requires attended calibration of the instrument and data inversion, although several semi-automated methods have been proposed so far (O’ Connor; Wiegner and Geiss). This aspect is described in sec. 3.4. However, this is a rather time-consuming activity, and hence it is not suitable for continuous and operational observations.
-In fact, the general definition of the aerosols ''IE'' can be expressed by:
-<math>IE\,=\,-\partial\ln{(C_{var})}/\partial\ln{(A_{var}})</math>,
+In the recent years, several techniques have been investigated to automatically derive some useful information from raw lidar profiles. These information include: cloud base (and eventually top), cloud coverage, presence of rain, and height of the mixing layer. This latter, in particular, is still an open task since several problems still limit the reliability of such product.
-Where <math>C_{var}</math> and <math>A_{var}</math> are the representative variables for cloud and aerosol amounts, respectively. A sensitivity analysis of the aerosols ''IE'' to new proxies can then be performed in order to further reduce the uncertainty affecting its quantification.
+However, several automatic analysis may be performed using the background-subtracted signal coming from the instrument, eventually under the form of Range-Corrected Signal (commonly referred to as RCS or Pr2) or logarithm of RCS.
+The determination of aerosol layers is usually performed on the RCS or ln(RCS), although some authors prefer the signal.
-New proxies can be defined through:
+The methods proposed so far to infer the boundary layer height, also referred to as mixing layer height or mixing height, from elastic lidar backscatter data may be classified in three categories:
-<math>IE\,=\,-\partial\ln{(R_{eff})}/\partial\ln{(\sigma})</math>,
+* threshold method;
+* variance method;
+* gradient method.
-<math>IE\,=\,-\partial\ln{(N_{cloud})}/\partial\ln{(N_{cloud}})</math>,
+The threshold method has been proposed by Melfi et al. (1985), and is based on the assumption that the aerosol load in the free troposphere is very low. In this case, the aerosol backscatter is significantly higher than zero only in the PBL. The ML is then determined as the zone, close to the ground, where the backscattering exceeds a fixed threshold. This technique requires a good signal-to-noise ratio, being quite sensitive to noise in the data.
-<math>IE\,=\,-\partial\ln{(Z_{cloud})}/\partial\ln{(\sigma})</math>,
+The variance method is a powerful technique that employs the temporal variance of the signal to detect the MH (illustrated in Figure 3.6.4). In fact, it has been shown that a maximum in the aerosol backscatter signal is associated to the entrainment zone, which is the interface between the mixed layer and the free troposphere. This layer is characterized  by the different eddies reaching different heights, causing a large variance in the aerosol cross section.
+[[File:Mh.4.jpg|300px|thumb|left|'''Figure 3.6.4''': MLD detection method using  the maximum variance technique. References: [Hennemuth and Lammert, 2005], [Hooper and Eloranta, 1986], [Menut et al., 1999]]]
+[[File:Mh.5.jpg|450px|thumb|right|'''Figure 3.6.5''': MLD detection methods using  the first (a) or second (b) derivative of  Pr2 or the first derivative of the logarithm of Pr2 (c) References: [Flamant et al., 1997,], [Martucci et al., 2007], [Menut et al., 1999], [Sicard et al., 2006]]]
+However, although this method is very powerful for the determination of the convective boundary layer, its reliability under stable or neutral conditions has not been proved so far. When turbulence is very weak, as often happens during nighttime, not necessarily the highest variance is directly connected to the top of the mixing layer. In these conditions is even hard to define the mixing layer, and often the most reliable method to detect the mixing status of the atmosphere is a direct measurement of the aerosol distribution (Seibert et al, 2000). However, the use of variance to detect the height of the stable boundary layer has been further investigated by Pal et al. (2013, submitted).
+Another key point concerning the variance method is that it requires a very high signal-to-noise ratio, so that the variance can be attributed to variation in the signal and not induced by noise. Many ceilometers, especially those composing current  networks are not powerful enough to provide a reliable variance profile with acceptable time resolution. Next generation ceilometers will likely allow to use this quantity to add valuable information to the MLH determination procedures.
-<math>IE\,=\,-\partial\ln{(R_{eff}^{\,cloud})}/\partial\ln{(R_{eff}^{\,aerosols}})</math>.
+The gradient method has been proposed by Endlich et al. (1979), and rests on the hypothesis that the aerosol is produced at ground and is well mixed within the boundary layer. The lowest inflection point detected in the aerosol backscatter coefficient indicates the MLH.
+The identification of the inflection points can be performed either by direct numerical differentiation (the first (a) or second (b) derivative of the range-corrected signal Pr2 or the first derivative of the logarithm of Pr2 (c) ; illustrated in Figure 3.6.5) or by discrete wavelet transform (maximum correlation coefficient between the signal and a wavelet, illustrated in Figure 3.6.6). The wavelet transform to detect the MH from lidar data has been first proposed by Davis (2000). The advantage of this technique is that it is less prone to noise since an integral is calculated, rather than a derivative. However, if a convenient smoothing is performed on the data, the two operations produce very similar effects.
+[[File:Mh.6.jpg|300px|thumb|left|'''Figure 3.6.6''': MLD detection method using  the wavelet covariance. References: [Baars et al., 2008], [Brooks, 2003], [Cohn and Angevine, 2000], [Teschke et al. 2008 ], [Haij et al., 2007], [Morille et al., 2007,], [Wauben et al, 2008]]]
+[[File:Mh.7.jpg|500px|thumb|right|'''Figure 3.6.7''': Strong Saharan advection observed by a CHM-15k Nimbus over San Pietro Capofiume (Po valley, Italy). The dynamics of the PBL is hardly visible against the strong aerosol structure reaching 5 km. The grey lines represent the timing of sun rise and set, from left to right.]]
+At the base of these three categories there are however some common assumptions, coming from the fact that the aerosol is used as a tracer of the boundary layer.
+This implies that it is supposed to be emitted at ground and mixed by turbulence within the PBL. Wind or inhomogeneities of the surrounding area may limit the validity of these techniques, since the aerosol may be advected from the neighborhood or even from long distances. In case of strong advection of aerosol the individuation of the mixing layer from lidar data may be complicated because of the continuity of the aerosol echo between the mixing layer and the free troposphere above.
+Such a case is shown in fig. 3.6.7, relative to a strong Saharan dust advection over Italy.
+The same is true when the aerosol is removed by strong winds or breeze. In this case, the low aerosol echo does not  allow the identification of aerosol layers.
+Furthermore, in case of fog the signal may be completely extinguished inside the fog layer and no information on the atmosphere above may be retrieved.
-The ''IE'' values obtained from the above equations are affected by different types of uncertainty resulting from the errors related to the individual microphysical variables of both clouds and aerosols. This approach, also supported by the ACTRIS WP22 ''A framework for cloud-aerosol interaction studies'', "aims to provide new recommendations to the scientific community about the development of new experimental means to quantify the indirect effects of aerosols. The need for unambiguous measurements of aerosols ''IE'' challenges the state-of-the-art remote sensing technologies of today and calls for the improvement of new observation methods". EG-CLIMET has provided the optimal scientific environment since February 2008 promoting proactive collaborations amongst the main European research groups in aerosols and cloud microphysics and facilitating the cuncurrent collaboration with other key European projects (e.g., ACTRIS, Paris-Fog, MWRNet) to achieve its objectives. EG-CLIMET created the coditions for a significant advance in the optimisation of cloud microphysical rertieval methods and, in pespective, in the quantification of the aerosols ''IE''.
+==== Retrieval uncertainties based on aerosol backscatter Lidars and ceilometers ====
+There are three important steps in the mixing height retrieval process, namely (1) the lidar/ceilometer pre-processing to produce an attenuated aerosol backscatter profile from raw signal, (2) gradient detection techniques to find the significant aerosol gradients, and finally (3) quality control and layer attribution to identify the actual mixing height from multiple possible layer detections. Each step introduces uncertainty in the retrieval process.
+'''Optical overlap'''. A key aspect in detecting the aerosol layers from ceilometers is the overlap between the laser beam and the field of view (FOV) of the receiver. In fact, closer than the height of complete overlap (HCO), the echo is detected only partially, leading to a raising branch of the lidar signal that confuses gradient detection. Even though a transfer function may be estimated or measured to correct the signal, at very low altitudes the effectiveness of this correction is low because of the high correction factor that amplifies noise, and is inapplicable below the minimum height for which the laser starts entering in the FOV of the receiver. This difficulty leads to a ‘blind zone’ close to the instrument where the top of the PBL may lay under stable conditions, causing the inability to detect the PBL or a wrong attribution to higher layers. For these reasons, it is recommended to design the instruments so that the overlap is reached as low as possible (e.g. beginning of usable signal between 50 and 100m, and full overlap between 200 and 300m), and use an accurate correction function to reconstruct the signal at close range.
+'''Gradient detection'''. Different gradient detection techniques were tested and compared during EG-CLIMET. No evidence was found that the first derivative, wavelet transform, and two-dimensional derivative techniques have different skills to detect one or multiple significant aerosol gradients from lidar and ceilometer attenuated backscatter. Lidar-based retrievals of mixing height were found to be consistent (i.e. within 300 m of) with radiosonde-based retrievals about 70% of the time during daytime, and about 30% of the time at night. Poor performances at night are due to: (1) Lidar optical overlap functions and (2) difficulties in identifying aerosol gradients in stable conditions. However, our studies showed that when mixing height retrievals from a ultraviolet lidar and a near-infrared ceilometer agreed, they were 25-40% more likely to agree with an independent radiosonde mixing height retrieval than when each lidar or ceilometer was used alone (Haeffelin et al., 2012).
+'''Attribution issue'''. While a visual inspection of the lidar profiles usually may give a good idea of the PBL evolution, up to now automated procedures reliable in the widest range of scenarios are not well established. Hence, a correct automatic attribution of the top of the PBL still represents an open research topic. This is mainly because advected aerosol layers as well as residual layers may complicate the scenario and make most automated algorithms fail. The attribution may be helped using both self-consistent data (the internal way) and ancillary data (the external way). Both ways make use of other assumptions employing the physics of the PBL.
+As an example of self-consistent information, the variance of the signal, if provided, may help to point out the turbulent layers, and detect without ambiguity the Convective Boundary Layer (CBL). Several works have been published (Hennemuth and Lammert, 2005; Lammert and Bösenberg, 2006; Pal et al., 2010; Behrendt et al., 2011) on this aspect and the use of variance to detect the CBL is now rather clear. On the contrary, the use of temporal variance of the aerosol echo is much more difficult for stable boundary layers. In this case, in fact, turbulence is often sporadic or driven by wind shear, making the temporal variance much less effective to solve the problem of attribution. However, Pal et al. (2013, submitted) have found that taking into account system noise errors and sampling errors, profiles of detrended, high-pass filtered, aerosol backscatter variances can be derived. These profiles reveal at what height turbulent mixing processes are strongest. In convective conditions, the variance profiles typically exhibit one large maximum at the top of the CBL. In stable conditions, the profile reveals multiple smaller maxima. They find that the lowest variance maximum typically coincides with the height of the lowest aerosol backscatter gradient. By combining gradient and variance analyses, and taking into account atmospheric stability derived from ancillary surface measurements, Pal et al. (2013, submitted) increase substantially the retrieval consistency between Lidar and radiosonde retrievals compared to single retrieval methods presented in Haeffelin et al. (2012). During daytime, they find more than 90% of occurrence when the lidar-radiosonde consistency is better than 150 m. At night, more than 65% of lidar and radiosonde retrievals are consistent within 50 m.
+An other approach makes use of ancillary data to attribute the MLH to one of the detected layers. These supplementary information may span from a 0-order PBL model to attribute the highest layer during the daytime and the lowest during night time, to a sophisticated synergy with other measurements, such as ground fluxes and a prognostic PBL model, (e. g. the Batchvarova-Gryning model), or radiosoundings or temperature profilers. Di Giuseppe et al. (2012) showed how the use of a Bayesian Selective Method, coupled for example to a rough slab model may help the attribution by selecting the layers closest to the model. Obviously, the more reliable the model, the more accurate will be the selection. The main problem with this approach is the balance between the weights of measurements and model.
+'''Operational status'''. Gradient and variance-based techniques have been successfully automatized. Hence mixing height retrievals based on these techniques are typically available with most commercial Lidar and ceilometer systems. However, the fraction of undefined or erroneous retrievals remains high and should be quantified precisely. '''The fraction of the time that mixing is correctly traced by the tracers we consider remains an open and important question'''.
+=== Liquid clouds ===
+Low-level liquid clouds are prevalent in all seasons and on the global scale. They can be described through cloud cover, vertical distribution (macro-physics), total path integrated liquid water (LWP) as well as droplet size distribution (micro-physics), which can be expressed in terms of liquid water content (LWC), cloud droplet number concentration (N) and effective radius (Reff). Lifetime, as well as macro-physical and microphysical properties of liquid clouds are determined by various factors such as large scale meteorological forcing, physical and chemical variations of cloud condensation nuclei (CCN) population, radiation processes, turbulent surface fluxes, etc. Especially frequently occuring thin mid-level liquid water clouds (alto-cumulus) play a crucial role in the interaction with solar radiation and thus impact atmospheric radiative forcing due to clouds (Turner et al. 2007). Also, condensation and evaporation of cloud water induces vertical and horizontal transports of energy from smallest to global scales. Liquid clouds are also relevant factors in boundary layer processes leading to deep convection and govern the formation of snow and ice in supercooled environments with respect to liquid water. Recent findings (Cesana et al., 2012) even show that also in Arctic regions liquid cloud occurence dominates ice cloud occurrence.
+====User requirement and benefits====
+Thus, the prediction of climate and weather is extremely dependent on the correct description of clouds on all spatial and temporal scales. This requirement is extremely difficult to meet since clouds since are highly variable in space and time, difficult to measure, interact in a physically complex way with their surrounding and must be correctly described by means of their phase, full particle size spectrum, and shape spectrum. In the context of high-resolution NWP, [http://www.wmo-sat.info/db/ WMO Observing Requirements Database] sets the ''uncertainty goals'' for cloud liquid water measurements for high-resolution NWP (global climate models) in the lower troposphere to 5 % (20 %) relative accuracy at 0.1 km (0.2 km) vertical and 15 min (60 min) temporal resolution. Note that the corresponding ''uncertainty thresholds'' are set to 20 % (100 %) relative accuracy at 0.5 km (2 km) vertical and 3 h (12 h) temporal resolution.
+Satellites can only partially provide such information due to limits in vertical, horizontal and temporal resolution as well as in the information content of passive remote sensors. In this respect Cloudsat (launched in 2006), the first cloud radar in space, has revolutionized the measurement capabilities of clouds from space concerning vertical resolution. However, Cloudsat's life time is limited and is (so far) a singular instrument if its type. In situ measurements are usually more accurate however, require in-cloud flights or radiosoundings which have high costs and can only be organized occasionally or with poor temporal resolution.
+It has been shown in the last two decades that a combination of active and passive ground-based remote sensors such as Doppler cloud radar, elastic (or inelastic) lidar and multi-channel microwave radiometer (together wit a limited number of assumptions) have the potential to retrieve these cloud microphysical parameters for different types of liquid clouds. National and international projects and research initiatives ([http://www.cloud-net.org/ FP5 Cloudnet project], [http://www.arm.gov/ US DOE ARM Programm], [http://www.actris.net/ FP7 ACTRIS infrastucture], [http://hdcp2.zmaw.de/ German Research Ministry HD(CP)2 initiative],...) have lead to a loose network of cloud profiling stations with such suitable instrumentation throughout Europe and the US. In the last years, EG-CLIMET has gathered scientists from these research projects to enable a common and more accurate development of cloud profiling retrieval approaches. Retrieval approaches as well as instrument accuracy and sensitivity have improved constantly throughout the years and this, along with the improved instrumental capabilities for measuring aerosols optical properties, have contributed to significantly to reduce the uncertainty of the retrieved cloud microphysics and the related radiative forcing.
+Measurements of clouds using ground-based remote sensing networks can lead to an improvement of models by providing an evaluation basis. Measurements can help to obtain insight into cloud parametrizations, i.e. methods to describe sub-scale processes such as convection or small scale processes like droplet formation and turbulence, by means of surrounding meteorological parameters of temperature, pressure, humidity and wind. Methods for determining integrated and vertically resolved cloud liquid water microphysical proeprties are presented and their accuracies are assessed. This is why it is essential to continue developing new methods with highest possible accuracy.
 ==== Available techniques ====
-Contributors: G. Martucci, Ulrich Löhnert
+The following ground-based remote sensing instruments are sensitive to cloud liquid water and the available techniques are summarized in the following. However, in order to gain essential information on the vertical profile of liquid water cloud microphysical properties an integration of the different measurements and methods is necessary. This is described in [http://wiki.eg-climet.org/index.php?title=Final_Report#Synergetic_profiling_retrieval_algorithms Synergetic profiling retrieval algorithms].
-The microphysical properties of boundary-layer liquid water clouds are essential for describing and predicting the development of the boundary layer, especially concerning their impact on radiative forcing, but also on atmospheric heating rates as well as the on the onset of precipitation (drizzle). Hence, it is imperative to assess currently used methods to derive the microphysics of liquid clouds in terms of CDNC, <math> R_{eff} </math> and LWC and their related uncertainty. Within the scope of the COST action ES0702 EG-CLIMET four different ground-based remote sensing methods employing cloud radar, microwave radiometer (MWR) and laser-ceilometer have been developed and applied to model output and real measurement data. All methods use the same information on cloud phase & type, cloud boundaries, radar reflectivity, ceilometer-backscatter and MWR-derived LWP, respectively MWR brightness temperature.
+[[File:iwv_lwp_q.png|400px|thumb|right|Figure 3.7.1: Time series of LWP (top), IWV(center) and profile of absolute (bottom) from Jülich]]
+'''''Microwave radiometer''''': Due to their suitability for operational measurements and widespread European distribution (i.e. organized within the new international Microwave Radiometer Network [http://cetemps.aquila.infn.it/mwrnet/ MWRnet]), microwave radiometers (MWR) have been in the main focus of EG-CLIMET. They are the most reliable technique for deriving the path-integrated liquid water amount (LWP), however provide no information on the vertical distribution of cloud liquid water (Crewell et al. 2009). The estimation of LWP by ground-based microwave radiometry has a long tradition. Westwater (1978) proposed a dual-frequency radiometer with channels at the wing of the water vapor line at 22.235 GHz and in the window region at 31.65 GHz to derive the Integrated water vapor (IWV) and the LWP of the atmosphere. First tests start in 1980.
+Details of the physical background are described in the [[MWR Fundamentals]] and in various reviews as e.g. Askne and Westwater (1986).
-[[File:Retrieval methods.jpg|600px|thumb|left|Figure xxx: :EG-CLIMET state-of-the-art techniques to retrieve the microphysics from liquid clouds]]
+In summary, due to the nearly linear relation between TB and IWV as well as vs LWP, the integrated values can be derived by linear equations as follows:
-Using this information as a common constraint, all four methods are applied to synthetic measurements calculated from model output using suited forward models available from the EarthCare Simulator. In this case retrieved microphysical properties can be directly compared to the original model output and thus the accuracy is evaluated as a function of height above cloud base. Systematic differences are assessed and it is shown that the CDNC and <math> R_{eff} </math> retrievals are much more dependent on the retrieval method parameters than LWC. Additionally, the methods are applied to real measurements and evaluated through a short-wave radiative closure using simultaneous broad-band pyranometer measurements. For the initial calibration phase of the four different ground-based remote sensing methods intercomparison (Table 1) the retrieved cloud microphysics have been tested against the provided synthetic ECSIM (EarthCare Simulator)reference. Table 1 summarizes the state-of-the-art techniques retrieving the microphysics from liquid clouds. For each combination of instrument (Doppler cloud RADAR, LIDAR and microwave-radiometer) Table 1 shows: (2nd column) the name or acronym of the method and the main publication to which the method refers; (3rd column) the principles the methodology is based on; (4th column) the main assumptions and limitations/advantages of each method; (5th column) the availability to operate 24/7. The fourth column details the main advantages of the each method and its major sources of uncertainty, thus providing indications on where each technique can improve the accuracy of the retrievals. In brown colour are shown the methods involved in the "blind test" already in act within the scope of the COST action EG-CLIMET.
+<math>IWV\,=\,a_0 + a_1TB_{23} + a_2TB_{31}</math>
-The intercomparison, initially named ''blind test'' because the synthetic microphysical measurements remained unknown to the participants, led to a three-way intercomparison of the IPT-SYRSOC-TUD retrieval schemes with CLOUDNET not included in the initial intercomparison phase. For each microphysical variable (CDNC, <math> R_{eff} </math>, LWC) the outputs of the intercomparison yielded the (i) time-height timeseries of the difference between each method's retrieval and the ECSIM true value, and (ii) the mean variable profile over representative time intervals during the liquid cloud lifetime above the cloud base. The i-ii intercomparison outputs provide the uncertainty for each retrieval methods as compared to the true-measurements. The next session shows in details the results of the intercomparison outputs and related uncertainties.
+<math>LWP\,=\,b_0 + b_1TB_{23} + b_2TB_{31}</math>
-==== Retrieval techniques and errors ====
+where a and b denote the coefficient vectors and TB the brightness temperatures of the radiometer. Regression coefficients are calculated mainly on the basis of training data sets consisting of concurrent TB and IWV/LWP values. Both IWV and LWP are obtained from a representative dataset of radiosonde observations, whereby a simple cloud model (i.e. empirically modified adiabatic assumption) is typically assumed to calculate LWP. These data are then used to calculate TB applying a radiative transfer model. Fig. 3.7.1 shows a typical 24h time series of IWV and LWP derived from MWR measurements between 21 and 32 GHz.
+Most microwave radiometers, which derive these two parameters have a frequency located on the wing of the 22.235 GHz water vapor line and a frequency within the “window” region between 30 and 35 GHz. Window region means that gas absorption is weak and the influence of emitting cloud drops will be large. If TB is measured on the low frequency side (~21.4 GHz) or the high frequency side (~23.8 GHz) of the water vapor absorption line, then, in cloud-free cases, TB is very well linearly related to IWV. This is due to the fact that at both of these frequencies the weighting function is nearly constant with height. In case of clouds, the measurements around the 22.235 GHz line are also influenced by emission of cloud liquid water drops. Thus, liquid clouds “disturb” the water vapor signal and are corrected for by a measurement in the window region. Similarly, water vapor influence on the cloud measurements in the window region are corrected for by using measurements on the wing of the 22.235 GZ absorption line.
+Lately, increasingly higher frequencies (> 30 GHz) are being used for atmospheric parameter retrieval.
+First multichannel radiometers were developed to retrieve vertical structures of thermodynamic variables. Closely related was an accuracy improvement of LWP retrievals achieved by multiple regression techniques or neural networks. Löhnert and Crewell (2003) have shown by simulations that the use of additional channels at about 50 GHz and 90 GHz result in better retrievals. Compared to the classical two-channel algorithm the rms-error could be reduced from about 35 gm<sup>-2</sup> to 15-20 gm<sup>-2</sup>. However, systematic errors due to different cloud model statistics become more important.
+Nevertheless, in spite of the technological progress uncertainties in LWP estimations remain unsettled. In a study (Turner et al., 2007) an identical data set of brightness temperatures was used to retrieve LWP by various methods and absorption models. The results are sensitive to uncertainties in MWR calibration, absorption models as well as to the retrieval methods which together may cause biases of up to 50%. Hence, the combination of different active and passive sounding instruments is needed to meet user requirements.
-Table 1 outlines the state-of-the-art retrieval techniques intercompared within the scope of the EG-CLIMET scientific program. The five retrieval methods are described hereafter.
+'''''Cloud radar''''': In the last two decades sensitive microwave radars have been developed, which can detect small cloud particles up to distances of a few kilometers. High spectral, spatial and temporal resolution allow the development of new techniques, which can help to quantify cloud microphysics at finer scales than before. Typically, higher frequencies are used for cloud radars than for weather radars, since these are more sensitive to cloud particles. However, due to the increasing attenuation with frequency, the range of cloud radars is limited to a few kilometers. Typically the radar reflectivity of clouds ranges from –50 to 0 dBZ, whereby –50 dBZ represents the delectability limit of most cloud radars and values above 0 dBZ increasingly imply rain.
+Cloud radar measurement have been used to relate Z directly to LWC with a power law relationship of the form:
-===== ''SYRSOC''- ''SY''nergistic ''R''emote ''S''ensing ''O''f ''C''loud =====
+<math>Z\,=\,cLWC^d</math>
+with Z is in [mm<sup>6</sup> m<sup>-3</sup>] (e.g. Atlas 1954, Sauvageot and Omar 1986). This relation is, however, extremely dependent on the DSD. For example, if an air volume of 1 m<sup>3</sup> contains 0.1 g of liquid water and only droplets 5 µm in radius, the reflectivity will be 8 times smaller than if the volume consists only of droplets 10 µm in radius. The coefficients c and d may be derived empirically from in-situ aircraft measurements by measuring the DSD, calculating LWC and Z (assumption Rayleigh scattering) and finally using a least squares to determine a and b. Instead of aircraft measurements other attempts have been made using microphysical cloud models, which resolve the drop size spectrum (Liao and Sassen 1994) and thus allow the calculation of Z and LWC. Fox and Illingworth (1997a) show scatter plots of LWC and Z calculated from DSD-aircraft measurements, which show maximum uncertainties of up to one order of magnitude in LWC for a single measurement if only droplets smaller than ~50 µm in radius are considered. They claim relative LWC accuracies of ~50 % for typical marine stratocumulus.
+Since LWC is proportional to D<sup>3</sup> and Z to D<sup>6</sup>, the occurrence of just a few larger precipitating (drizzle) drops, which do not contribute significantly to LWC, will dominate the radar signal. Many low level stratocumulus clouds contain drizzle drops and consequently Z - LWC relations must be adapted accordingly during precipitation.
+Most modern cloud radars have Doppler capabilities and thus the possibility of measuring the Doppler velocity spectrum. Here, the possibility is given to detect precipitating particles by relating the Doppler velocities of particles to their fall speed, which is determined by particle size.
+As shown by Hogan et al. (2005), another approach towards retrieving LWC from radar measurements is to use two radars at different wavelengths. Since attenuation is proportional to LWC within the Rayleigh backscattering regime, the differences between the Z measurements at a certain height give information on attenuation and thus on LWC.
+'''''Infrared spectrometer''''': Next to being sensitive to temperature and traces gases (i.e. water vapor, carbon dioxide, methane, nitrus oxide) highly resolved spectral infrared measurements as provided by an AERI are also sensitive to liquid and ice clouds. Thus, together with reasonable a priori assumptions for temperature and humidity, an AERI is able retrieve the cloud properties cloud effective radius (Reff) and cloud optical depth (COD). An AERI spectrum is sensitive to the liquid cloud properties Reff and COD, whereas MWR observations of liquid clouds are generally sensitive to the integrated liquid water path (LWP). However, within the optical limit, COD=3LWP/2(rho<sub>l</sub>Reff) directly relates MWR and AERI observations, with rho<sub>l</sub> the bullk density of liquid water. At approximately LWP=60gm<sup>-2</sup>, the signal of the infrared spectrometer is fully satured. This implies, as mentioned by Turner et al., that an AERI can only be used to retrieve the microphyical properties of thin liquid water clouds, which can however, effectively regulate the solar radiation balance.
+'''''Shortwave irradiance''''': Cloud optical depth can also be derived by using shortwave irradiance measurements. Together with LWP from an MWR, additionally the mean effective radius can then be derived. Several studies have been carried out to estimate cloud optical depth (COD) by broadband (Leontyeva and Stamnes 1994, Dong et al. 1997, Boers 1997, Barker et al. 1998, Qiu 2006) and narrow band (Min and Harrison 1996, Marshak et al. 2000, Daniel et al. 2002, Marshak et al. 2004, Min et al. 2004, Chiu et al. 2010, Matamoros et al. 2011) global (i.e. direct+diffuse), diffuse or direct measurements of irradiance in the shortwave (SW) region.
+Here we focus on methodologies using broadband SW irradiance, because of the large availability of such type of measurements. The empirical and semi-empirical methodologies presented by Barnard and Long (2004) and Barnard et al. (2008) permit to estimate the COD using the ground-based diffuse and global SW irradiance, respectively, without the need of using other type of measurements or radiative transfer model simulation. Other advantage of these techniques concern the methodology itself, which reduces the impact of the pyranometer calibration. These characteristics make such methodologies attractive for use in routine calculations over one or more sites and for collection of long time series of data. Major drawbacks of this approach are the assumption of a plane-parallel and homogeneous cloud, possibly satisfied in cases of fully overcast conditions, and the lack of information related to the vertical distributions of the clouds. Moreover, the applicability of these algorithms is limited to surface types characterized by albedo lower than 0.30, to solar zenith angles below 75° and to COD values larger than about 5. For further detailed see Barnard and Long (2004) and Barnard et al. (2008).
+The cloud effective radius can be estimated using COD and LWP values. Assuming a constant LWC(z) within the cloud and a value of the extinction efficiency factor of 2 in the SW region, the effective radius is Reff=3/2*(LWP/COD). Actually the vertical profile of the effective radius varies within the cloud, generally increasing from the cloud base up to the proximity of the cloud top. Under the assumption of a linear increase in LWC(z), i.e. adiabatic profile, it is possible to derive the maximum value of Re(z) as Re(z,top) = 9/5*(LWP/COD)
+==== Synergetic profiling retrieval algorithms ====
+Within the scope of the EG-CLIMET four different retrieval methods for profiling LWC, Reff and N all based on active and passive ground-based microwave remote sensing measurements have been thouroughly assessed. The combination of passive MWR and active cloud radar together with a backscatter lidar are currently the most robust way to profile liquid cloud microphysical properties, concerning both 24/7 instrument performance and well as algorithm applicability. All methods use the same information on cloud phase & type, cloud boundaries, radar reflectivity, ceilometer-backscatter and MWR-derived LWP, respectively MWR brightness temperature. This information is derived by the [http://www.cloud-net.org Cloudnet] categorization product. Additionally these measurements are available at all atmospheric profiling observatories.
+In order to have a "truth" to validate against, all retrieval methods have been applied in a synthetic model environment. Measurement simulations of the ground-based remote sensing instruments using microphysical variables from cloud resolving model output provided this reference. The simulations were carried out within the framework of ECSIM (EarthCare Simulator). After applying the microphysical retrievals to the measurement simulations, an independent evaluation of performance was carried out in order to identify strengths and weaknesses and to improve the retrieval algorithm quality in general.
+Additionally, the methods are applied to real measurements and evaluated through a short-wave radiative closure using simultaneous broad-band pyranometer measurements.
+[[File:LIQUID_CLOUD_PARAMETERS.png|600px|thumb|left|Figure 3.7.2: EG-CLIMET state-of-the-art techniques to retrieve microphysics from liquid clouds]]
+'''''Cloudnet - scaled adiabatic'''''
+The Cloudnet algorithm is the standard method within the [http://www.cloud-net.org Cloudnet] products to retrieve LWC. In case a non-precipitating liquid cloud is detected by the Cloudnet categorization scheme, cloud base, cloud top and cloud temperature (extracted from atmospheric model output) are used to calculate the adiabatic liquid water content as a function of height above cloud base. Since this LWC represents a theoretical upper limit to cloud LWC, the LWC profile is linearly scaled to meet the the LWP determined independently by a MWR.
+'''''TUD-RSCPP algorithm'''''
+The retrieval method relies on a combination of the cloud radar reflectivity, the microwave radiometer estimated liquid water path and on the cloud geometrical thickness from lidar and cloud radar. These observations are used as input data for different vertical cloud models to retrieve profiles of the LWC, the droplet concentration, the effective radius, the optical extinction and the optical depth. The three cloud models are characterized by their predefined in-cloud vertical structure of the assumed gamma DSD parameters (concentration, shape parameter and mean radius). This assumption is necessary to reduce the number of unknowns since the vertical information of the DSD properties from surface remote sensing observations are still lacking. The common assumptions in all three cloud models on the vertical distribution of the DSD parameters are that the cloud droplet concentration and DSD shape parameter remain constant within the cloud layer. The differences in the in-cloud vertical structure of the cloud models are related to the cloud layer mean droplet radius. In the vertical uniform (VU) cloud model, the cloud layer mean droplet radius is uniformly distributed over the cloud layer thickness while the scaled-adiabatic stratified (SAS) and homogeneous mixed (HM) cloud models parametrize the vertical profiles of the mean droplet radius in consideration of possible impacts of the cloud dilution. The SAS cloud model accounts for the entire range of mixing processes available in the atmosphere by a constant reduction in the particle size with height. In case of the HM cloud model, the impact of mixing is associated with the observed vertical variation in the radar reflectivity profile, which is attributed to changes in the mean particle size. The main assumptions constrain the application of the algorithms to liquid water clouds without drizzle formation and it is expected that drizzle-sized particles will produce biased results, because they are dominating the cloud radar reflectivity while their contribution to the LWC, the droplet concentration and the effective particle size are rather small.
+'''''IPT - Integrated Profiling Technique''''':
+The IPT (Löhnert et al., 2004, Löhnert et al. 2008) is a variational scheme for retrieving profiles of temperature, humidity and cloud microphysical properties. The core version of this technique
+includes the physically consistent combination of microwave radiometer, cloud radar and lidar/
+ceilometer together with information on the background state (a priori information). It is a variational
+technique that, similarly to data assimilation techniques, requires uncertainty estimates of the
+measurements, forward model and background state, which need to be carefully specified. If assuming
+a Gaussian distribution of atmospheric variables, measurements and their corresponding error, the
+solution will bring forth not only the most probable solution, but also the error covariance matrix for
+each derived variable. The retrievable parameters include profiles of temperature, humidity and LWC, as well as Reff. By adapting an empirical relation between Z and LWC for cloud, respectively precipitation, it can retrieve LWC also in drizzling cases.
+'''''SYRSOC - Synergistic Remote Sensing of Cloud''''':
 SYRSOC (SYnergistic Remote Sensing Of Cloud) is a multi-module technique developed at the National University of Ireland Galway and retrieving the three primary microphysical parameters from liquid clouds (Martucci and O’Dowd, 2011, Martucci et al., 2012, Ovadnevaite et al., 2011), i.e. the cloud droplet number concentration (CDNC), the effective radius (<math> R_{eff} </math>) and the cloud liquid water content (LWC). In addition to the three main microphysical variables, SYRSOC provides a number of parameters describing the cloud droplet spectral properties (relative dispersion), the degree cloud of subadiabaticity, the Doppler spectrum of droplets, the cloud optical depth and the cloud albedo. Extinction from standard 355-1500 nm inverted backscatter LIDAR signal or directly from Raman signal is used as input data for SYRSOC. Other input data are the temperature and humidity profiles from co-located operational microwave-radiometer and the reflectivity/signal-to-noise-ratio and depolarization ratio from co-located Ka-band Doppler cloud RADAR. Data from the 1064-nm and 15-km vertical range Jenoptik CHM15K LIDAR ceilometer, the RPG-HATPRO water vapour and oxygen multi-channel microwave profiler and the MIRA36, 35 GHz Ka-band Doppler cloud RADAR are currently used at the GAW Atmospheric Station of Mace Head (Ireland) to supply the necessary input to SYRSOC.
-===== IPT: Integrated Profiling Technique  =====
+==== Technical implementation and performance ====
+In the following, the main results of the retrieval algorithm application to the simulated data sets are discussed with respect to the different microphysical parameters.
-===== CLOUDNET =====
+'''LWC'''
-===== TUD-RSCPP - TU Delft Remotely-Sensed Cloud Property Profiles =====
-The retrieval method relies on a combination of the cloud radar reflectivity; the microwave radiometer estimated liquid water path and on the cloud geometrical thickness from lidar and cloud radar. These observations are used as input data for different vertical cloud models to retrieve profiles of the LWC, the droplet concentration, the effective radius, the optical extinction and the optical depth. The three cloud models are characterized by their predefined in-cloud vertical structure of the assumed gamma DSD parameters (concentration, shape parameter and mean radius). This assumption is necessary to reduce the number of unknowns since the vertical information of the DSD properties from surface remote sensing observations are still lacking. The common assumptions in all three cloud models on the vertical distribution of the DSD parameters are that the cloud droplet concentration and DSD shape parameter remain constant within the cloud layer. The differences in the in-cloud vertical structure of the cloud models are related to the cloud layer mean droplet radius. In the vertical uniform (VU) cloud model, the cloud layer mean droplet radius is uniformly distributed over the cloud layer thickness while the scaled-adiabatic stratified (SAS) and homogeneous mixed (HM) cloud models parametrize the vertical profiles of the mean droplet radius in consideration of possible impacts of the cloud dilution. The SAS cloud model accounts for the entire range of mixing processes available in the atmosphere by a constant reduction in the particle size with height. In case of the HM cloud model, the impact of mixing is associated with the observed vertical variation in the radar reflectivity profile, which is attributed to changes in the mean particle size. The main assumptions constrain the application of the algorithms to liquid water clouds without drizzle formation and it is expected that drizzle-sized particles will produce biased results, because they are dominating the cloud radar reflectivity while their contribution to the LWC, the droplet concentration and the effective particle size are rather small.
+[[File:brandau_cloudnet.png|400px|thumb|right|Figure 3.7.3: Mean LWC profile from cloud resolving model output (black bold) and corresponding 1-sigma range (black dotted) for a simulation initialized over the Cabauw, NL area. The red lines show retrievals results and corresponding 1-sigma ranges from the Cloudnet retrieval (left) and the retrieval method according to C. Brandau (HM model), Delft University, NL (right).]]
-===== G. Pace =====
+A comparison between the standard Cloudnet scheme and the RSCCP method acording to Brandau (HM cloud model) shows an improvement in LWC retrieval skill using the latter method (Fig. 3.7.3). In contrast to Cloudnet, which relies on a linearly scaled adiabatic assumption, the Brandau method uses radar reflectivity profiles from a cloud radar assuming a relationship between the 2nd and 3rd moment of the DSD based on aircraft measurement (Brenguier et al. 2011). This assumption holds only in non-precipitating clouds. Note, three of the four assessed methods require the LWP derived by independent measurements of an MWR. In non-precipitating cases, the accuracy of LWP is the most crucial factor for retrieving both LWC and Reff. In case the LWP is accurately know, random and systematic error can both be on the order of ~10% for the Brandau method. The IPT method was shown to be very sensitive to the a priori assumption, is however, independent of LWP, whereas the SYRSOC method is very sensitive towards an accurate retrieval of lidar extinction from lidar backscatter. All retrieval methods were shown to be very sensitive towards a correct description of cloud base and cloud top and the corresponding distinction between cloud droplets and precipitation.
-<gallery caption="ECSIM vs Retr. Methods, ASTEX case, Effective Radius" widths="300px"  heights="275px" perrow="3">
+'''Reff & N'''
-File: ASTEX_SYRSOC-CLEAN-IV_Reff_prof_0-5.jpg
-File: BRANDAU_ASTEX_V3_2_Reff_prof_0-5.jpg
-File: IPT_ASTEX_III_Reff_prof_0-5.jpg
-</gallery>
-=== Ice clouds ===
+[[File:brandau_Reff_N.png|400px|thumb|right|Figure 3.7.4: : Mean Reff (left) and N (right) profile from cloud resolving model output (black bold) and corresponding 1-sigma range (black dotted) for a simulation initialized over the Cabauw, NL area. The red lines show retrievals results and corresponding 1-sigma ranges from the retrieval method according to C. Brandau (HM model), Delft University, NL (right).]]
-Contributors: D. Donovan, J. Delanoe, R. Hogan
+For non-precipitating cases, the Brandau retrieval method delivers the most satisfactory results for Reff (Fig. 3.7.4, left). Within the cloud boundaries, Reff can be derived with overall accuracies of ~15%. The Brandau method as well as the IPT assumes constant values of N throughout the cloud. Although this is actually the case within the clouds analysed (Fig 3.7.4, right), systematic errors of more than 50% occur. Improvements are only possible if a more situation-specific relation between the 2nd and 3rd moment of the droplet size distribution is used instead of the one proposed by Brenguier et al. 2011.
+'''Precipitation'''
+Frequently, liquid clouds contain precipitation size drops (drizzle). In these cases the assumptions on the relations between 2nd and 3rd moment of the droplet size distribution is no longer valid, leading to large overestimation (underestimation) of Reff (N) because a small number of larger droplets dominate the radar reflectivity factor signal. However, both IPT and Brandau method still deliver fairly robust results in LWC with overall errors in the range of 20-50%.
+==== Summary and Outlook ====
+[[File:Histogram_LWP_kl.png|400px|thumb|right|Figure 3.7.5: Histogramm of one year of MWR LWP observations at Lindenberg]]
+Due to their capability to provide continuous observations, ground-based remote sensing observations of clouds are widely used and well suited for:
+* Long-term observations (Validation of new methods, climate applications), e.g. Fig. 3.7.5 gives an impression about the amount of liquid water at Lindenberg during one year. It shows a histogram of non-rejected retrievals indicating that no liquid water was observed at about 24% of the cases. For only for 8% the LWP was greater than 200 gm<sup>-2</sup>.
+[[File:LWP_Jan_2010.png|400px|thumb|left|Figure 3.7.6: Model and MWR LWP (top) and solar radiation balance (bottom) observed at Lindenberg observatory in January 2010]]
+* NWP model validation. For validation studies LWC, N and Reff measurements are needed as component of a variety of continuously observed parameters. Investigations, which aim at revealing possible deficiencies in the model parameterization, rely on the long-term availability of corresponding parameters. The periods may cover time intervals ranging from months up to several years. LWP from MWR can be provided for such long periods of time. In the frame of a validation study (Vogel et al., 2011) of operational weather forecast models (COSMO-EU) a systematic prediction error of the 2 m temperature during winter months was found. The overestimation of the noon temperature results from an error of the radiation balance at surface of about 20-40 W m<sup>-2</sup>. In order to find reasons for the overestimation the radiation balance was split into solar and thermal components. In fact, model radiation peaks appear in low stratiform clouds because their cloud water content is considerably to low compared to the MWR-derived LWP. Furthermore, if the model produces a realistic LWP then the radiance balance simulated by the model agrees with the observation (Figure 3.7.6).
+'''Next steps'''
+Currently, research focus is on developing retrieval methods that allow determining microphysical properties of the non-precipitating and precipitating parts of the liquid cloud. This can only be achieved by using additional information from the full Doppler spectrum of the cloud radar. Furthermore, physically consistent a priori data (i.e. long-term statistics) of cloud profiles is needed from in-situ measurement to be able to better constrain the retrieval methods. These methods should be ideally developed within a variational framework, which is flexible concerning the used measurements and retrieval assumption and additionally allowing an inherent error approximation.
 == Networks ==
-Contributors: C. Gaffard, M. Haeffelin
 === Operational networks ===
-Contributors:
-==== CWINDE ====
+==== The European network of wind profilers CWINDE ====
-Contributors:
+[[File:CWINDE.png|300px|thumb|right|Figure 4.1.1: Spatial distribution of CWINDE wind profilers network]]
-[http://www.metoffice.gov.uk/science/specialist/cwinde/profiler/ CWINDE network] managed by [http://www.eumetnet.eu/ EUMETNET]
+The [http://www.eumetnet.eu/ EUMETNET][http://www.eucos.net/nn_133388/EN/Home/networks/winprof/winprof__node.html?__nnn=true E-WINPROF] programme is providing vertical profiles of wind measurements from wind profilers and weather radars from a network of stations across Europe. Its main goal is to improve the overall usability of wind profiler data for operational meteorology and to provide support and expertise to both profiler operators and end users. Since 2002, this programme is operating the network [http://www.metoffice.gov.uk/science/specialist/cwinde/profiler/ CWINDE] (fig. 4.1.1) which displays time series of realtime quality controlled wind profiles from more than 25 sites in Europe.
-==== CN-MET ====
+Monthly statistics on availability and data quality are sent to the data owners. A list of wind profilers and weather radars whose winds are operationally assimilated into the main Numerical and Weather Prediction (NWP) models in Europe is also updated on a regular basis.
-[[File:COSMO-2.png|300px|thumb|right]]
-Contributors: Dominique Ruffieux, Alexander Haefele
+==== The Swiss nuclear powerplant meteorological surveillance tool CN-MET ====
+[[File:COSMO-2.png|300px|thumb|right|Figure 4.1.2: Visual sketch of CN-MET system]]
-Main purpose of the CN-MET project (Centrale Nucléaire et METéorologie) is to bring up to date the system delivering weather information necessary to the population safety in case of a nuclear hazard. CN-MET represents the coupling of a specifically adapted measurement network and a predictive tool in the form of a fine grid numerical weather prediction model currently developed at MeteoSwiss (COSMO-2). This new tool, calling upon modern measurement and modeling techniques of the atmosphere, represents a solution which will keep all its relevance for the next decades.
+The main purpose of CN-MET (Centrale Nucléaire et METéorologie) is to bring up to date the system delivering weather information necessary to the population safety in case of a nuclear hazard. CN-MET represents the coupling of a specifically adapted measurement network (mainly ground-based remote sensing) and a predictive tool in the form of a fine grid numerical weather prediction model currently operated at MeteoSwiss (COSMO-2). This new tool, calling upon modern measurement and modeling techniques of the atmosphere, represents a solution which will keep all its relevance for the next decades.
-In case of a nuclear accident, the necessary atmospheric data used to calculate the diffusion of a contaminated air mass will be provided by a fine grid numerical model, covering the whole Swiss territory. The new measurement network within CN-MET is directly adapted to provide the best information (initial and boundary conditions, and test measurements) for this model. CN-MET not only ensures the emergency preparedness for the concerned population on a local scale, but also enhances it on a regional scale corresponding to the Swiss Plateau.
+In case of a nuclear accident, the necessary atmospheric data used to calculate the diffusion of a contaminated air mass will be provided by a fine grid numerical model, covering the whole Swiss territory. The measurement network within CN-MET combines in-situ measurements and ground-nased remote sensing systems (wind profilers and microwave radiometers). It is directly adapted to provide the best information (initial and boundary conditions, as well as test measurements) for this model. CN-MET not only ensures the emergency preparedness for the concerned population on a local scale, but also enhances it on a regional scale corresponding to the Swiss Plateau.
-More information at: [http://www.atmos-meas-tech.net/4/1617/2011/amt-4-1617-2011.html Calpini, B., Ruffieux, D., Bettems, J.-M., Hug, C., Huguenin, P., Isaak, H.-P., Kaufmann, P., Maier, O., and Steiner, P.: Ground-based remote sensing profiling and numerical weather prediction model to manage nuclear power plants meteorological surveillance in Switzerland, Atmos. Meas. Tech., 4, 1617-1625, doi:10.5194/amt-4-1617-2011, 2011.]
+For more information: [http://www.atmos-meas-tech.net/4/1617/2011/amt-4-1617-2011.html Calpini et al, 2011.]
 === Candidate networks ===
-Contributors:
 ==== Ceilometer network ====
-Contributors:Martial Haeffelin, Owen cox
-==== MWRNET ====
+The number of automatic Lidars and ceilometers with profiling capability installed over Europe has increased over the past two years. National Meteorological and Hydrological Services (NMHS) in Germany, France, the Netherlands and the United Kingdom, in particular, are deploying Lidars and ceilometers to cover their national territories with the objective to reach a spatial density of nearly one device every 100 km (e.g. Haij and Klein Baltink 2007; Flentje et al. 2010). Figure 4.2.1 (from Haeffelin et al., 2012) provides a convincing representation of the density of automatic backscatter lidars and ceilometers. These investments have been made because of the Lidars/ceilometers ability to detect volcanic ash, but  the network is potentially of great value in monitoring  clouds and pollution and evaluating their representation in NWP models.  Ultimately, incorporation of such data could lead to improved prediction of air quality and hazardous weather.
-Contributors: N. Cimini, U. Löhnert
-The International network of MicroWave Radiometers (MWRnet) aims to address the lack of coordination between the MWR operations in the world. The long-term mission of MWRnet is the set up of an operational network sharing good practices (in terms of procedures, formats, quality control, protocols, software, etc...) and life cycle of MWR data.
+Although the name ceilometer suggests that their sole purpose is to detect cloud-base, modern ceilometers are able to provide continuous accurate and reliable profiles of backscatter from aerosols and clouds. In the past, Lidars were strictly research instruments. Similarly modern Lidars are becoming more automated and can now contribute efficiently to continuous monitoring of air quality and weather.
-More information at: [http://cetemps.aquila.infn.it/mwrnet/ MWRnet website]
+Several communities have expressed interest in exploiting data that can be derived from automatic Lidars/ceilometers in Europe: for evaluation of the representation of clouds and aerosols in operational weather forecast models run by National Met Services, for evaluation of climate models, for aerosol transport surveillance and air traffic safety (eg VAAC services, national aviation control entities), for air quality applications (eg EU FP7/GMES MACC-II programme), for greenhouse gas monitoring applications (eg. GAW, ICOS programme). Hence, efforts should be made to provide Lidar/ceilometer data in a harmonized way in Europe.
-=== Testbeds ===
+'''Automatic Lidar and Ceilometer map over Europe'''
-Contributors:
+About 50 institutions, mainly the European NMHSs and aviation control entities, were contacted for their national Lidar and ceilometer networks and a station map was generated using the google earth visualization tool (see Figure 4.2.1). Several WMO member states of the RA VI did not respond to the survey (Albania, Georgia, Lithuania, Luxembourg, Russia, Serbia, Hungaria, Ukrainia, Italy, Bulgaria), thus were not providing any information about local capacities. Enhancements of national ceilometer networks are currently planned in Belgium, Finland, France, Iceland, and Italy.
+Google Earth was chosen for visualizing the ceilometer positions and the instrument types. The map contains more than 1000 positions (as of March 2012) of ceilometers and lidars in Europe (EARLINET, CIS-Linet, Pollynet, Leonet) but also America (MPLnet) and Asia (AD-net lidars), thus showing the potentially available global vertical profiling capacities. There is however no storage of raw data for roughly half of all instruments gathered, making it impossible to retrieve information about aerosol layers at these positions. These stations are generally marked by using different white symbols representing the different instrument types in the animation.
+Several EARLINET stations, the entire AD-net and all active MPLnet stations provide quick looks of the backscatter signal. Furthermore, all Jenoptik ceilometers in Germany and some LD40 instruments in the Netherlands operated by KNMI provide links to quick look images (range-corrected backscatter intensities) in near-real-time. Links to quick looks of the UK Met. Office (UKMO) instruments will be added at a later stage. In case of emergency (e.g. volcanic ash plumes) the map may provide information about the spatial distribution of ash clouds and the height regime of such clouds.
+The map can easily be enhanced by users by adding more stations and/or additional information (e.g., station meta data). The Lidar/ceilometer map is electronically available (as google earth kml-formatted file) on request from the author but requires currently at run time a google earth installation at the user’s site. It is planned offering download of the latest stable version through a dedicated web page.
+[[File:Cn.1.jpg|500px|thumb|left|'''Figure 4.2.1''': Lidar and Ceilometer map as of Mar 30<sup>th</sup>, 2012, centered over Europe]]
+{| class="wikitable"
+!colspan="4"|Table 4.2.1: Legend for Lidar and Ceilometer map
+|-
+| blue symbol "square":
+| Vaisala CT12K
+| blue symbol "blank":
+| Vaisala CT25K
+|-
+| blue symbol "star":
+| Vaisala CL31
+| blue symbol "diamond":
+| Vaisala CL51
+|-
+| blue symbol "circle":
+| Vaisala CT75K
+| cyan/white symbol "square":
+| Vaisala LD12
+|-
+| cyan symbol "blank":
+| Vaisala AW11
+| cyan symbol "circle":
+| Vaisala LD40
+|-
+| white shaded circle:
+| Vaisala CTC21
+| green symbol "blank":
+| Eliasson CBME80
+|-
+| green needle:
+| Jenoptik CHM15K
+| yellow needle:
+| Jenoptik CHM15KX
+|-
+| yellow symbol "star":
+| other Lidar
+| red symbol "A":
+| AD-net
+|-
+| red symbol "C":
+| CIS-Linet
+| red symbol "E":
+| Earlinet
+|-
+| red symbol "L":
+| Leonet
+| red symbol "M":
+| MPLnet
+|-
+| red symbol "N":
+| NDACC
+| red symbol "P":
+| Pollynet
+|-
+| black/white squares:
+| Telvent Cirrus 100
+| black/white circles:
+| MTECH 8200
+|-
+| white:
+| backscatter data stored, instrument types as given above
+|
+|
+|-
+| white donut:
+| unknown instrument type
+|
+|
+|}
-==== Helsinki testbed ====
+The data was transfered to an openlayers-based solution, which is free of charge, and the result is now visible and accessible under [http://www.dwd.de/ceilomap DWD - Ceilometer-Viewer]
-Contributors: Jani Poutiainen (Jani is in parental leave until September, unless we manage to get more information this part might remain just a link to the Heslinky test bed )
-The Helsinki testbed project goals broadly consist of mesoscale weather research, forecast and dispersion models development and verification, demonstration of integration of modern technologies with complete weather observation systems, end-user product development and demonstration and data distribution for public and research community.
+'''Progress and Challenges'''
-[http://testbed.fmi.fi/ Helsinki testbed]
-==== FUND ====
+''Towards a European network of automatic lidars and ceilometers: Harmonizing recording formats and data sharing protocols, data quality management, calibration, target classification and parameter retrievals for clouds and aerosols.''
-Contributors: Catherine Gaffard
-There is little knowledge about the requirements for observations of very high resolution numerical weather prediction models, e.g. in the UK Met Office for 1.5 km grid length. So in order to address this, the Met Office intended to set up a dense network of profilers around London, see Fig. 1. for its Future Upper Air Networks Design (FUND) Project. This test-bed wanted to examine the provision of vertical profiles of not only wind, but also  temperature humidity and cloud, with network spacing less than 200km, by setting three integrated profiler stations all using a wind profiler, a ceilometer, a radiometer, plus for 2 of them a cloud radar. This test-bed would have used some of the NREC facilities like Chilbolton Cloud radar and the mobile wind profiler from UFAM.
+There is an increasing interest in Europe for automatic Lidar/ceilometer data for NWP evaluation and assimilation and for atmospheric surveillance (eg. aerosol transport). Most European countries are planning or are in the process of deploying reasonably dense networks of profiling ceilometers or automatic lidars.
-This test-bed has partially started in summer 2009 but run out of resource in 2010.
-*[[Lesson learned]]
+This topic is at the cross road between “operational observation specialists” (Met Services) and “Lidar data interpretation experts” (Research programs).
-*[[Output]]
-=== Observatories ===
+Several communities have expressed their interest in exploiting data that can be derived from automatic Lidars/ceilometers in Europe: for evaluation of the representation of clouds and aerosols in operational weather forecast models run by National Met Services, for evaluation of climate models, for aerosol transport surveillance and air traffic safety (eg VAAC services, national aviation control entities), for air quality applications (eg EU FP7/GMES MACC-II programme), for greenhouse gas monitoring applications (eg. GAW, ICOS programme). Hence, efforts should be made to provide Lidar/ceilometer data in a harmonized way in Europe.
-Contributors:
+EG-CLIMET has brought together Met Service representatives involved in Lidar and ceilometer activities and Lidar data analysis experts involved in the EU FP7 ACTRIS programme.
+'''Main conclusions:''' The participants are highly motivated by the importance of establishing a European network of automatic lidars and ceilometers that would enable data sharing and harmonized processing. A website will be developed to give visibility to the network, present the state of the network and give access to visualization of the measurements, initially at just a few sites (e.g. [http://www.dwd.de/ceilomap DWD - Ceilometer-Viewer]).
-== Examples of applications ==
+The group proposes that data sharing, calibration and processing shall be handled in a framework similar to the WINPROF system of EUMETNET. This system would include data sharing based on BUFR format, and, harmonized processing using common algorithms (possibly also centralized processing).
-Contributors:
-=== NWP data assimilation ===
+'''Formats:''' The group will propose a common BUFR format for operational purposes allowing efficient data sharing.
-Contributors:
-* [[ Wind profiler impact]]
+The group will propose a common NetCDF format for scientific applications that will contain all data and metadata.
+'''Calibration and processing:''' Calibration of automatic lidar/ceilometer measurements is important to enable scientific exploitation of the data. The group will develop common procedures to produce calibrated backscatter profiles.
+Processing of calibrated lidar/ceilometer data to produce (1) target classification, liquid cloud, ice clouds, aerosol; (2) aerosol and cloud backscatter profiles; (3) aerosol and cloud extinction profiles; (4) aerosol speciation is of high importance, in order to inform users about observed aerosol properties. The group will propose common procedures to retrieve these properties (inspired by the experience of the FP6 programmes, EARLINET and CLOUDNET).
+'''The way forward:''' Following EG-CLIMET presentations to EUCOS, the body responsible for the European observing system, E-PROFILE has been launched which will run from 2013-2017 with a kick-off meeting in April-May 2013. E-PROFILE will be responsible for Wind Profiler data quality and for coordinating real time exchange of backscatter profiles from lidars and ceilometers.    E-PROFILE will be involved in the logistics, a proposed COST action ‘TOPROF’ would be concerned with operational problems of data quality, calibration and the formats for data exchange.
+==== MWRnet ====
+MWR can provide timely and enough accurate atmospheric temperature and humidity data, especially good in the planetary boundary layer (PBL), which remains the single most important under-sampled part of the atmosphere, outside the reach of surface sensors and with poor satellite coverage.
+At the EG-CLIMET MC Meeting in Oslo (March 2009), some MC/WG members concurred on that the use of ground-based MWR in NWP and climate studies was hampered by unsufficient communication between users, manufacturers, and experts, lack of coordination for networking, unknown number of operational MWR. Thus, a long-time overdue cooperation and coordination effort started under the auspices of EG-CLIMET: MWRnet, an International network of MicroWave Radiometers. MWRnet aims to address the lack of coordination between the MWR operations and increase the utilization of quality controlled MWR data. The long-term mission of MWRnet is the set up of an operational network sharing good practices (in terms of procedures, formats, quality control, protocols, software, etc...) and life cycle of MWR data, facilitating the access of well documented and quality controlled MWR observations and retrievals (with errors).
+MWRnet currently links about 61 members, operating more than 94 MWR world wide (including dual-channel units, water vapor profilers, single-channel temperature profilers, multi-channel temperature profilers, and temperature and water vapor profilers), of which about 30 in Europe (temperature and water vapor profilers, for the most).
+More information on MWRnet and the network map are available at: [http://cetemps.aquila.infn.it/mwrnet/ MWRnet website]
+MWRnet started within EG-CLIMET and most of the activities were carried out within this COST action. In particular, 3 SWG meetings and 3 STSM were performed:
+* SWG 00: From raw data to meteorological products
+* SWG 02: MWR data processing
+* SWG 17: Towards operational use of MWR data
+* STSM 06: Assessment of Microwave Radiometer Temperature Profiling
+* STSM 11: Estimate of PBL Mixing Height from MWR data
+* STSM 13: Development of a ground-based Radiative Transfer Model (RTM) for NWP
+The major achievements of MWRnet within EG-CLIMET were:
+* Development of calibration control methods
+* Advances in retrieval algorithm development
+* MWR Data Assimilation experiment
+* Assessment of O-B statistics
+* Initial efforts towards a ground-based MWR Forward Model suited for NWP
+* EU FP7 proposal EMERGE (unfunded)
+In particular, the proposal EMERGE (European MicrowavE Radiometer network within GEo) grouped eight members (CETEMPS-Univ. of L’Aquila (IT), Univ. of Köln (D), KNMI (NL), IMAA (IT), FMI (FI), DWD (D), Meteoswiss (CH), MetOffice (UK)), five of which from National Weather Services. EMERGE passed all quality criteria but unfortunately did not reach the funding level.
+MWRnet pursued building connections with NWP data assimilation (DA), climate, and radiopropagation communities:
+* NWP DA:
+** Contribution to the US Tropospheric Profiling Technology Workshop (organized by the US NSF and NWS)
+** Invitation to chair a session on the German DA Workshop
+** DA experiment in collaboration with Meteo France (HyMeX)
+** Mention in the EUCOS roadmap for 2013-2017 as an interesting network for EUCOS expansion
+* CLIMATE:
+** Invitation to join the GRUAN (GCOS Reference Upper Air Network) Task Team 5 focusing on ancillary measurement (w.r.t. radiosondes)
+** Contribution to the MWR handbook for GRUAN
+* RADIO PROPAGATION
+** Contribution to the final report of COST Action IC0802 – “Propagation tools and data for integrated Telecommunication, Navigation and Earth Observation systems” with a MWR handbook focusing on MWR estimates of atmospheric attenuation
+At its present stage, MWRnet faces both technical and bureaucratic challenges:
+* Implement common data life-cycle (data format, quality control, retrieval)
+* Establish a trusted ground-based MWR Forward Model suited for NWP
+* Data sharing policy
+As the outcome of the MWRnet meetings, the following recommendations were collected for good practices with MWR operations.
+{| class="wikitable"
+!colspan="5"|Table 4.2.2: MWRnet recommendations for MWR operations
+|-
+| '''#'''
+| '''Type'''
+| '''Recommendation'''
+| '''Note'''
+|-
+| MM1
+| Measurement mode
+| Perform zenith viewing alternating with elevation scans regularly, possibly as frequent as 5 min. Store observations at all channels. If possible, perform 2-side scans.
+|
+|-
+| MM2
+| Measurement mode
+| Perform frequent observations of the calibration load (5min intervals). Use integration time ~10 sec (as calibrations need to have longer integration times than the observations for a safe reduction of rms noise).
+|
+|-
+| MM3
+| Measurement mode
+| Ideally, all raw voltages of receivers and temperatures in the radiometer system should be recorded continuously in order to make a post-calibration possible.
+|
+|-
+| MM4
+| Measurement mode
+| Level 0 data should always be stored. Always store data even if quality flags are on. Avoid discarding data.
+|
+|- style="color:blue"
+| CC1
+| Calibration control
+| Carefully follow instructions for cryogenic calibration. If possible check Tb after cryogenic calibration against a reference (e.g. clear sky radiosonde simulations).
+|
+|- style="color:blue"
+| CC2
+| Calibration control
+| Before each cryogenic calibration: observe the cold load for ~2min to characterize the instrument drifts since the last calibration. Note that this need a dedicated featured software since the observed TB will NOT be the LN2 temperature. In fact, the interface reflection on the LN2-surface, residual mirror emission, overspill-termination and other correction factors need to be applied.
+|
+|- style="color:blue"
+| CC3
+| Calibration control
+| Be careful when using calibration coefficients obtained by a single sky dip (tipping curve). Make sure the threshold for a horizontally homogeneous sky are set very tight, Averaged time series of sky dip calibration coefficients may be used to avoid jumps in the data. Perform full sky-scans to assess the validity of the “homogeneous sky” assumption.
+|
+|- style="color:blue"
+| CC4
+| Calibration control
+| Inspection by manufacturer every 1.5-2 years is recommended.
+|
+|- style="color:blue"
+| CC5
+| Calibration control
+| Re-processing of MWR observations and retrievals may be possible if a comparable set of collocated radiosonde profiles is available. Alternatively model analyses could be used.
+|
+|- style="color:blue"
+| CC6
+| Calibration control
+| Climate application should rely on careful calibration monitoring (including radiative transfer comparison and close maintenance).
+|
+|- style="color:blue"
+| CC7
+| Calibration control
+| Gain calibration should be performed once every 3-5 minutes for some 5-10 sec integration time.
+|
+|-
+| QC1
+| Quality control
+| Use sanity checks to monitor the reliability of the instrument hardware and thus of observed Tb. Use flags provided by manufacturers as well as developed by users.
+|
+|-
+| QC2
+| Quality control
+| Use quality control checks to estimate the value of retrievals in opaque (rainy) situations. Use flags provided by manufacturers as well as developed by users.
+|
+|-
+| QC3
+| Quality control
+| Rain flag is necessary, especially for humidity, but is may overkill acceptable retrievals. Check the quality of retrievals during rain flagged periods.
+|
+|- style="color:blue"
+| RA1
+| Retrieval algorithm
+| Uniform multi-linear regression (or NN) retrievals based on radiative transfer calculations should be implemented. These are robust to handle and their accuracy is mostly optimized. Alternatively, direct regression retrievals based on the relation between measurements and model output should be considered.
+|
+|- style="color:blue"
+| RA2
+| Retrieval algorithm
+| Ideally, a variational approach should be adopted for all the MWR. However, future testing is required – specifically concerning the handling of liquid clouds
+|
+|- style="color:blue"
+| RA3
+| Retrieval algorithm
+| The estimate of the retrieval error should be provided.
+|
+|- style="color:blue"
+| RA4
+| Retrieval algorithm
+| The estimate of in-depth retrieval characteristics should be provided (averaging kernels, degrees of freedom)
+|
+|- style="color:blue"
+| RA5
+| Retrieval algorithm
+| Avoid RH profiles computed from T and WV retrieved profiles.
+|
+|-
+| DF1
+| Data format
+| Produce data in a easy-to-share format with metadata.
+|
+|-
+| DF2
+| Data format
+| netCDF format complying to the Climate-Forecast (CF) convention is preferable.
+|
+|-
+| DF3
+| Data format
+| Common data and metadata format should be decided building on the experience of ARM, LUAMI, COPS.
+|
+|-
+| DF4
+| Data format
+| Data should be processed and stored in a reliable and centralized server.
+|
+|}
+== NWP Applications ==
+=== Quantifying the impact of wind profiler observations ===
+==== Wind Profiler Impact seen by FSO preliminary results ====
+Until recently there had only been a  few studies of the impact of wind profiler observations in NWP and these studies concluded that the impact is very small, or even neutral in the UK Met Office global unified model (UM). “Significant impact cannot be detected from the European wind profiler network” Technical Report No. 532 2009, Richard Dumelow. In this denial experiment, wind profilers were removed as a whole observing system along with VAD wind from weather radars.
+Within the last couples of years several Met services like NRL, ECMWF, the UK Met Office have developed forecast sensitivity to observation (FSO) tools which estimate the reduction of forecast error associated with individual observations.  At the Met office, this tool has been recently developed for the global model by Andrew Lorenc and Richard Marriott and is run to correspond with parallel suites containing significant changes to the UM and /or data assimilation. It allows comparison of the impact of different observing systems (Lorenc and Marriott 2012) for different versions of the model. For the first time, the impact of each wind profiler can easily be examined.
+In this section we show the impact, measured by FSO, of wind profilers on 24-hour global forecasts over a period of one month and compare it with radiosonde impact. The theoretical foundation for the Met Office FSO tool is fully described in Lorenc and Marriott 2012.
+==== Wind profiler impact on 24-hour global model forecasts ====
+[[File:Wp.1.jpg|640px|thumb|left|'''Figure 5.1.1''': Values for 24-hour forecast impact associated with the use of wind profiler within areas of 2.5 by 2.5 degrees. If in that grid box two profilers are present, their impacts are combined. (In Europe wind profiler are together with VAD wind from weather radar). Negative values indicate beneficial forecast impacts (corresponding to a reduction in forecast error). Impacts were accumulated over the full period (22/08/2010-29/09/2012)]]
+Using the chain rule of derivatives (adjoint techniques), values of forecast error sensitivity to observations (usually at a forecast length of 24h) can be computed for each assimilated observation simultaneously. The values represent the change in forecast error for a unit observation innovation. Multiplying the sensitivity by the observation innovation gives an estimate of the forecast error difference due to the observation. This is an estimate of the observation’s impact in the full system, i.e. assimilation + forecast model. The innovation is the difference between the equivalent model observation computed from the forecast valid at the analysis time issued from the previous analysis and the observation use in the current analysis cycle. The forecast error is computed using an energy norm which includes elastic and potential energy, thermal energy, the latent thermal energy of condensation and kinetic energy (Lorenc and Marriott 2012). The forecast error can be computed on any domain. In this study the domain is the full globe for model levels up to 150 hPa.
+This tool has been developed for the operational global model which uses a 4D-Var assimilation scheme (Rawlins et al 2007). The FSO tool was run over a period of approximately one month from the 22/08/2010 until the 29/09/2010 using a reduced-resolution version of the UM that was operational at the Met Office between 16 March and 20 July 2011. The full forecast model was run at N512 resolution (approx. 25km in the horizontal and the adjoint model at N216 (approx. 60km in the horizontal. The 4D-Var assimilation scheme uses a 6 hour window and was run at N216 resolution in both the forward and adjoint runs. The wind profilers which are suitable for data assimilation are quality controlled using a background check (if the innovation is too large the observation is rejected). The wind profiler data are hourly thinned.
+[[File:Wp.2.jpg|700px|thumb|right|'''Figure 5.1.2''': An example of wind from wind profiler 70197 (CENA2 Alaska) with quality issues. Winds in red are flagged by the data assimilation quality control. However, some erroneous winds are assimilated]]
+Figure 5.1.1 shows FSO-estimated values of the difference in 24h forecast error associated with the use of wind profiler observations within areas of 2.5 by 2.5 degrees. If in that area two profilers are present, their impacts are combined. N.B. the field shows estimated values of forecast error impact attributed to observations in those locations, not the change in forecast error itself. The error difference measured by the FSO tool was accumulated over the full period for each of the wind profilers and weather radars assimilated in the UK Met Office global model. The impact is quite variable but most of the wind profilers have a beneficial impact (negative value corresponding to a reduction in forecast error). The strongest beneficial impact comes from the Japanese network whilst a few wind profilers have a detrimental impact. The profiler in the middle of Alaska is clearly giving a detrimental impact. A few wind profilers in the US are also measured as having a detrimental impact. In Europe, impacts are mostly neutral/beneficial except for over Switzerland.
+The detrimental impact of the wind profiler located in Alaska is due to the quality of the data. Figure 5.1.2 shows one example of these observations. A fair amount of the winds are blowing in spurious directions. Most of them are flagged by the data assimilation quality control but some suspect winds are assimilated. The comparison of the wind against the first guess (Figure 5.1.3) reveals strong bias and a large root mean square deviation. This wind profiler is now blacklisted by the Met Office and is in need of maintenance. (It stopped sending data in 2012.) Some of the other wind profilers from the NOAA network are also giving slightly detrimental impacts; the origin of these detrimental impacts has not yet been studied. The wind profiler in Switzerland at Payerne is located in the vicinity of very complex terrain not well represented by the global model and it is not surprising that such detailed information might have a detrimental effect on the global model. The comparison with the global model in Figure 5.1.4 clearly shows large biases in the boundary layer.
+[[File:Wp.3.jpg|700px|thumb|center|'''Figure 5.1.3''': Comparison of wind data from 70197 (CENA2 Alaska) against the background from the global model for the whole period]]
+[[File:Wp.4.jpg|700px|thumb|center|'''Figure 5.1.4''': Comparison of wind data from Payerne (Switzerland) against the background from the global model for the whole period]]
+Figure 5.1.5 shows total 24-hour forecast impacts for all European wind profilers. The largest beneficial impact is for wind profiler 03020 South Uist high mode UK (North West Scotland), followed by 10266 Ziegendorf (North Germany). A couple of wind profilers are giving detrimental impacts where they are situated in regions of complex orography (Switzerland 6610, 6632 ). The detrimental impact for the three other wind profilers 11036, 12842, 12982 haven’t yet been investigated.
+[[File:Wp.5.jpg|400px|thumb|center|'''Figure 5.1.5''': Total 24-hour forecast impact over the period for each of the wind profilers assimilated in Europe in the UK Met Office’s global model. The vertical axis is labelled with WMO numbers of the wind profilers]]
+In the UK, total wind profiler impact for the period is larger than that for radiosondes; (see Figure 5.1.6 and 5.1.7) by a factor ~3 when comparing the South Uist wind profiler and Lerwick radiosonde, which are both located in Scotland, and for Camborne (Cornwall).
+[[File:Wp.6.jpg|400px|thumb|left|'''Figure 5.1.6''': Total impact for wind profilers located in the UK]]
+[[File:Wp.7.jpg|400px|thumb|right|'''Figure 5.1.7''': Total impacts for radiosondes launched in the UK. The impact includes all observations reported by the radiosondes: wind, temperature and humidity data]]
+[[File:Wp.8.jpg|400px|thumb|left|'''Figure 5.1.8''': Mean impact per profile for German wind profilers]]
+[[File:Wp.9.jpg|400px|thumb|right|'''Figure 5.1.9''': Mean impact per profile for German radiosondes. The impact includes all observations reported by the radiosondes: wind, temperature and humidity data]]
+[[File:Wp.10.jpg|400px|thumb|left|'''Figure 5.1.10''': Total impacts for wind profilers located in Germany]]
+[[File:Wp.11.jpg|400px|thumb|right|'''Figure 5.1.11''': Total impact for radiosondes launched in the UK. The impact includes all observations reported by the radiosondes: wind, temperature and humidity data]]
+At Lindenberg in Germany, the mean wind profiler impact per sounding is as large as the mean impact per radiosonde profile (Figures 5.1.8 and 5.1.9) even though radiosonde observations include temperature and humidity readings as well as winds. (Part of the reason for this could be that the Lindenberg wind profiler is located at a manned observatory (GRUAN station) and is very well maintained.) When accumulated over the full period, the wind profiler impact is larger than the radiosonde impact by a factor ~7 (Figures 5.1.10 and 5.1.11) due to the higher frequency at which wind profiler soundings are performed. The variance of the Lindenberg radiosonde impacts is large meaning that there may be error in our estimation of this mean impact. This result should therefore be confirmed over a larger period of time. Also, it is possible that errors in the impacts of individual observations might be correlated (in height and in time). The total impact, which is just the sum of all the individual impacts, might then be exaggerated. This needs more investigation. However, as the Lindenberg wind profiler and radiosonde are collocated, their impact estimates should each suffer from similar error-correlations. Comparison of their impacts is therefore justified.
+When comparing the impact of Lindenberg with Ziegendorf or South Uist, the impact is relatively small. This is not surprising as, at Lindenberg, the atmosphere is already well described in the model due to assimilation of the radiosonde four times a day. The same applies for Camborne where both wind profiler and radiosonde are assimilated. There is a tendency to measure larger impacts for wind profilers and radiosondes located close to the sea, e.g. Lerwick, South Uist, Eimden, Ziegendorf.
+==== Conclusion ====
+The FSO tool allows efficient estimation of the impact of each wind profiler. Some wind profilers have a detrimental impact because of quality issues (as in Alaska) or representativeness problems (as at Payerne) but most are measured as having a beneficial impact. The largest impacts come from the Japanese network which are very homogeneous in quality. In general the impact is larger near the coast and in other less well-observed areas. For the studied period, wind profilers of good quality were found to have as much impact per profile as radiosondes with the total wind profiler impact being much larger when accumulated over time. Correlation of errors may cause the beneficial or detrimental impact of observations to be exaggerated. However, these preliminary results tend to indicate that wind profilers could be giving large impacts where they are well maintained and placed in strategic locations. An extended period should be studied to confirm these findings.
+=== Operational assimilation of wind profiler observations ===
+[[File:Example_CN-MET.jpg|300px|thumb|right|Figure 5.2.1: Typical example of a one-day wind profile time series at Payerne. Coloured barbs: wind profiler measurement; grey barbs COSMO-2 profiles.]]
+Wind profiler observations are operationally assimilated at the European level since a few years (see [http://wiki.eg-climet.org/index.php?title=Final_Report#The_European_network_of_wind_profilers_CWINDE CWINDE]). At the regional scale, an operational system combining wind profiler measurements and a 2km-resolution NWP model was designed in Switzerland (see Figure 5.2.1). Its main purpose is to deliver weather information necessary to the population safety in case of a nuclear hazard. It represents the coupling of a specifically adapted measurement network (mainly ground-based remote sensing) and a predictive tool in the form of a fine grid numerical weather prediction model currently operated at MeteoSwiss (COSMO-2). During the project phase, the positive impact of the three wind profilers on the quality of the forecast over the Swiss Plateau was demonstrated. This system is operational since 2009 [http://www.atmos-meas-tech.net/4/1617/2011/amt-4-1617-2011.html Calpini et al, 2011.].
+=== MWR data assimilation test ===
+A first trial of assimilating microwave radiometers (MWR) measurements into numerical weather prediction was carried out in preparation to the Hydrological cycle in Mediterranean EXperiment ([http://www.hymex.org/ HyMeX]) Special Observing Period 1, held in September-November 2012 in the Western Mediterranean (WMed) arget area.
+[[File: HyMeX Arome WMed.png |300px|thumb|right|Figure 5.3.1: Domain of Arome WMed (black line) and distribution of MWR (red: humidity only, blue: temperature only, purple: humidity and temperature) participating to the Data Assimilation preparation phase to HyMeX SOP1]]
+The NWP system used for this study is Arome-WMed, a particular version of the Arome system covering the western part of the Mediterranean Sea (see fig. 5.3.1). Arome-WMed has a horizontal resolution of 2.5 km, a non-hydrostatic dynamical core, detailed physics inherited from the research Meso-NH model, and is coupled with the global Arpege NWP system. It has a three-dimensional variational (3DVar) data assimilation system [10] with background covariances specially computed for the WMed domain. 3DVar analyses are performed every three hours and provide new initial states for subsequent forecasts.
+Data assimilation tools developed for the Météo-France Arome-WMed NWP system were used to assimilate temperature and humidity retrievals from a list of 13 MWR members (Table 5.3.1) of the international network of ground-based microwave radiometers [http://cetemps.aquila.infn.it/mwrnet MWRnet].
+{| class="wikitable"
+!colspan="6"|Table 5.3.1: MWR units participating to the data assimilation test
+into HyMeX Arome-WMed NWP
+|-
+| '''STATION'''
+| '''INSTITUTION'''
+| '''Lat'''
+| '''Lon'''
+| '''m a.s.l.'''
+| '''Products'''
+|-
+| Bern
+| IAP
+| 46.88
+| 7.46
+| 905
+| H
+|-
+| Cagliari
+| INAF/OAC
+| 39.5
+| 9.24
+| 623
+| T, H
+|-
+| Granada
+| CEAMA-UGR
+| 37.16
+| -3.6
+| 683
+| T, H
+|-
+| Kloten
+| MeteoSwiss
+| 47.48
+| 8.53
+| 436
+| T
+|-
+| Lampedusa
+| ENEA
+| 35.51
+| 12.34
+| 50
+| T, H
+|-
+| Madrid
+| UniLeon
+| 40.49
+| -3.46
+| 620
+| T, H
+|-
+| Padova
+| ARPAV
+| 45.4
+| 11.89
+| 30
+| T
+|-
+| Payerne
+| MeteoSwiss
+| 46.82
+| 6.95
+| 491
+| T, H
+|-
+| Potenza
+| IMAA/CNR
+| 40.6
+| 15.72
+| 760
+| T, H
+|-
+| Rovigo
+| ARPAV
+| 45.07
+| 11.78
+| 23
+| T
+|-
+| Schaffhausen
+| MeteoSwiss
+| 47.68
+|  6.62
+| 437
+| T
+|-
+| Schneefernerhaus
+| UniCologne
+| 47.42
+| 10.98
+| 2650
+| T, H
+|-
+| Toulouse
+| ONERA
+| 43.38
+| 1.29
+| 144
+| T, H
+|}
+Preliminary results are summarized in [http://cetemps.aquila.infn.it/istp/proceedings/Session_P_Posters/P45_Cimini.pdf  Cimini et al., 2012]. As a first step, observation-minus-background (O-B) statistics have been computed for temperature and relative humidity to check the consistency between MWR products and 3-h Arome forecasts. For all MWRs, the O-B standard deviations are generally consistent with those of radiosondes, but tend to increase with height. O-B biases are generally much larger than those found for radiosondes (except for Lampedusa where the temperature bias is particularly small). This is likely due to the difference between the climatological mean assumed in the retrieval and the mean atmospheric state during the period under analysis.
+Ongoing work includes deeper investigation of automatic quality control and O-B biases, and a quantitative evaluation of the impact Arome-WMed on analyses and forecasts.
 == References ==
-Contributors: N. Cimini, G. Martucci
-Askne, J. and E.R. Westwater, 1986: A review of ground-based remote sensing of temperature and moisture by passive microwave radiometers. IEEE Trans. Geosci. Remote Sens., GE-24, 340-352.
+* Ansmann, A., Riebesell, M., Wandinger, U., Weitkamp, C., Voss, E., Lahmann, W., Michaelis, W., Combined Raman elastic-backscatter lidar for vertical profiling of moisture, aerosol extinction and lidar ratio, Appl. Phys B., 55 (1), 18-28, 1992
+* [http://www.opticsinfobase.org/ol/abstract.cfm?id=10138 Ansmann A., M. Riebesell, and C. Weitkamp, "Measurement of atmospheric aerosol extinction profiles with a Raman lidar," Opt. Lett. 15, 746-748 (1990)]
+* Argyrouli A., N. Budko, H. Russchenberg & C. Unal (2012): The effect of droplet clustering on the statistics of radar backscatter from water clouds, Proceedings of 9th International Symposium on Tropospheric Profiling, ISBN 978-90-815839-4-7, L'Aquila, ITALY, 3-7 Semptember 2012.
+* Askne, J. and E.R. Westwater, 1986: A review of ground-based remote sensing of temperature and moisture by passive microwave radiometers. IEEE Trans. Geosci. Remote Sens., GE-24, 340-352.
+* Atlas, D., The estimation of cloud parameters by radar, Jour. Meteor., 11, 309-317, 1954
+* Baars, H., Ansmann, A., Engelmann, R., and Althausen, D.: Continuous monitoring of the boundary-layer top with lidar, Atmos. Chem. Phys., 8, 7281-7296, 2008.
+* Barker, H. W., T. J. Curtis, E. Leontieva, and K. Stamnes, 1998: Optical depth of overcast cloud across Canada: Estimates based on surface pyranometer and satellite measurements, J. Climate, 11, 2980–2993.
+* Barnard, J. C., Long C. N., 2004: A simple empirical equation to calculate cloud optical thickness using shortwave broadband measurements, J. Appl. Meteor.; 43(7): 1057-1066.
+* Barnard J.C., C.N. Long, E.I. Kassianov, S.A. McFarlane, J.M. Comstock, M. Freer, and G. McFarquhar, 2008: Development and Evaluation of a Simple Algorithm to Find Cloud Optical Depth with Emphasis on Thin Ice Clouds, Open Atmospheric Science Journal 2:46-55. doi:10.2174/1874282300802010046
+* Bastin, S., C. Champollion, O. Bock, P. Drobinski, and F. Masson, 2007: Diurnal cycle of water vapor as documented by a dense GPS network in a coastal area during ESCOMPTE IOP2. J. Appl. Meteor. Climatol., 46, 167–182.
+* Battan, L.J. (1973): Radar observation of the atmosphere. The University of Chicago Press.
+* Bauer-Pfundstein, M. & Görsdorf, U. (2007), Target separation and classification using cloud radar Doppler-spectra, in 'Proceedings 33rd Intern. Conf. on Radar Meteorology, Cairns'.
+* Behrendt, A., Pal, S., Aoshima, F., Bender, M., Blyth, A., Corsmeier, U., Cuesta, J., Dick, G., Dorninger, M., Flamant, C., Di Girolamo, P., Gorgas, T., Huang, Y., Kalthoff, N., Khodayar, S., Mannstein, H., Träumner, K., Wieser, A., Wulfmeyer, V., 2011a. Observation of convection initiation processes with a suite of state-of-the-art research instruments during COPS IOP8b. Quarterly Journal of Royal Meteorological Society 137, doi: 81e100. doi:10.1002/qj.758.
+* Bender, M., Dick, G., Ge, M., Deng, Z., Wickert, J., Kahle, H.-G., Raabe, A., and Tetzlaff, G.: Development of a GNSS water vapour tomography system using algebraic reconstruction techniques, Adv. Space Res., 47, 1704–1720, doi:10.1016/j.asr.2010.05.034, 2011.
+* Bergada, M., S.M. Sekelsky & L. Li (2001): External Calibration of Millimeter-Wave Atmospheric Radar Systems Using Corner Reflectors and Spheres, Eleventh ARM Science Team Meeting Proceedings, Atlanta, Georgia, March 19-23, 1-8.
+* Bianco, L., J. M. Wilczak, and A. B. White, 2007: Convective boundary layer depth estimation from wind profilers: statistical comparison between an automated algorithm and expert estimations, J. Atmos. Ocean. Tech., 25, 1397-1413).
+* Bleisch R., N. Kampfer, and A. Haefele. Retrieval of tropospheric water vapour by using spectra of a 22 GHz radiometer. Atm. Meas. Tech., 4:1891-1903, 2011.
+* Boers, R., Russchenberg, H., Erkelens, J., and V. Venema, 2000. J. Appl. Meteor., 39, 169-181
+* Boers, R., J. R. Acarreta, and J. L. Gras, 2006. J. Geophys. Res., 111, D22208, doi: 10.1029/2005JD006838
+* Boers, R., 1997: Simultaneous retrievals of cloud optical depth and droplet concentration from solar irradiance and microwave liquid water path, J. Geophys. Res., 102(D25), 29,881–29,891, doi:10.1029/97JD02494.
+* Bohren, C. F., Clothiaux, E. "Fundamentals of Atmospheric Radiation: An Introduction with 400 Problems", 1. Edition, Wiley-VCH, Berlin, 2006, 472 pp. ISBN-10: 3-527-40503-8, ISBN-13: 978-3-527-40503-9
+* Bosenberg, J, Ground-based differential absorption lidar for water-vapor and temperature profiling: methodology, Appl. Opt., 37 (18), 3845-3860, 1998
+* Bouniol, D., A. J. Illingworth and R. J. Hogan, 2003: Deriving turbulent kinetic energy dissipation rate within clouds using ground based 94 Ghz radar. Proc. 31st Conference on Radar Meteorology, Seattle, USA, Amer. Meteor. Soc., 193-196.
+* Brandau, C.L., Russchenberg, H.W.J., Knap, W.H., 2010. Atmospheric Research, 96, DOI:10.1016/j.atmosres.2010.01.009.
+* Brenguier, J.-L., Burnet, F., and Geoffroy, O.: Cloud optical thickness and liquid water path – does the k coefficient vary with droplet concentration?, Atmos. Chem. Phys., 11, 9771-9786, doi:10.5194/acp-11-9771-2011, 2011.
+* [http://dx.doi.org/10.1017/CBO9780511541094 Bringi, V.N. & V. Chandrasekar (2001): Polarimetric Doppler Weather Radar. Cambridge University.]
+* Brooks, Ian M., 2003: Finding boundary layer top: Application of a wavelet covariance transform to Lidar Backscatter Profiles. J. of Atmos. and Oceanic Technol., 20, 1092 – 1105.
+* Browning, K.A. and R. Wexler, 1968: The Determination of Kinematic Properties of a Wind Field Using Doppler Radar, J. Appl. Met., 7, 105-113.
+* Cadeddu, M.P. and D.D. Turner, (2011), Evaluation of water permittivity models from ground-based observations of cold clouds at frequencies between 23 and 170 GHz, IEEE Trans. Geosci. Rem. Sens., in press, doi:10.1109/TGRS.2011.2121074.
+* Cadeddu M. P., V. H. Payne, S. A. Clough, K. Cady-Pereira, and James C. Liljegren (2007), Effect of the Oxygen Line-Parameter Modeling on Temperature and Humidity Retrievals From Ground-Based Microwave Radiometers, IEEE Trans. Geosci. Rem. Sens., vol. 45, no. 7, pp. 2216-2223.
+* Cadeddu M. P., Liljegren, J. C., and A. L. Pazmany, Measurements and Retrievals From a New 183-GHz Water-Vapor Radiometer in the Arctic, IEEE Trans. Geosci. Rem. Sens, 45, 7, 2207-2215, 2007.
+* Calpini B., D. Ruffieux, J.-M. Bettems, C. Hug, P. Huguenin, H.-P. Isaak, P. Kaufmann, O. Maier, and P. Steiner, Ground-based remote sensing profiling and numerical weather prediction model to manage nuclear power plants meteorological surveillance in Switzerland. Atmos. Meas. Tech., 4, 1617-1625, 2011, DOI 10.5194/amt-4-1617-2011. [http://www.atmos-meas-tech.net/4/1617/2011/amt-4-1617-2011.html Online]
+* Canny, J., A Computational Approach To Edge Detection, IEEE Trans. Pattern Analysis and Machine Intelligence, 8:679-714 (1986).
+* Cariou Jean-Pierre, Parmentier Rémy, Valla Matthieu, "An innovative and autonomous 1.5µm Coherent lidar for PBL wind profiling"; 14th CLRC, USA
+* Cariou J.P., B. Augere, M. Valla, “Laser source requirements for coherent lidars based on fiber technology”, C. R Physique 7 (2006) Elsevier Ed.
+* Cesana, G., J. E. Kay, H. Chepfer, J. M. English, and G. deBoer (2012), Ubiquitous low-level liquid-containing Arctic clouds: New observations and climate model constraints from CALIPSO-GOCCP, Geophys. Res. Lett, 39, L20804, doi:10.1029/2012GL053385 http://onlinelibrary.wiley.com/doi/10.1029/2012GL053385/abstract
+* Champollion, C., F. Masson, M. N. Bouin, A. Walpersdorf, E. Doerflinger, O. Bock, and J. Van Baelen, 2005: GPS water vapour tomography: Preliminary results from the ESCOMPTE field experiment. Atmos. Res., 74, 253-274.
+* Charlson, R.J., D.S. Covert, T.V. Larson, and A.P. Waggoner, Chemical properties of tropospheric sulphur aerosols, Atmos. Environ., 12, 39-53, 1978.
+* Chiu, J. C., C.-H. Huang, A. Marshak, I. Slutsker, D. M. Giles, B. N. Holben, Y. Knyazikhin, and W. J. Wiscombe, 2010: Cloud optical depth retrievals from the Aerosol Robotic Network (AERONET) cloud mode observations, J. Geophys. Res., 115, D14202, doi:10.1029/2009JD013121.
+* Cimini D., O. Caumont, U. Löhnert, L. Alados-Arboledas, R. Bleisch, J. Fernández-Gálvez, T. Huet, M. E. Ferrario, F. Madonna, O. Maier, F. Nasir, G. Pace, and R. Posada: An International Network of Ground-Based Microwave Radiometers for the Assimilation of Temperature and Humidity Profiles into NWP Models, Proceedings of 9th International Symposium on Tropospheric Profiling, ISBN 978-90-815839-4-7, L'Aquila, ITALY, 3-7 Semptember 2012. [http://cetemps.aquila.infn.it/istp/proceedings/Session_P_Posters/P45_Cimini.pdf Online]
+* Cimini D., E. Campos, R. Ware, S. Albers, G. Giuliani, J. Oreamuno, P. Joe, S. Koch, S. Cober, and E. Westwater, (2011) “Thermodynamic Atmospheric Profiling during the 2010 Winter Olympics Using Ground-based Microwave Radiometry”, IEEE Trans. Geosci. Rem. Sens., 2011.
+* Cimini D., E. R. Westwater, and A. J. Gasiewski (2010), “Temperature and humidity profiling in the Arctic using millimeter-wave radiometry and 1DVAR”, IEEE Trans. Geosci. Rem. Sens., Vol. 48, 3, 1381-1388, 10.1109/TGRS.2009.2030500.
+* Cimini, D., E. R. Westwater, A. J. Gasiewski, M. Klein, V. Leusky, and S. Dowlatshahi, The Ground-based Scanning Radiometer: A Powerful Tool for Study of the Arctic Atmosphere, IEEE Trans. Geosci. Rem. Sens., Vol. 45, No. 9, pp. 2759-2777, 2007
+* Cimini, D., T. J. Hewison, L. Martin, J. Güldner, C. Gaffard and F. S. Marzano (2006), “Temperature and humidity profile retrievals from ground-based microwave radiometers during TUC”,  Met. Zeitschrift, Vol. 15, No. 1, 45-56.
+* Cimini, D., E. R. Westwater, R. Ware, S.J. Keihm, Y. Han, F. S. Marzano, and P. Ciotti (2004), Empirical evaluation of four microwave radiative forward models based on ground-based radiometer between 20 and 60 GHz, Proc. 14th ARM Science Team Meeting.
+* Clothiaux, E.E., M.A. Miller, B.A. Albrecht, T.P. Achermann, J. Verlinde, D.M. Babb, R.M. Peters & W.J. Syrett (1995): An evaluation of a 94 GHz radar for remote sensing of cloud parameters, J. Atmos. Oceanic Technol., 12, 201-229.
+* Clothiaux E. E., and Coauthors, 1999: The Atmospheric Radiation Measurement Program Cloud Radars: Operational Modes. J. Atmos. Oceanic Technol., 16, 819–827.
+* Clough S. A., M.W. Shephard, E. J.Mlawer, J. S. Delamere, M. J. Iacono, K. Cady-Pereira, S. Boukabara, and P. D. Brown (2005), “Atmospheric radiative transfer modeling: A summary of the AER codes,” J. Quant. Spectrosc. Radiat. Transf., vol. 91, no. 2, pp. 233–244.
+* Cohn, S.A., and W.M. Angevine, 2000:  Boundary-layer height and entrainment zone thickness measured by lidars and wind profiling radars. J. Appl. Meteor., 39, 1233 – 1247.
+* [http://www2.dmu.dk/atmosphericenvironment/cost_710.htm COST710 Final report]
+* [http://www2.dmu.dk/atmosphericenvironment/cost/FinalReports715.htm COST715 Final report]
+* Crewell S., K. Ebell, U. Loehnert, and D. D. Turner (2009), “Can liquid water profiles be retrieved from passive microwave zenith observations?”, Geophys. Res. Lett., V. 36, L06803, doi:10.1029/2008GL036934
+* Crewell, S., and U. Löhnert, 2003: Accuracy of cloud liquid water path from ground-based microwave radiometry, 2. Sensor accuracy and synergy. Radio Sci., 38, 8042, doi: 10.1029/2002RS002634.
+* Crewell, S., and U. Löhnert, 2007: Accuracy of boundary layer temperature profiles retrieved with multi-frequency, multi-angle microwave radiometry. IEEE Transactions on Geoscience and Remote Sensing, 45(7), 2195-2201, DOI10.1109/TGRS.2006.888434.
+* Dabas A. , “Semi-empirical model for the reliability of a matched filter frequency estimator for Doppler lidar”, Journal of Atmospheric and Oceanic Technology, 16:19–28, 1999.
+* Daniel, J. S., S. Solomon, R. W. Portmann, A. O. Langford, C. S. Eubank, E. G. Dutton, and W. Madsen, 2002: Cloud liquid water and ice measurements from spectrally resolved near-infrared observations: A new technique, J. Geophys. Res., 107(D21), 4599, doi:10.1029/2001JD000688.
+* Danne, O. (1996): Messungen physikalischer Eigenschaften stratiformer Bewölkung mit einem 94 GHz-Wolkenradar. PhD thesis. University Hannover, Germany.
+* Davis, K. J., Gamage, N., Hagelberg, C. R., Kiemle, C., Lenschow, D. H., and Sullivan, P. P., 2000. An objective method for deriving atmospheric structure from airborne lidar observations. Journal of Atmospheric and Oceanic Technology 17, 1455–1468.
+* de Haan, S., van der Marel, H. Observing three-dimensional water vapour using a surface network of GPS receivers. Atmos. Chem. Phys. Discuss. 8, 17193–17235, 2008.
+* Di Giuseppe, F., Riccio, A., Caporaso, L., Bonafé, G., Gobbi, G. P. and Angelini, F. (2012), Automatic detection of atmospheric boundary layer height using ceilometer backscatter data assisted by a boundary layer model. Q.J.R. Meteorol. Soc., 138: 649–663.
+* Dolfi-Bouteyre et al. “Aircraft wake vortex study and characterization with 1.5 μm fiber Doppler lidar“, Journal of Aerospace Lab, December 2009.
+* Dong, X., and G.G. Mace, 2003. J. Atmos. and Oceanic Tech., 20, 42-53.
+* Dong, X., T. P. Ackerman, E. E. Clothiaux, P. Pilewskie, and Y. Han, 1997: Microphysical and radiative properties of boundary layer stratiform clouds deduced from ground-based measurements, J. Geophys. Res., 102(D20), 23,829–23,843, doi:10.1029/97JD02119.
+* Donovan, D.P. & A.C.A.P. Van Lammeren (2001): Cloud effective particle size and water content profile retrievals using combined lidar and radar observations 1. Theory and examples, Journal of Geophysical Research-Atmospheres 106, 27425–27448.
+* Doviak, R.J. & D.S. Zrnic (2006): Doppler radar and weather observations. Second Edition, Academic Press, San Diego.
+* Drüe, C., Frey, W., Hoff, A., Hauf, Th., 2008: Aircraft type-specific errors in AMDAR weather reports from commercial aircraft, Quart. J. Roy. Meteor. Soc., 134 (630), 229-239, doi: 10.1002/qj.205.
+* Emeis S, Schäfer K, MünkelC (2008) Surface-based remote sensing of the mixing-layer height - a review. Meteorol Z 17: 621-630
+* Endlich R.M., F.L. Ludwig, E.E. Uthe (1979) An automatic method for determining the mixing depth from lidar observations. Atmospheric Environment, Volume 13, Issue 7, Pages 1051–1056
+* Eresmaa, N., Karppinen, A., Joffre, S. M., Räsänen, J., and Talvitie, H.: Mixing height determination by ceilometer, Atmos. Chem. Phys., 6, 1485-1493, 2006.
+* Feltz, W.F., W.L. Smith, R.O. Knuteson, H.E. Revercomb, H.M. Woolf, and H.B. Howell, 1998: Meteorological applications of temperature and water vapor retrievals from the ground-based Atmospheric Emitted Radiance Interferometer (AERI). J. Appl. Meteor., 37, 857–875, doi: 10.1175/1520-0450(1998)037<0857.
+* Feltz, W.F., H.B. Howell, R.O. Knuteson, H.M. Woolf, D.D. Turner, R. Mahon, T.D. Halther, and W.L. Smith, 2005: Retrieving Temperature and Moisture Profiles from AERI Radiance Observations: AERIPROF Value-Added Product Technical Description, DOE/SC-ARM/TR-066, U.S. Department of Energy, Washington, D.C.
+* Fiocco, G.; and Smullin, L. D., Detection of Scattering Layers in the Upper Atmosphere (60-140 km) by Optical Radar, Nature, I275 (1963).
+* Fisher, B., S. Joffre, J. Kukkonen, M. Piringer, M. Rotach, M. Schatzmann (Eds.), 2005: Meteorology applied to urban air pollution problems. Final Report of COST Action 715. ISBN 954-9526-30-5, 276 pp. Demetra Ltd. Publishers. Printed in Bulgaria.
+* Fisher B.E.A., Erbrink J.J., Finardi S., Jeannet P., Joffre S., Morselli M.G., Pechinger U., Seibert P. and Thomson D.J. (1998): EUR 18195 -  COST Action 710  -  Final report. Harmonisation of the pre-processing of meteorological data for atmospheric dispersion models, Luxembourg: Office for Official Publications of the European Communities 1998 - 431pp. ISBN 92-828-3302-X.
+* Flamant C., J. Pelon, P. H. Flamant, and P. Durand, “Lidar  determination of the entrainment zone thickness at the top of the unstable marine atmospheric boundary-layer,” Boundary-Layer Meteorol. 83, 247–284 1997.
+* Flentje H, Heese B, Reichardt J, Thomas W (2010) Aerosol profiling using the ceilometer network of the German Meteorological Service. Atmos Meas Tech Discuss 3: 3643-3673, doi:10.5194/amtd-3-3643-2010
+* Fox, N. and A. J. Illingworth, The retrieval of stratocumulus cloud properties by ground-based cloud radar. J. Appl. Meteor., 36, 485 - 492, 1997
+* Frisch, A.S., C.W. Fairall, G. Feingold, T. Utal, & J.B. Snider (1998): On cloud radar microwave radiometer measure-ments of stratus cloud liquid water profiles, Journal of Geophysical Research 103, 23195–23197.
+* Gaussiat, N., R. J. Hogan and A. J. Illingworth, 2007: Accurate liquid water path retrieval from low-cost microwave radiometers using additional information from lidar and operational forecast models. J. Atmos. Oceanic Technol., 24, 1562-1575.
+* Gero, P.J., and D.D. Turner, 2011: Long-term trends in downwelling spectral infrared radiance over the U.S. Southern Great Plains. J. Climate., 24, 4831–4843, doi: 10.1175/2011JCLI4210.1.
+* Goldsmith J. E. M., F. H. Flair, S. E. Bisson, d. D. Turner, 1998: Turn-key Raman lidar for profiling atmospheric water vapor, clouds, and aerosols, Appl Opt., 37, 4979-4990.
+* Goody, R. M. and Y. L. Yung , “Atmospheric Radiation”, Theoretical Basis, Oxford University Press, Second Edition, 1995, 544 pages.
+* Görsdorf, U. (2007): Cloud radar. In: Engelbart D.A.M., W.A. Monna, J. Nash & C. Mätzler (Ed.): Integrated ground-based remote sensing stations for atmospheric profiling, COST Action 720 - final report, 149-167.
+* Görsdorf U., Engelbart D., Teschke G.: Can insects be used for the detection of the mixing-height layer?  Methodic and results of mixing-height layer estimation from Ka-band radar  measurements, submitted to ISTP2009 in Delft.
+* Görsdorf U., V. Lehmann & M. Bauer-Pfundstein (2012): Ka-band moment statistics and aspects of accuracy,Proceedings of the 9th International Symposium on Tropospheric Profiling.
+* Grzeschik, M., H.-S. Bauer, and V. Wulfmeyer, 2008: Four-dimensional analysis of water-vapor Raman lidar data and their impact on mesoscale forecasts. J. Atmos. Oceanic Tech., 25, 1437-1453, DOI:10.1175/2007JTECHA974.1.
+* Haeffelin, M., F. Angelini, Y. Morille, G. Martucci, S. Frey, G.-P. Gobbi, S. Lolli, C. D. O’Dowd, L. Sauvage, I. Xueref-Rémy, B. Wastine, D. Feist, 2012: Evaluation of mixing height retrievals from automatic profiling lidars and ceilometers in view of future integrated networks in Europe, Boundary-Layer Meteorol. 143:49–75.
+* Haij, M.J. de, H. Klein Baltink and W.M.F. Wauben: Continuous mixing layer height determination using the LD-40 ceilometer: a feasibility study, Scientific Report WR 2007-01, KNMI, De Bilt, 2007.
+* Han, Y. and Ed R. Westwater. 2000: Analysis and Improvement of Tipping Calibration for Ground-based Microwave Radiometers.IEEE Trans. Geosci. Remote Sens., 38(3), 1260–127
+* Hardesty, R.M, Hoff, R.M, Eds. Hoff, R.M., Hardesty, R.M., Carr, F., Weckwerth, T., Koch, S., Benedetti, A., Crewell, S., Cimini, D., Turner, D., Feltz, W., Demoz, B., Wulfmeyer, V., Sisterson, D., Ackerman, T., Fabry, F., Knupp, K., Thermodynamic Profiling Technologies Workshop report to the National Science Foundation and the National Weather Service. NCAR Technical Note 488, NCAR/TN-488+STR, ISSN: 2153-2397, 80pp. Online at http://nldr.library.ucar.edu/repository/collections/TECH-NOTE-000-000-000-853, 2012.
+* Hartung, D. C., J. A. Otkin, R. A. Petersen, D. D. Turner, W. F. Feltz, 2011: Assimilation of Surface-Based Boundary Layer Profiler Observations during a Cool-Season Weather Event Using an Observing System Simulation Experiment. Part II: Forecast Assessment. Mon. Wea. Rev., 139, 2327–2346. doi: http://dx.doi.org/10.1175/2011MWR3623.1
+* Heese, B., Flentje, H., Althausen, D., Ansmann, A., and Frey,S.: Ceilometer-lidar inter-comparison: backscatter coefficient retrieval and signal-to-noise ratio determination, Atmos. Meas. Tech. Discuss., 3, 3907–3924, 2010
+* Hennemuth B., Lammert A. (2005) Determination of the atmospheric boundary layer height from radiosonde and lidar backscatter. Boundary-Layer Meteorol DOI: 10.1007/s10546-005-9035-3.
+* Hewison T. J., D. Cimini, L. Martin, C. Gaffard and J. Nash, Validating clear air absorption model using ground-based microwave radiometers and vice-versa, Meteorologische Zeitschrift, Vol.15, No.1, 27-36, 2006.
+* Hewison T. (2006), “Profiling Temperature and Humidity by Ground-based Microwave Radiometers”, PhD Thesis, Department of Meteorology, University of Reading
+* Hewison T. (2007), “1D-VAR retrievals of temperature and humidity profiles from a ground-based microwave radiometer, IEEE Trans. Geosci. Rem. Sens., Vol. 45, No. 7, pp. 2163-2168.
+* Hogan, R.; Jakob, C. & Illingworth, A. (2001), 'Comparison of ECMWF winter-season cloud fraction with radar-derived values', Journal of Applied Meteorology 40(3), 513--525.
+* Hogan R.J., D. Bouniol, D.N. Ladd, E.J. O'Connor & A.J. Illingworth (2003): Absolute calibration of 94/95-GHz radars using rain. J. Atmos. Oceanic Technol., 20, 572–580.
+* Hogan, R. & O’Connor, E. (2004), 'Facilitating cloud radar and lidar algorithms: the Cloudnet Instrument Synergy/Target Categorization product', Cloudnet documentation.
+* Hogan, R.; O'Connor, E. & Illingworth, A. (2009), 'Verification of cloud-fraction forecasts', Quarterly Journal of the Royal Meteorological Society 135(643), 1494--1511.
+* Hogan, R. J., N. Gaussiat and A. J. Illingworth.:2005, Stratocumulus liquid water content from dual-wavelength radar, J. Atmos. Oceanic Technol., 22, 1207-1218
+* Holleman I., 2005: Quality Control and Verification of Weather Radar Wind Profiles, J. Atm. Oc. Tech., 1541-1550.
+* Holton, J.R., 1992 (2005): An Introduction to Dynamic Meteorology, fourth edition, Elsevier Academic Press, ISBN: 0-12-354015-1.
+* Hooper, W.P., & E.W. Eloranta, 1986. Lidar measurements of  wind in the planetary boundary layer: the method, accuracy and results from joint measurements with radiosonde and kytoon. J. Climate Appl. Meteor. 25:990-1000.
+* Huang, D., Y. Liu, and W. Wiscombe, 2008: Cloud tomography: Role of constraints and a new algorithm. J. Geophys. Res., 113, D23203, doi: 10.1029/2008JD009952.
+* Hurter F. and Maier O., Accuracy of boundary layer humidity profiles retrieved by GNSS meteorology and microwave radiometry, Proceedings of 9th International Symposium on Tropospheric Profiling, ISBN 978-90-815839-4-7, L'Aquila, ITALY, 3-7 Semptember 2012.
+* Illingworth, A.; Hogan, R.; O’Connor, E.; Bouniol, D.; Brooks, M.; Delanoe, J.; Donovan, D.; Eastment, J.; Gaussiat, N.; Goddard, J. & others (2007): Cloudnet - Continuous evaluation of cloud profiles in seven operational models using ground-based observations. Bull. Am. Meteorol. Soc 88, 883-898.
+* Janssen, M. A. “An Introduction to the Passive Remote Sensing of Atmospheres,” in Michael A. Janssen (ed.), Atmospheric Remote Sensing by Microwave Radiometry, New York, J. Wiley & Sons, Inc, 1993, pp.1-36.
+* Kadygrov E. N. and D. R. Pick, “The potential performance of an angular scanning single channel microwave radiometer and some comparisons with in situ observations,” Meteorol. Appl., vol. 5, pp. 393–404, 1998. DOI: 10.1017/S1350482798001054
+* Kaufman, Y. J., D. Tanré, and O. Boucher, 2002. Nature, 419, 215–223.
+* Kizhakkemadam, 2002, Estimation of atmospheric boundary layer depth from raman lidar using 2-d spatial filters, Master of science, The Pennsylvania State University.
+* Kollias, P., E.E. Clouthiaux, M.A. Miller, B.A. Albrecht, G.L. Stephens & T.P. Ackerman (2007): Millimeter-Wavelength Radars, new frontier in atmospheric cloud and precipitation research. Bulletin of the American Meteorological Society, 88, 1608-1624.
+* Kovalev V., V. Eichinger, Elastic Lidar. Theory, Practice, and Analysis Methods, Wiley Interscience Publ., New York, USA, 2004.
+* Kneifel, S., U. Löhnert, A. Battaglia, S. Crewell, and D. Siebler (2010), “Snow scattering signals in ground-based passive microwave radiometer measurements”, J. Geophys. Res., 115, D16214, doi:10.1029/2010JD013856.
+* Kneifel, S., S. Crewell, U. Löhnert, and J. Schween, 2009: Investigating water vapor variability by ground-based microwave radiometry: Evaluation using airborne observations. IEEE Geosci. Remote Sens. Letts., 6, 157–161, doi: 10.1109/LGRS.2008.2007659.
+* Kropfli, R.A. & R.D. Kelly (1996): Meteorological research application of MM-wave radar. Meteorol. Atmos. Phys., 59, 105–121.
+* Lammert A, Bösenberg J (2006) Determination of the convective  boundary layer height with laser remote sensing. Boundary-Layer Meteorol 119 : 159–170
+* Langland, R. H. and Baker, N. L. (2004): Estimation of observation impact using the NRL atmospheric variational data assimilation adjoint system. Tellus 56A, 189-201.
+* Leontyeva, E., and K. Stamnes, 1994: Estimations of cloud optical thickness from ground-based measurements of incoming solar radiation in the Arctic, J. Climate, 7, 566–578.
+* Lhermitte, R.M. and D. Atlas, 1961: Precipitation Motion by Pulse Doppler Radar in Measurements of Particle Fall Velocities, Proceedings of the 9th Weather Radar Conference, Boston, American Meteorological Society, 218-233.
+* Lhermitte, R. (1990): Attenuation and scattering of millimeter wavelength radiation by clouds and precipitation. J. Atmos. Oceanic Technol., 7, 464–479.
+* Lhermitte, R., (2002): Centimeter and Millimeter Wavelength Radars in Meteorology. Lhermitte Publications.
+* Lhermitte, R.M., 1962: Note on Wind Variability with Doppler Radar, J. Atmos. Sci., 19, 343-346.
+* Liao, L. and K. Sassen, Investigation of relationships between Ka-Band radar reflectivity and ice liquid water density, Atmos. Res., 34, 231-248, 1994
+* Liebe, H. T., 1985: An updated model for millimeter-wave propogation in moist air. Radio Sci., 20, 1069-1089.
+* Liebe, H. T., Manabe, T. and Hufford, G. A., 1989: Millimeter-wave attenuation and delay rates due to fog/cloud conditions. IEEE AP, 37, 1617-1623.
+* Liljegren, J.C., E. E. Clothiaux, G. G. Mace, S. Kato, and X. Dong, 2001. J. Geophys. Res., 106,
+* Liljegren J. C., S. A. Boukabara, K. Cady-Pereira, and S. A. Clough (2005), “The effect of the half-width of the 22-GHz water vapor line on retrievals of temperature and water vapor profiles with a twelve-channel microwave radiometer,” IEEE Trans. Geosci. Rem. Sens., vol. 43, no. 5, pp. 1102–1108.
+* Lorenc A.C. (2003): Modelling of error covariances by four-dimensional variational data assimilation. Q. J. R. Meteorol. Soc. 129: 3167-3182.
+* Lorenc A.C. and Marriott R.T. (2012): Observation Impacts in the Met Office Global NWP System, submitted to QJRMS.
+* Löhnert U., and O. Maier (2012): Operational profiling of temperature using ground-based microwave radiometry at Payerne: prospects and challenges, Atmos. Meas. Tech., 5, 1121-1134, doi:10.5194/amt-5-1121-2012. [http://www.atmos-meas-tech.net/5/1121/2012/amt-5-1121-2012.pdf Online]
+* Löhnert, U. and Maier, O.: Operational profiling of temperature using ground-based microwave radiometry at Payerne: prospects and challenges, Atmos. Meas. Tech., 5, 1121-1134, doi:10.5194/amt-5-1121-2012
+* Löhnert U., D. Turner, and S. Crewell (2009), Ground-Based Temperature and Humidity Profiling Using Spectral Infrared and Microwave Observations. Part I: Simulated Retrieval Performance in Clear-Sky Conditions, Journal of Applied Meteorology and Climatology, 48(5):1017-1032.
+* Löhnert, U.; Crewell, S.; Krasnov, O.; O'Connor, E. & Russchenberg, H. (2008), 'Advances in continuously profiling the thermodynamic state of the boundary layer: Integration of measurements and methods', Journal of Atmospheric and Oceanic Technology 25(8), 1251-1266.
+* Löhnert U., E. van Meijgaard, H. K. Baltink, S. Groß, and R. Boers (2007), “Accuracy assessment of an integrated profiling technique for operationally deriving profiles of temperature, humidity and cloud liquid water,” J. Geophys. Res., vol. 112, no. D4, p. D04 205.
+* Löhnert U., S. Crewell, and C. Simmer (2004), “An integrated approach toward retrieving physically consistent profiles of temperature, humidity, and cloud liquid water,” J. Appl. Meteorol., vol. 43, no. 9, pp. 1295–1307.
+* Löhnert,U. and S.Crewell, 2003: Accuracy of cloud liquid water path from groud-based microwave radiometry. Part I. Dependency on cloud model statistics. Radio Sci. 38, 8041, doi:10.1029/202RS002654.
+* Mace, G. G., C. Jakob and K. P. Moran, 1998: Validation of hydrometeor occurrence predicted by the ECMWF model using millimeter wave radar data. Geophys. Res. Lett., 25, 1645-1648.
+* Marshak, A., Y. Knyazikhin, A. B. Davis, W. J. Wiscombe, and P. Pilewskie, 2000: Cloud‐vegetation interaction: Use of normalized difference cloud index for estimation of cloud optical thickness, Geophys. Res. Lett., 27(12), 1695–1698, doi:10.1029/1999GL010993.
+* Marshak, A., Y. Knyazikhin, K. D. Evans, and W. J. Wiscombe, 2004: The “RED versus NIR” plane to retrieve broken‐cloud optical depth from ground‐based measurements, J. Atmos. Sci., 61, 1911–1925.
+* Martin L., ASMUWARA - The All-Sky Multi Wavelength Radiometer: Documentation, IAP Re-search Report, No. 2002-12, University of Bern, August 2002.
+* Martucci, G., J. Ovadnevaite, D. Ceburnis, H. Berresheim, S. Varghese, D. Martin, R. Flanagan, C.D. O’Dowd, 2012. Atmospheric Environment, 48C, 205-218.
+* Martucci, G. and O'Dowd, C. D., 2011. Atmos. Meas. Tech., 4, 2749-2765, doi:10.5194/amt-4-2749-2011.
+* Martucci, G., R. Matthey, V. Mitev, and H. Richner, 2007: Comparison between Backscatter Lidar and Radiosonde Measurements of the Diurnal and Nocturnal Stratification in the Lower Troposphere. J. Atmos. Oceanic Technol., 24, 1231–1244.
+* Maschwitz, G., U. Löhnert, S. Crewell, T. Rose, and D. D. Turner, 2013, Investigation of ground-based microwave radiometer calibration techniques at 530 hPa. Atmos. Meas. Tech. Discuss., 6, 989-103.
+* Matamoros, Salvador, Josep-Abel González, Josep Calbó, 2011: A Simple Method to Retrieve Cloud Properties from Atmospheric Transmittance and Liquid Water Column Measurements, J. Appl. Meteor. Climatol., 50, 283–295. doi: http://dx.doi.org/10.1175/2010JAMC2394.1
+* Mattis I., et al., 2002: Geophys.Res. Let. 29, 1306.
+* Mätzler C., Thermal Microwave Radiation: Applications for Remote Sensing, Thermal Microwave Radiation: Applications for Remote Sensing No.52, series: IEE Electromagnetic Wave series, The Institution of Engineering and Technology (IET), 2006, ISBN 0-86341-573-3 / 978-086341-573-9.
+* Measures R. M., Laser Remote Sensing. Fundamentals and Applications, Krieger Publishing Company, Malabar, Florida, 1992.
+* Melfi S. H., J. D. Sphinhirne, S.-H. Chou, and S. P. Palm,  Lidar observations of the vertically organized convection in  the planetary boundary layer over the ocean, J. Climate Appl.  Meteorol. 24, 806 – 821 1985.
+* Menut L., C. Flamant, J. Pelon and P.H.Flamant, 1999,'Urban boundary layer height determination from lidar measurements over the Paris area' Applied Optics, 38, 945-954.
+* Min, Q., E. Joseph, and M. Duan, 2004: Retrievals of thin cloud optical depth form a multifilter rotating shadowband radiometer, J. Geophys. Res., 109, D02201, doi:10.1029/2003JD003964.
+* Min, Q., and L. C. Harrison, 1996: Cloud properties derived from surface MFRSR measurements and comparison with GOES results at the ARM SGP Site, Geophys. Res. Lett., 23, 1641–1644.
+* Morille, Y., M. Haeffelin, P. Drobinski, and J. Pelon, 2007: STRAT: An Automated Algorithm to Retrieve the Vertical Structure of the Atmosphere from Single-Channel Lidar Data. J. Atmos. Oceanic Technol., 24, 761–775.
+* Müller D., Wandinger U., Ansmann A., 1999: Appl Optics, 38, 2346.
+* Münkel C, Eresmaa N, Räsänen J, Karppinene A (2007) Retrieval of mixing height and dust concentration with lidar ceilometer. Bound-Layer Meteorol 124: 117-128
+* Nan, L., W. Ming, T. Xiaowen, and P. Yujie, 2007: An Improved Velocity Volume Processing Method, Adv. Atmos. Sci., 24, 893-906.
+* Nicolae D., C. Talianu, T. Trickl, B. Tatarov, H. Nakane, N. Sugimoto, I. Serikov, V. Rizi, M. Iarlori, J. Pelon, P. Flamant, J. Spinhirne, Recent Advances in Atmospheric lidars, INOE Publishing House, 2010
+* Nicolae D., Belegante L., Nemuc A., 2010: Optoelectron. Adv. Mat.-RC, 4, 12.
+* Nilsson, T., Gradinarsky, L., & Elgered, G. (2007). Water vapour tomography using GPS phase observations: Results from the ESCOMPTE experiment. Tellus A, 59(5). doi:10.3402/tellusa.v59i5.15150
+* O'Connor, E. J., A. J. Illingworth and R. J. Hogan, 2004: A technique for autocalibration of cloud lidar. J. Atmos. Oceanic Technol., 21, 777-786.
+* Otkin, Jason A., Daniel C. Hartung, David D. Turner, Ralph A. Petersen, Wayne F. Feltz, Erik Janzon, 2011: Assimilation of Surface-Based Boundary Layer Profiler Observations during a Cool-Season Weather Event Using an Observing System Simulation Experiment. Part I: Analysis Impact. Mon. Wea. Rev., 139, 2309–2326. doi: http://dx.doi.org/10.1175/2011MWR3622.1
+* Ovadnevaite, J., D. Ceburnis, G. Martucci, J. Bialek, C. Monahan, M. Rinaldi, M. C. Facchini, H. Berresheim, D. R. Worsnop, and C. O'Dowd, 2011. Geophys. Res. Lett., 38, L21806, doi:10.1029/2011GL048869
+* Padmanabhan, S., S.C., Reising, J. Vivekanandan, F. Iturbide-Sanchez, 2009, Retrieval of atmospheric water vapor density with fine spatial resolution using three-dimensional tomographic inversion of microwave brightness temperatures measured by a network of scanning compact radiometers. IEEE Trans. Geosci. Rem. Sens., 47, 3708–3721, doi: 10.1109/TGRS.2009.2031107.
+* Pal, S., Behrendt, A., Wulfmeyer, V., 2010. Elastic-backscatter-lidar-based characterization of the convective boundary layer and investigation of related statistics. Annales Geophysicae 28, 825-847.
+* Pal, S., M. Haeffelin, E. Batchvarova, Exploring a geophysical process-based attribution technique for the determination of the atmospheric boundary layer depth using aerosol lidar and near surface meteorological measurements, submitted to JGR.
+* Payne V. H., J. S. Delamere, K. E. Cady-Pereira, R. R. Gamache, J.-L.Moncet, E. J. Mlawer, and S. A. Clough (2008), “Air-broadened half-widths of the 22 GHz and 183 GHz water vapor lines,” IEEE Trans. Geosci. Rem. Sens., vol. 46, no. 11, pp. 3601–3617.
+* Payne, V.H., E.J. Mlawer, K.E. Cady-Pereira, and J.-L. Moncet, (2011), Water vapor continuum absorption in the microwave, IEEE Trans. Geosci. Rem. Sens., 49, 2194-2208, doi:10.1109/TGRS.2010.2091416.
+* Perler, D (2011) Water vapour tomography using global navigation satellite systems , PhD thesis No. 20012, ETH Zurich, Switzerland.
+* Perler, D., A. Geiger, and F. Hurter (2011). 4D GPS water vapor tomography: new arameterized approaches. J. Geod. 85(8), 539-550.
+* Petty, G.W. "A First Course In Atmospheric Radiation", (2nd Ed.) Sundog Publishing, Madison, Wisconsin, 2006, 460 pp. (paperback), ISBN-10: 0-9729033-1-3 ISBN-13: 978-0-9729033-1-8.
+* Piironen, A.K., & E.W. Eloranta, 1995. Convective boundary layer mean depths and cloud geometrical properties obtained from volume imaging lidar data. J. Geophys. Res. 100:25 569-25 576.
+* Piringer, M., S. Joffre (Eds.), 2005: The urban surface energy budget and mixing height in European cities: data, models and challenges for urban meteorology and air quality. Final report of Working Group 2 of COST Action 715. ISBN 954-9526-29-1, 239 pp. Demetra Ltd. Publishers. Printed in Bulgaria.
+* Protat, A., D. Bouniol, E. J. O’Connor, H. Klein Baltink, J. Verlinde, K. Widener, 2011: Cloudsat as a global radar calibrator. J. Atmos. Oceanic Technol., 28, 445–452.
+* Qiu, J., 2006: Cloud optical thickness retrievals from ground-based pyranometer measurements, J. Geophys. Res., 111, D22206, doi:10.1029/2005JD006792.
+* Rainbow® 5 Instruction Manual, Release 5.31.0: Products and Algorithms, Selex Systems Integration GmbH, Document Code: GEMA-SD-0150-5310-2.
+* Ramanathan, V.,  Cess, R. D., Harrison, E. F., Minnis, P.,  Barkstrom, B. R., Ahmad, E., and D. Hartmann, 1989. Science, 243 (4887), 57-63 [doi: 10.1126/science.243.4887.57]
+* Rawlins F., Ballard S.P., Bovis K.J., Clayton A.M., Li D., Inverarity G.W., Lorenc A.C., Payne T.J. (2007): The Met Office global 4-dimensional data assimilation system. Q. J. R. Meteorol. Soc. 133: 347-362.
+* Reichardt J. U. Wandinger, V. Klein, I. Mattis, B. Hilber, D. Engelbart, R. Bergvie, F. H. Berger, 2001: RAMSES – The German Meteorological Service water-vapour Raman lidar, promet, 36, 161-168.
+* Rinehart, R. E. (2005): Radar for Meteorologists. Fourth Edition. Rinehart Publications, Columbia, MO.
+* Russchenberg, H.W. (1992): Ground-based remote sensing of precipitation using a multipolarized FM-CW Doppler radar. PhD thesis, Technical University Delft.
-Boers, R., Russchenberg, H., Erkelens, J., and V. Venema, 2000. J. Appl. Meteor., 39, 169-181
+* Russchenberg, H., Löhnert, U., Brandau, C., and Ebell, K., eds. (2009): Radar scattering by stratocumulus: often much lower than expected. Why?, Proceedings of the 8th International Symposium on Tropospheric Profiling, 2009.
-Boers, R., J. R. Acarreta, and J. L. Gras, 2006. J. Geophys. Res., 111, D22208, doi: 10.1029/2005JD006838
+* Sauvageot, K. (1992): Radar meteorology. Artech House, Boston/London.
-Brandau, C.L., Russchenberg, H.W.J., Knap, W.H., 2010. Atmospheric Research, 96, DOI:10.1016/j.atmosres.2010.01.009.
+* Sauvageot, H. and J. Omar, Radar reflectivity of cumulus clouds. J. Atmos. Oceanic Technol., 4, 264-272, 1986
-Browning, K.A. and R. Wexler, 1968: The Determination of Kinematic Properties of a Wind Field Using Doppler Radar, J. Appl. Met., 7, 105-113.
+* Schween, J.H., S. Crewell, and U. Löhnert, (2011): Horizontal-humidity gradient from one single-scanning microwave radiometer, IEEE Geosci. Remote Sens. Lett. 8(2), 336-340.
-Dong, X., and G.G. Mace, 2003. J. Atmos. and Oceanic Tech., 20, 42-53.
+* Seibert, P.; Beyrich, F.; Gryning, S.E.; Joffre, S.; Rasmussen, A.; Tercier, P. (2000): Review and intercomparison of operational methods for the determination of the mixing height. ATMOS ENVIRON. 2000; 34(7): 1001-1027.
-Fox, N. I., and A. J. Illingworth. J. Appl. Meteor., 36, 485-492, 1997
+* Sicard M., C. Pérez, F. Rocadenbosch, J. M. Baldasano, and D. García-Vizcaino, 2006: Mixed layer depth determination in the Barcelona costal area from regular lidar measurements: Methods, results and limitation. Bound.-Layer Meteor., 119, 135–157.
-Kaufman, Y. J., D. Tanré, and O. Boucher, 2002. Nature, 419, 215–223.
+* Simeonov V., T. Dinoev, B. Calpini, S. Bobrovnikov, Y. Arshinov, P. Ristori, H. van den Bergh, and M. Parlange, 2010: A Raman Lidar as Operational Tool for Water Vapor Profiling in the Swiss Meteorological Office, 25 ILRC proceedings, pp. 1175-1178.
-Holleman I., 2005: Quality Control and Verification of Weather Radar Wind Profiles, J. Atm. Oc. Tech., 1541-1550.
+* Smith, W.L, W.F. Feltz, R.O. Knuteson, H.E. Revercomb, H.M. Woolf, and H.B. Howell, 1999: The retrieval of planetary boundary layer structure using ground-based infrared spectral radiance measurements. J. Atmos. Oceanic Technol., 16, 323–333, doi: 10.1175/1520-0426(1999)016<0323.
-Holton, J.R., 1992 (2005): An Introduction to Dynamic Meteorology, fourth edition, Elsevier Academic Press, ISBN: 0-12-354015-1.
+* Sobel, I., Feldman,G., A 3x3 Isotropic Gradient Operator for Image Processing, presented at a talk at the Stanford Artificial Project in 1968, unpublished but often cited, orig. in Pattern Classification and Scene Analysis, Duda,R. and Hart,P., John Wiley and Sons,'73, pp271-2.
-Illingworth, A.J., R.J. Hogan, et al. 2007. Bull. Amer. Meteor. Soc., 88, 6, 883-898.
+* Solomon, S.; Qin, D.; Manning, M.; Chen, Z.; Marquis, M.; Averyt, K.B.; Tignor, M.; and Miller, H.L., ed., IPCC AR4 WG1: Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 978-0-521-88009-1 (pb: 978-0-521-70596-7).
-Kovalev V., V. Eichinger, Elastic Lidar. Theory, Practice, and Analysis Methods, Wiley Interscience Publ., New York, USA, 2004.
+* Steyn, D.G., M. Baldi, and R.M. Hoff, 1999: The Detection of Mixed Layer Depth and Entrainment Zone Thickness from Lidar Backscatter Profiles. J. Atmos. Oceanic Technol., 16, 953–959.
-Lhermitte, R.M. and D. Atlas, 1961: Precipitation Motion by Pulse Doppler Radar in Measurements of Particle Fall Velocities, Proceedings of the 9th Weather Radar Conference, Boston, American Meteorological Society, 218-233.
+* Stull R (1988) An introduction to boundary layer meteorology. Kluwer Acad Publ, Dordrecht, p 666
-Lhermitte, R.M., 1962: Note on Wind Variability with Doppler Radar, J. Atmos. Sci., 19, 343-346.
+* Teschke, G.; Görsdorf, U.; Körner, P. & Trede, D. (2006), A new approach for target classification of Ka-band radar data, in 'Fourth European Conference on Radar in Meteorology and Hydrology (ERAD), Barcelona', pp. 18--22.
-Liljegren, J.C., E. E. Clothiaux, G. G. Mace, S. Kato, and X. Dong, 2001. J. Geophys. Res., 106,
+* Teschke G., J. Reichardt, D. Engelbart,Wavelet algorithm for the estimation of mixing layer heights. Proc. ILRC Delft, 2008.
-Löhnert, U. , S. Crewell, C. Simmer, 2004. Journal of Applied Meteorology, 43, No. 9, 1295-1307
+* Theopold, F.A., and J. Bosenberg, Evaluation of DIAL measurements in presence of signal noise, Proc. 14th International Laser Radar Conf., San Candido, Italy, 209-211, 1988.
-Löhnert,U. and S.Crewell, 2003: Accuracy of cloud liquid water path from groud-based microwave radiometry. Part I. Dependency on cloud model statistics. Radio Sci. 38, 8041, doi:10.1029/202RS002654.
+* Turner, D.D., 2007: Improved ground-based liquid water path retrievals using a combined infrared and microwave approach, J. Geophys. Res., 112, D15204, doi:10.1029/2007JD008530.
-Measures R. M., Laser Remote Sensing. Fundamentals and Applications, Krieger Publishing Company, Malabar, Florida, 1992.
+* Turner D. D., M. P. Cadeddu, U. Löhnert, S. Crewell, and A. M. Vogelmann (2009), Modifications to the Water Vapor Continuum in the Microwave Suggested by Ground-Based 150-GHz Observations, IEEE Trans. Geosci. Rem. Sens., vol. 47, no. 10, .pp. 3326-3337.
-Martucci, G., J. Ovadnevaite, D. Ceburnis, H. Berresheim, S. Varghese, D. Martin, R. Flanagan, C.D. O’Dowd, 2012. Atmospheric Environment, 48C, 205-218.
+* Turner, D.D., Vogelmann, A.M., Austin, R., Barnard, J.C., Cady-Pereira, K., Chiu, C., Clough, S.A., Flynn, C.J., Khaiyer, M.M., Liljegren, J.C., Johnson, K., Lin, B., Long, C.N., Marshak, A.,Matrosov, S.Y.,McFarlane, S.A., Miller,M.A., Min, Q., Minnis, P., O'Hirok, W., Wang, Z., Wiscombe, W. , 2007. Bull. Amer. Meteor. Soc., 88, 177–190.
-Martucci, G. and O'Dowd, C. D., 2011. Atmos. Meas. Tech., 4, 2749-2765, doi:10.5194/amt-4-2749-2011.
+* Twomey, S.A.,1977. J. Atmos.Sci., 34, 1149-1152.
-Mattis I., et al., 2002: Geophys.Res. Let. 29, 1306.
+* Ulaby, F.T., R.K. Moore & A.K. Fung (1981): Microwave remote sensing, active and passive, Vol. 1. Artech House, Norwood, MA.
-Müller D., Wandinger U., Ansmann A., 1999: Appl Optics, 38, 2346.
+* Unden, P., and Coauthors, 2002: Hirlam-5 scientific documentation, SMHI Hirlam-5 Project Tech. Rep., 146.
-Nan, L., W. Ming, T. Xiaowen, and P. Yujie, 2007: An Improved Velocity Volume Processing Method, Adv. Atmos. Sci., 24, 893-906.
+* [http://www.opticsinfobase.org/ao/abstract.cfm?id=40524  Vaughan G., D. P. Wareing, S. J. Pepler, L. Thomas, and V. Mitev, Atmospheric temperature measurements made by rotational Raman scattering, Applied Optics, Vol. 32, Issue 15, pp. 2758-2764 (1993)]
-Nicolae D., C. Talianu, T. Trickl, B. Tatarov, H. Nakane, N. Sugimoto, I. Serikov, V. Rizi, M. Iarlori, J. Pelon, P. Flamant, J. Spinhirne, Recent Advances in Atmospheric lidars, INOE Publishing House, 2010
+* Venable, D.D., D.N. Whiteman, M.N. Calhoun, A.O. Dirisu, R.M. Connell, and E. Landulfo, 2011: Lamp mapping technique for independent determination of the water vapor mixing ratio calibration factor for a Raman lidar system. Appl. Optics, 50, 4622–4632, doi: 10.1364/AO.50.004622.
-Nicolae D., Belegante L., Nemuc A., 2010: Optoelectron. Adv. Mat.-RC, 4, 12.
+* Waldteufel, P., and H. Corbin, 1979: On the analysis of single Doppler radar data, J. Appl. Meteor., 18, 532–542.
-Ovadnevaite, J., D. Ceburnis, G. Martucci, J. Bialek, C. Monahan, M. Rinaldi, M. C. Facchini, H. Berresheim, D. R. Worsnop, and C. O'Dowd, 2011.
+* Wandinger, U., Multiple-Scattering Influence on Extinction-and Backscatter-Coefficient Measurements with Raman and High-Spectral-Resolution Lidars, Appl. Opt., 37 (3), 417-427, 1998.
-Geophys. Res. Lett., 38, L21806, doi:10.1029/2011GL048869
-Solomon, S.; Qin, D.; Manning, M.; Chen, Z.; Marquis, M.; Averyt, K.B.; Tignor, M.; and Miller, H.L., ed., IPCC AR4 WG1: Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, ISBN 978-0-521-88009-1 (pb: 978-0-521-70596-7).
+* Wandinger, U., and Ansmann, A., Experimental determination of the lidar overlap profile with Raman lidar, Appl. Opt., 41 (3), 511–514, 2002.
-Rainbow® 5 Instruction Manual, Release 5.31.0: Products and Algorithms, Selex Systems Integration GmbH, Document Code: GEMA-SD-0150-5310-2.
+* Wauben Wiel M.F., de Haij Marijn and Baltink Henk Klein, Towards a cloud ceilometer network reporting mixing layer height, TECO-2008 - WMO Technical Conference on Meteorological and Environmental Instruments and Methods of Observation St. Petersburg, Russian Federation, 27-29 November 2008.
-Ramanathan, V.,  Cess, R. D., Harrison, E. F., Minnis, P.,  Barkstrom, B. R., Ahmad, E., and D. Hartmann, 1989. Science, 243 (4887), 57-63 [doi: 10.1126/science.243.4887.57]
+* Westwater, E.R., 1978: The accuracy of water vapor and cloud liquid determination by dual-frequency ground-based microwave radiometry. Radio Sci 13, 667-685.
-Turner, D.D., 2007: Improved ground-based liquid water path retrievals using a combined infrared and microwave approach, J. Geophys. Res., 112, D15204, doi:10.1029/2007JD008530.
+* Westwater E.R., S. Crewell, C. Mätzler: A Review of Surface-Based Microwave and Millimeter Wave Radiometric Remote Sensing of the Troposphere URSI Radio Science Bulletin, No. 310, 59-80, 2004
-Turner, D.D., Vogelmann, A.M., Austin, R., Barnard, J.C., Cady-Pereira, K., Chiu, C., Clough, S.A., Flynn, C.J., Khaiyer, M.M., Liljegren, J.C., Johnson, K., Lin, B., Long, C.N., Marshak, A.,Matrosov, S.Y.,McFarlane, S.A., Miller,M.A., Min, Q., Minnis, P., O'Hirok, W., Wang, Z., Wiscombe, W. , 2007. Bull. Amer. Meteor. Soc., 88, 177–190.
+* Westwater E. R., S. Crewell, C. Mätzler, D. Cimini: Principles of surface-based microwave and millimeter wave radiometric remote sensing of the troposphere Quaderni della Società Italiana di Elettromagnetismo Vol.: 1, No.3, 50-90, 2005
-Twomey, S.A.,1977. J. Atmos.Sci., 34, 1149-1152.
+* Whiteman, D. N., 2000: Investigation of Cloud Properties using a Raman Lidar, Ph.D. dissertation, University of Maryland, Baltimore County.
-Unden, P., and Coauthors, 2002: Hirlam-5 scientific documentation, SMHI Hirlam-5 Project Tech. Rep., 146.
+* Whiteman D. N., Examination of the traditional Raman lidar technique. I. Evaluating the temperature-dependent lidar equations, Applied Optics, Vol. 42, Issue 15, pp. 2571-2592 (2003) [http://ramanlidar.gsfc.nasa.gov/activities/publications/data/tempsens1.pdf  pdf]
-Waldteufel, P., and H. Corbin, 1979: On the analysis of single Doppler radar data, J. Appl. Meteor., 18, 532–542.
+* Whiteman D. N., Examination of the Traditional Raman Lidar Technique. II. Evaluating the Ratios for Water Vapor and Aerosols, Applied Optics, Vol. 42, Issue 15, pp. 2593-2608 (2003) [http://ramanlidar.gsfc.nasa.gov/activities/publications/data/tempsens2.pdf  pdf]
-Westwater, E.R., 1978: The accuracy of water vapor and cloud liquid determination by dual-frequency ground-based microwave radiometry. Radio Sci 13, 667-685.
+* Wilczak J. M., E. E. Gossard, W. D. Neff, W. L. Eberhard, 1996: Ground-based remote sensing of the atmospheric boundary layer: 25 years of progress, Boundary-Layer Meteorology; 78(3):321-349. DOI:10.1007/BF00120940 pp.321-349
-Wolfram Mathworld, http://mathworld.wolfram.com/ConditionNumber.html
+* [http://mathworld.wolfram.com/ConditionNumber.html Wolfram Mathworld, Condition Number]
-Zhao C, SA Klein, S Xie, X Liu, JS Boyle, and Y Zhang. 2012. Geophysical Research Letters, 39, L08806, doi:10.1029/2012GL051213
+* Zhao C, SA Klein, S Xie, X Liu, JS Boyle, and Y Zhang. 2012. Geophysical Research Letters, 39, L08806, doi:10.1029/2012GL051213