This chapter reviews the state-of-the-art of land surface rainfall estimation using measurements from weather radars, personal weather stations, and commercial microwave links, including comparisons to rain gauge measurements. These studies are related to recently emerging field of opportunistic weather sensing using the existing communications infrastructure.@en

Spaceborne microwave radiometers represent an important component of the Global Precipitation Measurement (GPM) mission due to their frequent sampling of rain systems. Microwave radiometers measure microwave radiation (brightness temperatures Tb), which can be converted into precipitation estimates with appropriate assumptions. However, detecting shallow precipitation systems using spaceborne radiometers is challenging, especially over land, as their weak signals are hard to differentiate from those associated with dry conditions. This study uses a random forest (RF) model to classify microwave radiometer observations as dry, shallow, or nonshallow over the Netherlands}a regionwith varying surface conditions and frequent occurrence of shallow precipitation. The RF model is trained on five years of data (2016–20) and tested with two independent years (2015 and 2021). The observations are classified using ground-based weather radar echo top heights. Various RF models are assessed, such as using only GPM Microwave Imager (GMI) Tb values as input features or including spatially aligned ERA5 2-m temperature and freezing level reanalysis and/or Dual-Frequency Precipitation Radar (DPR) observations. Independent of the input features, the model performs best in summer and worst in winter. The model classifies observations from high-frequency channels ($85 GHz) with lower Tb values as nonshallow, higher values as dry, and those in between as shallow. Misclassified footprints exhibit radiometric characteristics corresponding to their assigned class. Case studies reveal dry observations misclassified as shallow are associated with lower Tb values, likely resulting from the presence of ice particles in nonprecipitating clouds. Shallow footprints misclassified as dry are likely related to the absence of ice particles. SIGNIFICANCE STATEMENT: Published research concerning rainfall retrieval algorithms from microwave radiometers is often focused on the accuracy of these algorithms. While shallow precipitation over land is often characterized as problematic in these studies, little progress has been made with these systems. In particular, precipitation formed by shallow clouds, where shallow refers to the clouds being close to Earth’s surface, is often missed. This study is focused on detecting shallow precipitation and its physical characteristics to further improve its detection from spaceborne sensors. As such, it contributes to understanding which shallow precipitation scenes are challenging to detect from microwave radiometers, suggesting possible ways for algorithm improvement.

@en

The Goddard Profiling algorithm (GPROF) converts radiometer observations from Global Precipitation Measurement (GPM) constellation satellites into precipitation estimates. Typically, high-quality ground-based estimates serve as reference to evaluate GPROF's performance. To provide a fair comparison, the ground-based estimates are often spatially aligned to GPROF. However, GPROF combines observations from various sensors and channels, each associated with a distinct footprint. Consequently, uncertainties related to the representativeness of the sampled areas are introduced in addition to the uncertainty when converting brightness temperatures into precipitation intensities. The exact contribution of resampling precipitation estimates, required to spatially and temporally align different resolutions when combining or comparing precipitation observations, to the overall uncertainty remains unknown. Here, we analyze the current performance of GPROF over the Netherlands during a 4-year period (2017-2020) while investigating the uncertainty related to sampling. The latter is done by simulating the reference precipitation as satellite footprints that vary in size, geometry, and applied weighting technique. Only GPROF estimates based on observations from the conical-scanning radiometers of the GPM constellation are used. The reference estimates are gauge-adjusted radar precipitation estimates from two ground-based weather radars from the Royal Netherlands Meteorological Institute (KNMI). Echo top heights (ETHs) retrieved from the same radars are used to classify the precipitation as shallow, medium, or deep. Spatial averaging methods (Gaussian weighting vs. arithmetic mean) minimally affect the magnitude of the precipitation estimates. Footprint size has a higher impact but cannot explain all discrepancies between the ground- and satellite-based estimates. Additionally, the discrepancies between GPROF and the reference are largest for low ETHs, while the relative bias between the different footprint sizes and implemented weighting methods increase with increasing ETHs. Lastly, our results do not show a clear difference between coastal and land simulations. We conclude that the uncertainty introduced by merging different channels and sensors cannot fully explain the discrepancies between satellite- and ground-based precipitation estimates. Hence, uncertainties related to the retrieval algorithm and environmental conditions are found to be more prominent than resampling uncertainties, in particular for shallow and light precipitation.

@en

Accurate precipitation observations are crucial for hydrological forecasts, notably over rapidly responding urban areas. This study evaluated the accuracy of three gridded spaceborne rainfall products (Integrated Multi-satellitE Retrievals for GPM (IMERG), Meteosat Second Generation Visible (MSG-VIS), and MSG-Infrared (MSG-IR)) and the non-governmental Trans-African Hydro-Meteorological Observatory (TAHMO) gauges across the Odaw catchment (Accra, Ghana) from January 2020-July 2022. IMERG is hardly able to capture the strong spatial variability of rainfall required for flood forecasting, but agrees in annual sums with TAHMO and MSG-IR. MSG-IR has difficulties during the wet season. MSG-VIS, only available during daylight, shows limited accuracy and gives high estimates while other products do not detect rain. TAHMO gauges effectively record high-intensity events and their strong spatial variability, although some (daily) accumulations are doubtful and data gaps exist due to technical issues. These findings assist hydrological modelers in selecting appropriate datasets at suitable spatiotemporal resolutions for their research.

@en

During the last decade, rainfall monitoring using signal-level data from commercial microwave links (CMLs) in cellular communication networks has been proposed as a complementary way to estimate rainfall for large areas. Path-Averaged rainfall is retrieved between the transmitting and receiving cellular antennas of a CML. One rainfall estimation algorithm for CMLs is RAINLINK, which has been employed in different regions (e.g., Brazil, Italy, the Netherlands, and Pakistan) with satisfactory results. However, the RAINLINK parameters have been calibrated for a unique optimum solution, which is inconsistent with the fact that multiple similar or equivalent solutions may exist due to uncertainties in algorithm structure, input data, and parameters. Here, we show how CML rainfall estimates can be improved by calibrating all parameters of the algorithm systematically and simultaneously with the stochastic particle swarm optimization method, which is used for the numerical maximization of the objective function. An open dataset of approximately 2800 sub-links of minimum and maximum received signal levels over 15gmin intervals covering the Netherlands (g1/4g35g500gkm2) is employed: 12gd are used for calibration and 3 months for validation. A gauge-Adjusted radar rainfall dataset is utilized as a reference. Verification of path-Average daily rainfall shows a reasonable improvement for the stochastically calibrated parameters with respect to RAINLINK's default parameter settings. Results further improve when averaged over the Netherlands. Moreover, the method provides a better underpinning of the chosen parameter values and is therefore of general interest for calibration of RAINLINK's parameters for other climates and cellular communication networks.

@en

Observations retrieved from radiometers aboard several satellites are combined in the Global Precipitation Measurement mission (GPM) to provide a global precipitation dataset. Radiometers are able to sense the radiance naturally emitted by the Earth's surface or emitted/scattered by hydrometeors. These observations, also known as brightness temperatures, are converted into precipitation estimates by the GPM Profiling Algorithm (GPROF). Although this algorithm is already in use for several decades and the conversion of brightness temperatures to precipitation estimates in general has been studied extensively, persistent challenges remain. Two of these challenges are: 1. the retrieval of precipitation formed close to the Earth’s surface, also referred to as shallow precipitation, and 2. low-intensity precipitation. Increased understanding of the physics behind these precipitation types will help to improve the accuracy of the conversion of brightness temperatures to precipitation. This study couples observations from radiometers to both ground-based precipitation observations and reflectivity profiles from ground-based weather radars over the Netherlands. The Netherlands is an ideal study area for this purpose as both precipitation types (shallow and low-intensity) occur regularly over the Netherlands (~52°N) and high-quality (gauge-adjusted) radar data is available. We use brightness temperatures from conical scanning radiometers belonging to the GPM in this study. Firstly, we investigate the relationship between brightness temperatures from different channels (frequency-dependent) and precipitation intensities. Within this analysis we try to take the effect of different footprint sizes of the different channels (related to the differences in the employed radio frequencies) into account, in order to limit the dependence of the retrieved relations on the footprint size. Secondly, we couple the observations of the radiometers with ground-based radar reflectivity profiles to gain insight in the vertical structure of the precipitation types and how these affect brightness temperatures.@en

The presence of significant biases in real-time radar quantitative precipitation estimations (QPEs) limits its use in hydrometeorological forecasting systems. Here, we introduce CARROTS (Climatology-based Adjustments for Radar Rainfall in an OperaTional Setting), a set of fixed bias reduction factors, which vary per grid cell and day of the year. The factors are based on a historical set of 10 years of 5ĝ€¯min radar and reference rainfall data for the Netherlands. CARROTS is both operationally available and independent of real-time rain gauge availability and can thereby provide an alternative to current QPE adjustment practice. In addition, it can be used as benchmark for QPE algorithm development. We tested this method on the resulting rainfall estimates and discharge simulations for 12 Dutch catchments and polders. We validated the results against the operational mean field bias (MFB)-adjusted rainfall estimates and a reference dataset. This reference consists of the radar QPE, that combines an hourly MFB adjustment and a daily spatial adjustment using observations from 32 automatic and 319 manual rain gauges. Only the automatic gauges of this network are available in real time for the MFB adjustment. The resulting climatological correction factors show clear spatial and temporal patterns. Factors are higher away from the radars and higher from December through March than in other seasons, which is likely a result of sampling above the melting layer during the winter months. The MFB-adjusted QPE outperforms the CARROTS-corrected QPE when the country-average rainfall estimates are compared to the reference. However, annual rainfall sums from CARROTS are comparable to the reference and outperform the MFB-adjusted rainfall estimates for catchments away from the radars, where the MFB-adjusted QPE generally underestimates the rainfall amounts. This difference is absent for catchments closer to the radars. QPE underestimations are amplified when used in the hydrological model simulations. Discharge simulations using the QPE from CARROTS outperform those with the MFB-adjusted product for all but one basin. Moreover, the proposed factor derivation method is robust. It is hardly sensitive to leaving individual years out of the historical set and to the moving window length, given window sizes of more than a week.

@en

The Royal Netherlands Meteorological Institute (KNMI) operates two operational dual-polarization C-band weather radars providing 2D radar rainfall products. Attenuation can result in severe underestimation of rainfall amounts, particularly in convective situations that are known to have high impact on society. To improve the radar-based precipitation estimates, two attenuation correction methods are evaluated and compared: 1) modified Kraemer (MK) method, i.e., Hitschfeld–Bordan where parameters of the power-law Z_h–k_h relation are adjusted such that reflectivities in the entire dataset do not exceed 59 dBZ_h and attenuation correction is limited to 10 dB; and 2) using two-way path-inte-grated attenuation computed from the dual-polarization moment specific differential phase K_dp (Kdp method). In both cases the open-source Python library wradlib is employed for the actual attenuation correction. A radar voxel only con-tributes to the computed path-integrated attenuation if its height is below the forecasted freezing-level height from the numerical weather prediction model HARMONIE-AROME. The methods are effective in improving hourly and daily quantitative precipitation estimation (QPE), where the Kdp method performs best. The verification against rain gauge data shows that the underestimation diminishes from 55% to 37% for hourly rainfall for the Kdp method when the gauge indicates more than 10 mm of rain in that hour. The improvement for the MK method is less pronounced, with a resulting underestimation of 40%. The stability of the MK method holds a promise for application to data archives from single-polarization radars.

@en

Applications like drought monitoring and forecasting can profit from the global and near-real-time availability of satellite-based precipitation estimates once their related uncertainties and challenges are identified and treated. To this end, this study evaluates the IMERG V06B Late Run precipitation product from the Global Precipitation Measurement mission (GPM), a multisatellite product that combines space-based radar, passive microwave (PMW), and infrared (IR) data into gridded precipitation estimates. The evaluation is performed on the spatiotemporal resolution of IMERG (0.1° × 0.1°, 30 min) over the Netherlands over a 5-yr period. A gauge-adjusted radar precipitation product from the Royal NetherlandsMeteorological Institute (KNMI) is used as reference, against which IMERG shows a large positive bias. To find the origin of this systematic overestimation, the data are divided into seasons, rainfall intensity ranges, echo top height (ETH) ranges, and categories based on the relative contributions of IR, morphing, and PMW data to the IMERG estimates. Furthermore, the specific radiometer is identified for each PMW-based estimate. IMERG’s detection performance improves with higher ETH and rainfall intensity, but the associated error and relative bias increase as well. Severe overestimation occurs during low-intensity rainfall events and is especially linked to PMW observations. All individual PMW instruments show the same pattern: overestimation of low-intensity events and underestimation of high-intensity events. IMERG misses a large fraction of shallow rainfall events, which is amplified when IR data are included. Space-based retrieval of shallow and low-intensity precipitation events should improve before IMERG can become accurate over the middle and high latitudes.@en

e investigate the spatiotemporal structure of rainfall at spatial scales from 7 m to over 200 km in the Netherlands. We used data from two networks of laser disdrometers with complementary interstation distances in two Dutch cities (comprising five and six disdrometers, respectively) and a Dutch nationwide network of 31 automatic rain gauges. The smallest aggregation interval for which raindrop size distributions were collected by the disdrometers was 30 s, while the automatic rain gauges provided 10-min rainfall sums. This study aims to supplement other micro-γ investigations (usually performed in the context of spatial rainfall variability within a weather radar pixel) with new data, while characterizing the correlation structure across an extended range of scales. To quantify the spatiotemporal variability, we employ a two-parameter exponential model fitted to the spatial correlograms and characterize the parameters of the model as a function of the temporal aggregation interval. This widely used method allows for a meaningful comparison with seven other studies across contrasting climatic settings all around the world. We also separately analyzed the intermittency of the rainfall observations. We show that a single parameterization, consisting of a two-parameter exponential spatial model as a function of interstation distance combined with a power-law model for decorrelation distance as a function of aggregation interval, can coherently describe rainfall variability (both spatial correlation and intermittency) across a wide range of scales. Limiting the range of scales to those typically found in micro-γ variability studies (including four of the seven studies to which we compare our results) skews the parameterization and reduces its applicability to larger scales.@en

Commercial microwave links (CMLs) from cellular telecommunication networks can provide a valuable 'opportunistic' source of high-resolution space-time rainfall information, complementing traditional in-situ measurement devices (rain gauges, disdrometers) and remote sensors (weather radars, satellites). Their greatest potential lies in areas with low gauge densities and lack of weather radars, often in developing countries with a subtropical or tropical climate and generally large spatial rainfall variability. Here, the open-source R package RAINLINK is employed to retrieve CML rainfall maps covering the majority of Sri Lanka for a 3.5 month period based on CML data from on average 1140 link paths. These are compared locally to hourly and daily rain gauge data, as well as to rainfall maps from the dual-frequency precipitation radar on board the global precipitation measurement core observatory satellite. The potential of CMLs for real-time tropical rainfall monitoring is demonstrated.

@en

We present a novel method of using two or three collocated microwave link instruments to estimate the three parameters of a gamma raindrop size distribution (DSD) model. This allows path-average DSD measurements over a path length of several kilometers as opposed to the point measurements of conventional disdrometers. Our method is validated in a round-trip manner using simulated DSD fields as well as five laser disdrometers installed along a path. Different potential link combinations of frequency and polarization are investigated. We also present preliminary results from the application of this method to an experimental setup of collocated microwave links measuring at 26 and 38 GHz along a 2.2 km path. Simulations show that a DSD retrieval on the basis of microwave links can be accurate under idealized conditions. We found that a triple-link retrieval provides little added benefit over a dual-link retrieval in terms of accuracy or precision. In practice, the accuracy and success rate of any retrieval is highly dependent on the stability of the base power level as well as the precision of the instruments and in particular the quantization applied to the recorded power level.

@en

The Royal Netherlands Meteorological Institute (KNMI) operates two dual-polarization C-band weather radars in simultaneous transmission and reception (STAR; i.e., horizontally and vertically polarized pulses are transmitted simultaneously) mode, providing 2D radar rainfall products. Despite the application of Doppler and speckle filtering, remaining nonmeteorological echoes (especially sea clutter) mainly due to anomalous propagation still pose a problem. This calls for additional filtering algorithms, which can be realized by means of polarimetry. Here we explore the effectiveness of the open-source wradlib fuzzy echo classification and clutter identification based on polarimetric moments. Based on our study, this has recently been extended with the depolarization ratio and clutter phase alignment as new decision variables. Optimal values for weights of the different membership functions and threshold are determined employing a 4-h calibration dataset from one radar. The method is applied to a full year of volumetric data from the two radars in the Dutch temperate climate. The verification focuses on the presence of remaining nonmeteorological echoes by mapping the number of exceedances of radar reflectivity factors for given thresholds. Moreover, accumulated rainfall maps are obtained to detect unrealistically large rainfall depths. The results are compared to those for which no further filtering has been applied. Verification against rain gauge data reveals that only a little precipitation is removed. Because the fuzzy logic algorithm removes many nonmeteorological echoes, the practice to composite data from both radars in logarithmic space to hide these echoes is abandoned and replaced by linearly averaging reflectivities.

@en

Several opportunistic sensors (private weather stations, commercial microwave links and smartphones) are employed to obtain weather information and successfully monitor urban weather events. The ongoing urbanisation and climate change urges further understanding and monitoring of weather in cities. Two case studies during a 17-day period over the Amsterdam metropolitan area, the Netherlands, are used to illustrate the potential and limitations of hydrometeorological monitoring using non-traditional and opportunistic sensors. We employ three types of opportunistic sensing networks to monitor six important environmental variables: (1) air temperature estimates from smartphone batteries and personal weather stations; (2) rainfall from commercial microwave links and personal weather stations; (3) solar radiation from smartphones; (4) wind speed from personal weather stations; (5) air pressure from smartphones and personal weather stations; (6) humidity from personal weather stations. These observations are compared to dedicated, traditional observations where possible, although such networks are typically sparse in urban areas. First we show that the passage of a front can be successfully monitored using data from several types of non-traditional sensors in a complementary fashion. Also we demonstrate the added value of opportunistic measurements in quantifying the Urban Heat Island (UHI) effect during a hot episode. The UHI can be clearly determined from personal weather stations, though UHI values tend to be high compared to records from a traditional network. Overall, this study illustrates the enormous potential for hydrometeorological monitoring in urban areas using non-traditional and opportunistic sensing networks.@en

Automatic personal weather stations owned and maintained by weather enthusiasts provide spatially dense in situ measurements that are often collected and visualized in real time on online weather platforms. While the spatial and temporal resolution of this data source is high, its rainfall observations are prone to typical errors, currently preventing its large-scale, real-time application. This study proposes a quality control methodology consisting of four modules targeting these errors, applicable in real time without requiring auxiliary measurements. The quality control improves the overall accuracy of a year of hourly rainfall depths in Amsterdam to a bias of −11.3% (0.2% when a proxy for overall rainfall underestimation by personal weather stations is used), a Pearson correlation coefficient of 0.82, and a coefficient of variation of 2.70, while maintaining 88% of the original data set. Application on a national scale (average 1 station per ∼10 km²) yields high-resolution nationwide rainfall maps, hence showing the great potential of personal weather stations for complementing existing often sparse traditional rain gauge networks.

@en

Microwave links from commercial cellular communication networks have been used for rainfall monitoring in The Netherlands since 2003. Here we report on the start of our work on this topic using a dedicated microwave link in 1999, our first trails with commercial microwave links (CMLs) from Vodafone in 2003, our first published results in 2007, our work on sources of error and uncertainties in rainfall retrievals using microwave links of different lengths and frequencies, and finally the fruitful collaboration with T-Mobile NL, which lead to areal rainfall estimation for the Rotterdam metropolitan area in 2009 and 2010 and country-wide rainfall mapping for the entire land surface area of The Netherlands since 2012. Our current work on this topic follows three lines of research: (1) further refinement of our rainfall retrieval and mapping algorithm; (2) further quantification of sources of error and uncertainties using a dedicated experimental setup of multiple microwave links and a line configuration of disdrometers for ground validation; (3) promotion of the international replication of this method for rainfall monitoring through collaboration with partners in Europe and beyond.

@en

In the last decade there has been a growing interest from the hydrometeorological community regarding rainfall estimation from commercial microwave link (CML) networks. Path-averaged rainfall intensities can be retrieved from the signal attenuation between cell phone towers. Although this technique is still in development, it offers great opportunities for the retrieval of rainfall rates at high spatiotemporal resolutions very close to the Earth's surface. Rainfall measurements at high spatiotemporal resolutions are highly valued in urban hydrology, for instance, given the large impact that flash floods exert on society. Flash floods are triggered by intense rainfall events that develop over short time scales. Here, we present one of the first evaluations of this measurement technique for a humid subtropical climate. Rainfall estimation for subtropical climates is highly relevant, as many countries with few surface rainfall observations are located in such areas. The test bed of the current study is the Brazilian city of São Paulo. The open-source algorithm RAINLINK was applied to retrieve rainfall intensities from (power) attenuation measurements. The performance of RAINLINK estimates was evaluated for 145 of the 213 CMLs in the São Paulo metropolitan area for which we received data, for 81 days between October 2014 and January 2015. We evaluated the retrieved rainfall intensities and accumulations from CMLs against those from a dense automatic gauge network. Results were found to be promising and encouraging when it comes to capturing the city-average rainfall dynamics. Mixed results were obtained for individual CML estimates, which may be related to erroneous metadata.

@en

Microwave backhaul links from cellular communication networks provide a valuable “opportunistic” source of high-resolution space–time rainfall information, comple-menting traditional in situ measurement devices (rain gauges, disdrometers) and remote sensors (weather radars, satellites). Over the past decade, a growing community of researchers has, in close collaboration with cellular communication compa-nies, developed retrieval algorithms to convert the raw microwave link signals, stored operationally by their network management systems, to hydrometeorologically useful rainfall estimates. Operational meteorological and hydrological services as well as private consulting firms are showing an increased interest in using this complemen-tary source of rainfall information to improve the products and services they provide to end users from different sectors, from water management and weather prediction to agriculture and traffic control. The greatest potential of these opportunistic environmental sensors lies in those geographical areas over the land surface of the Earth where the densities of traditional rainfall measurement devices are low: mountainous and urban areas and the developing world. This article provides a nonexpert summary of the history, theory, challenges, and opportunities toward continental-scale rainfall monitoring using microwave links from cellular communication networks. This article is categorized under: Science of Water > Methods Science of Water > Hydrological Processes.

@en

We present a measurement campaign to address several error sources associated with rainfall estimates from microwave links in cellular communication networks. The core of the experiment is provided by three co-located microwave links installed between two major buildings on opposite sides of the small town of Wageningen, approximately 2 km apart: a 38 GHz formerly commercial microwave link, as well as 26 and 38 GHz (dual-polarization) research microwave links. Transmitting and receiving antennas have been attached to masts installed on the roofs of the two buildings, about 30 m above the ground. This setup was complemented with an infrared large-aperture scintillometer, installed over the same path, as well as five laser disdrometers positioned at several locations along the path and an automated rain gauge. Temporal sampling of the received signals was performed at a rate of 20 Hz. The setup was monitored by time-lapse cameras to assess the state of the antennas as well as the atmosphere. The experiment was active between August 2014 and December 2015. Data from an existing automated weather station situated just outside Wageningen was further used to compare and to interpret the findings. In addition to presenting the experiment, we also conduct a preliminary global analysis and show several cases highlighting the different phenomena affecting received signal levels: rainfall, solid precipitation, temperature, fog, antenna wetting due to rain or dew, and clutter. We also briefly explore cases where several phenomena play a role. A rainfall intensity (R) - specific attenuation (k) relationship was derived from the disdrometer data. We find that a basic rainfall retrieval algorithm without corrections already provides a reasonable correlation to rainfall as measured by the disdrometers. However, there are strong systematic overestimations (factors of 1.2-2.1) which cannot be attributed to the R-k relationship. We observe attenuations in the order of 3 dB due to antenna wetting under fog or dew conditions. We also observe fluctuations of a similar magnitude related to changes in temperature. The response of different makes of microwave antennas to many of these phenomena is significantly different even under the exact same operating conditions and configurations.

@en