A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations
The present paper describes the quality-control component of an automatic procedure (APACH: A Procedure for Automated Quality Control and Homogenization of Weather Station Data) developed to control quality and homogenize the historical daily temperature and precipitation data from meteorological st...
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | JOUR |
| Materias: | |
| Acceso en línea: | http://hdl.handle.net/20.500.12110/paper_01650009_v98_n3_p471_Boulanger |
| Aporte de: |
| id |
todo:paper_01650009_v98_n3_p471_Boulanger |
|---|---|
| record_format |
dspace |
| spelling |
todo:paper_01650009_v98_n3_p471_Boulanger2023-10-03T15:02:27Z A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations Boulanger, J.-P. Aizpuru, J. Leggieri, L. Marino, M. Agricultural impacts Argentina Automatic procedures Control components Control methods Control quality Daily temperatures Decision-tree algorithm Extreme precipitation Maximum temperature Meteorological station National Weather Services Non-parametric Precipitation data Real time quality control Weather services Weather stations Customer satisfaction Error detection Quality assurance Total quality management Weather information services Quality control algorithm database diurnal variation meteorology precipitation (climatology) quality control temperature profile weather station Argentina The present paper describes the quality-control component of an automatic procedure (APACH: A Procedure for Automated Quality Control and Homogenization of Weather Station Data) developed to control quality and homogenize the historical daily temperature and precipitation data from meteorological stations. The quality-control method is based on a set of decision-tree algorithms analyzing separately precipitation and minimum and maximum temperature. All our tests are non-parametric and therefore are potentially useful in regions or countries presenting different climates as those observed in Argentina. The method is applied to the 1959-2005 historical daily database of the Argentine National Weather Service. Our results are coherent with the history of the Weather Service and more specifically with the history of implementation of systematized quality control processes. In temperature, our method detects a larger number of suspect values before 1967 (when there was no quality control) and after 1997 (when only real-time quality control had been applied). In precipitation, the detection of error in extreme precipitations is complex, but our method clearly detected a strong decrease in the number of potential outliers after 1976 when the National Weather Service was militarized, and the network was strongly reduced, focusing more on airport weather stations. Also in precipitation, we analyze in detail the long dry sequences and are able to identify potential long erroneous sequences. This is important for the use of the data for hydrological or agricultural impact studies. Finally, all the data are flagged with codes representing the path followed by the record in our decision-tree algorithms. While each code is associated to one of the categories ("Useful", "Need-Check", "Doubtful" or "Suspect"), the final user is free to redefine such category-assignment. © Springer Science + Business Media B.V. 2009. Fil:Leggieri, L. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales; Argentina. Fil:Marino, M. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales; Argentina. JOUR info:eu-repo/semantics/openAccess http://creativecommons.org/licenses/by/2.5/ar http://hdl.handle.net/20.500.12110/paper_01650009_v98_n3_p471_Boulanger |
| institution |
Universidad de Buenos Aires |
| institution_str |
I-28 |
| repository_str |
R-134 |
| collection |
Biblioteca Digital - Facultad de Ciencias Exactas y Naturales (UBA) |
| topic |
Agricultural impacts Argentina Automatic procedures Control components Control methods Control quality Daily temperatures Decision-tree algorithm Extreme precipitation Maximum temperature Meteorological station National Weather Services Non-parametric Precipitation data Real time quality control Weather services Weather stations Customer satisfaction Error detection Quality assurance Total quality management Weather information services Quality control algorithm database diurnal variation meteorology precipitation (climatology) quality control temperature profile weather station Argentina |
| spellingShingle |
Agricultural impacts Argentina Automatic procedures Control components Control methods Control quality Daily temperatures Decision-tree algorithm Extreme precipitation Maximum temperature Meteorological station National Weather Services Non-parametric Precipitation data Real time quality control Weather services Weather stations Customer satisfaction Error detection Quality assurance Total quality management Weather information services Quality control algorithm database diurnal variation meteorology precipitation (climatology) quality control temperature profile weather station Argentina Boulanger, J.-P. Aizpuru, J. Leggieri, L. Marino, M. A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations |
| topic_facet |
Agricultural impacts Argentina Automatic procedures Control components Control methods Control quality Daily temperatures Decision-tree algorithm Extreme precipitation Maximum temperature Meteorological station National Weather Services Non-parametric Precipitation data Real time quality control Weather services Weather stations Customer satisfaction Error detection Quality assurance Total quality management Weather information services Quality control algorithm database diurnal variation meteorology precipitation (climatology) quality control temperature profile weather station Argentina |
| description |
The present paper describes the quality-control component of an automatic procedure (APACH: A Procedure for Automated Quality Control and Homogenization of Weather Station Data) developed to control quality and homogenize the historical daily temperature and precipitation data from meteorological stations. The quality-control method is based on a set of decision-tree algorithms analyzing separately precipitation and minimum and maximum temperature. All our tests are non-parametric and therefore are potentially useful in regions or countries presenting different climates as those observed in Argentina. The method is applied to the 1959-2005 historical daily database of the Argentine National Weather Service. Our results are coherent with the history of the Weather Service and more specifically with the history of implementation of systematized quality control processes. In temperature, our method detects a larger number of suspect values before 1967 (when there was no quality control) and after 1997 (when only real-time quality control had been applied). In precipitation, the detection of error in extreme precipitations is complex, but our method clearly detected a strong decrease in the number of potential outliers after 1976 when the National Weather Service was militarized, and the network was strongly reduced, focusing more on airport weather stations. Also in precipitation, we analyze in detail the long dry sequences and are able to identify potential long erroneous sequences. This is important for the use of the data for hydrological or agricultural impact studies. Finally, all the data are flagged with codes representing the path followed by the record in our decision-tree algorithms. While each code is associated to one of the categories ("Useful", "Need-Check", "Doubtful" or "Suspect"), the final user is free to redefine such category-assignment. © Springer Science + Business Media B.V. 2009. |
| format |
JOUR |
| author |
Boulanger, J.-P. Aizpuru, J. Leggieri, L. Marino, M. |
| author_facet |
Boulanger, J.-P. Aizpuru, J. Leggieri, L. Marino, M. |
| author_sort |
Boulanger, J.-P. |
| title |
A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations |
| title_short |
A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations |
| title_full |
A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations |
| title_fullStr |
A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations |
| title_full_unstemmed |
A procedure for automated quality control and homogenization of historical daily temperature and precipitation data (APACH): Part 1: Quality control and application to the Argentine weather service stations |
| title_sort |
procedure for automated quality control and homogenization of historical daily temperature and precipitation data (apach): part 1: quality control and application to the argentine weather service stations |
| url |
http://hdl.handle.net/20.500.12110/paper_01650009_v98_n3_p471_Boulanger |
| work_keys_str_mv |
AT boulangerjp aprocedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT aizpuruj aprocedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT leggieril aprocedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT marinom aprocedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT boulangerjp procedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT aizpuruj procedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT leggieril procedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations AT marinom procedureforautomatedqualitycontrolandhomogenizationofhistoricaldailytemperatureandprecipitationdataapachpart1qualitycontrolandapplicationtotheargentineweatherservicestations |
| _version_ |
1782027763828391936 |