TY - GEN
T1 - Detection of outliers and replacement of missing values in absorbance and discharge time series
AU - Torres Abello, Andres Eduardo
AU - Plazas-Nossa, Leonardo
AU - Bertrand-Krajewski, J. L.
PY - 2015
Y1 - 2015
N2 - The present paper proposes a methodology aiming to detect and remove outliers as well as to fill gaps in time series. One notable application of such a methodology would be the comparison of dry weather contributions to those of rain events, after detection and removal of outliers. The proposed methodology includes outlier detection and application of the Discrete Fourier Transform (DFT). Together, these tools were used to analyse a case study including four time series: three UV-Vis spectra series from study sites in Colombia and one discharge series in France. Outlier detection with the proposed methodology gives good results when window parameter values are small and self-similar, despite the fact that the four time series exhibited different lengths and behaviours. The DFT allows completing time series based on its ability to manage various gap sizes, remove outliers and replace missing values. DFT led to low error percentages for all four time series (14 % in average). This percentage reflects what would have likely been the time series behaviour in the absence of misleading outliers and missing data.
AB - The present paper proposes a methodology aiming to detect and remove outliers as well as to fill gaps in time series. One notable application of such a methodology would be the comparison of dry weather contributions to those of rain events, after detection and removal of outliers. The proposed methodology includes outlier detection and application of the Discrete Fourier Transform (DFT). Together, these tools were used to analyse a case study including four time series: three UV-Vis spectra series from study sites in Colombia and one discharge series in France. Outlier detection with the proposed methodology gives good results when window parameter values are small and self-similar, despite the fact that the four time series exhibited different lengths and behaviours. The DFT allows completing time series based on its ability to manage various gap sizes, remove outliers and replace missing values. DFT led to low error percentages for all four time series (14 % in average). This percentage reflects what would have likely been the time series behaviour in the absence of misleading outliers and missing data.
KW - Discrete Fourier Transform
KW - Time series analysis
KW - UV-Vis spectrometry
KW - Water quality
KW - Winsorising
M3 - Conference contribution
SP - 113
EP - 117
BT - 10th UDM--International Conference on Urban Drainage Modelling
ER -