Parallelization of the SUFI2 algorithm: a Windows HPC approach.

The Soil and Water Assessment Tool (SWAT) has been used for evaluating land use changes on water resources worldwide, and like many models, SWAT requires calibration. However, the execution time of these calibrations can be rather long, reducing the time available for proper analysis. This paper presents a Windows approach for calibrating SWAT using a multinodal cluster computer, composed of six computers with i7 processors (3.2 GHz; 12 cores), 8 GB RAM and 1 TB HDD each. The only requirement for this type of cluster is to have 64-bit processors. Our computers were setup with Windows Server HPC 2012 R2, a network switch 10/100, and regular Ethernet cables. We used the SUFI2 algorithm that comes with SWAT-CUP package to perform calibrations with 100 simulations at node level. Calibration runs were configured as follows: 1-12 (1 process interval), and 12-72 (12 processes interval), resulting in 17 runs. Each run was repeated three times, and results are presented as the mean execution time, in order to minimize any influence of resources fluctuations. Results showed that time of execution was reduced by almost half by using nine processes (15 min) in comparison with the one node control (28 min). We observed a linear decrease of execution time from one to nine processes. With additional processes, execution time increased about 23% and stabilized at 80% of the control. All processing is divided into five steps: distribute files (2.24% of all processing time), organize samples (0.89%), run SWAT (47.59%), collect results (46.51%) and cleanup (0.28%).

Saved in:
Bibliographic Details
Main Authors: MIRANDA, R. de Q., GALVÍNCIO, J. D., MOURA, M. S. B. de, SRINIVASAN, R.
Other Authors: RODRIGO DE QUEIROGA MIRANDA, Universidade Federal de Pernambuco; JOSICLÊDA DOMICIANO GALVÍNCIO, Universidade Federal de Pernambuco; MAGNA SOELMA BESERRA DE MOURA, CPATSA; RAGHAVAN SRINIVASAN, Professor, Spatial Sciences Laboratory, Texas A&M University, College Station, Texas, United States of America.
Format: Artigo de periódico biblioteca
Language:English
eng
Published: 2018-06-22
Subjects:Alta performance, SWAT, Uso da Terra, Recurso Hídrico, Hidrologia, Recurso Natural, Natural resources, Water resources,
Online Access:http://www.alice.cnptia.embrapa.br/alice/handle/doc/1092702
Tags: Add Tag
No Tags, Be the first to tag this record!
id dig-alice-doc-1092702
record_format koha
spelling dig-alice-doc-10927022018-06-24T00:57:49Z Parallelization of the SUFI2 algorithm: a Windows HPC approach. MIRANDA, R. de Q. GALVÍNCIO, J. D. MOURA, M. S. B. de SRINIVASAN, R. RODRIGO DE QUEIROGA MIRANDA, Universidade Federal de Pernambuco; JOSICLÊDA DOMICIANO GALVÍNCIO, Universidade Federal de Pernambuco; MAGNA SOELMA BESERRA DE MOURA, CPATSA; RAGHAVAN SRINIVASAN, Professor, Spatial Sciences Laboratory, Texas A&M University, College Station, Texas, United States of America. Alta performance SWAT Uso da Terra Recurso Hídrico Hidrologia Recurso Natural Natural resources Water resources The Soil and Water Assessment Tool (SWAT) has been used for evaluating land use changes on water resources worldwide, and like many models, SWAT requires calibration. However, the execution time of these calibrations can be rather long, reducing the time available for proper analysis. This paper presents a Windows approach for calibrating SWAT using a multinodal cluster computer, composed of six computers with i7 processors (3.2 GHz; 12 cores), 8 GB RAM and 1 TB HDD each. The only requirement for this type of cluster is to have 64-bit processors. Our computers were setup with Windows Server HPC 2012 R2, a network switch 10/100, and regular Ethernet cables. We used the SUFI2 algorithm that comes with SWAT-CUP package to perform calibrations with 100 simulations at node level. Calibration runs were configured as follows: 1-12 (1 process interval), and 12-72 (12 processes interval), resulting in 17 runs. Each run was repeated three times, and results are presented as the mean execution time, in order to minimize any influence of resources fluctuations. Results showed that time of execution was reduced by almost half by using nine processes (15 min) in comparison with the one node control (28 min). We observed a linear decrease of execution time from one to nine processes. With additional processes, execution time increased about 23% and stabilized at 80% of the control. All processing is divided into five steps: distribute files (2.24% of all processing time), organize samples (0.89%), run SWAT (47.59%), collect results (46.51%) and cleanup (0.28%). 2018-06-24T00:57:43Z 2018-06-24T00:57:43Z 2018-06-22 2017 2018-06-24T00:57:43Z Artigo de periódico Revista Brasileira de Geografia Física, v. 10, n. 5, p. 1535-1544, 2017. 1984-2295 http://www.alice.cnptia.embrapa.br/alice/handle/doc/1092702 en eng openAccess
institution EMBRAPA
collection DSpace
country Brasil
countrycode BR
component Bibliográfico
access En linea
databasecode dig-alice
tag biblioteca
region America del Sur
libraryname Sistema de bibliotecas de EMBRAPA
language English
eng
topic Alta performance
SWAT
Uso da Terra
Recurso Hídrico
Hidrologia
Recurso Natural
Natural resources
Water resources
Alta performance
SWAT
Uso da Terra
Recurso Hídrico
Hidrologia
Recurso Natural
Natural resources
Water resources
spellingShingle Alta performance
SWAT
Uso da Terra
Recurso Hídrico
Hidrologia
Recurso Natural
Natural resources
Water resources
Alta performance
SWAT
Uso da Terra
Recurso Hídrico
Hidrologia
Recurso Natural
Natural resources
Water resources
MIRANDA, R. de Q.
GALVÍNCIO, J. D.
MOURA, M. S. B. de
SRINIVASAN, R.
Parallelization of the SUFI2 algorithm: a Windows HPC approach.
description The Soil and Water Assessment Tool (SWAT) has been used for evaluating land use changes on water resources worldwide, and like many models, SWAT requires calibration. However, the execution time of these calibrations can be rather long, reducing the time available for proper analysis. This paper presents a Windows approach for calibrating SWAT using a multinodal cluster computer, composed of six computers with i7 processors (3.2 GHz; 12 cores), 8 GB RAM and 1 TB HDD each. The only requirement for this type of cluster is to have 64-bit processors. Our computers were setup with Windows Server HPC 2012 R2, a network switch 10/100, and regular Ethernet cables. We used the SUFI2 algorithm that comes with SWAT-CUP package to perform calibrations with 100 simulations at node level. Calibration runs were configured as follows: 1-12 (1 process interval), and 12-72 (12 processes interval), resulting in 17 runs. Each run was repeated three times, and results are presented as the mean execution time, in order to minimize any influence of resources fluctuations. Results showed that time of execution was reduced by almost half by using nine processes (15 min) in comparison with the one node control (28 min). We observed a linear decrease of execution time from one to nine processes. With additional processes, execution time increased about 23% and stabilized at 80% of the control. All processing is divided into five steps: distribute files (2.24% of all processing time), organize samples (0.89%), run SWAT (47.59%), collect results (46.51%) and cleanup (0.28%).
author2 RODRIGO DE QUEIROGA MIRANDA, Universidade Federal de Pernambuco; JOSICLÊDA DOMICIANO GALVÍNCIO, Universidade Federal de Pernambuco; MAGNA SOELMA BESERRA DE MOURA, CPATSA; RAGHAVAN SRINIVASAN, Professor, Spatial Sciences Laboratory, Texas A&M University, College Station, Texas, United States of America.
author_facet RODRIGO DE QUEIROGA MIRANDA, Universidade Federal de Pernambuco; JOSICLÊDA DOMICIANO GALVÍNCIO, Universidade Federal de Pernambuco; MAGNA SOELMA BESERRA DE MOURA, CPATSA; RAGHAVAN SRINIVASAN, Professor, Spatial Sciences Laboratory, Texas A&M University, College Station, Texas, United States of America.
MIRANDA, R. de Q.
GALVÍNCIO, J. D.
MOURA, M. S. B. de
SRINIVASAN, R.
format Artigo de periódico
topic_facet Alta performance
SWAT
Uso da Terra
Recurso Hídrico
Hidrologia
Recurso Natural
Natural resources
Water resources
author MIRANDA, R. de Q.
GALVÍNCIO, J. D.
MOURA, M. S. B. de
SRINIVASAN, R.
author_sort MIRANDA, R. de Q.
title Parallelization of the SUFI2 algorithm: a Windows HPC approach.
title_short Parallelization of the SUFI2 algorithm: a Windows HPC approach.
title_full Parallelization of the SUFI2 algorithm: a Windows HPC approach.
title_fullStr Parallelization of the SUFI2 algorithm: a Windows HPC approach.
title_full_unstemmed Parallelization of the SUFI2 algorithm: a Windows HPC approach.
title_sort parallelization of the sufi2 algorithm: a windows hpc approach.
publishDate 2018-06-22
url http://www.alice.cnptia.embrapa.br/alice/handle/doc/1092702
work_keys_str_mv AT mirandardeq parallelizationofthesufi2algorithmawindowshpcapproach
AT galvinciojd parallelizationofthesufi2algorithmawindowshpcapproach
AT mouramsbde parallelizationofthesufi2algorithmawindowshpcapproach
AT srinivasanr parallelizationofthesufi2algorithmawindowshpcapproach
_version_ 1756024811749900288