Multi-sensor spectral fusion to model grape composition using deep learning

Spectral instruments can be useful for the rapid assessment of chemical compounds in different targets, and their use have been already reported for the modeling of grape composition comparing two spectral ranges. Still, with the increased easiness of acquiring data with several sensors, it would be valuable to explore spectral fusion techniques for the modeling with deep learning, seeking to obtain improved performance. Therefore, the objective of this work was to develop multi-sensor spectral fusion approaches for the deep learning modeling of grape composition. From 128 grape samples, two spectra per sample were acquired from two different ranges using two sensors (visible and shortwave near infrared, 570–1000 nm; and wider NIR 1100–2100 nm). From each sample, 15 grape nitrogen compounds were analyzed by wet chemistry. Three different data fusion approaches are defined using neural networks and deep learning, testing several ways of structuring and merging the input spectra. Statistical analyses supported that (i) the proposed deep learning fusion architectures performed better than single spectral range models, and (ii) neural networks have better modeling capabilities than partial least squares in spectral fusion. The results demonstrate the potential of deep learning for spectral data fusion in grape nitrogen composition regression, and potentially other traits in food and agriculture spectroscopy.

Saved in:
Bibliographic Details
Main Authors: Gutiérrez, Salvador, Fernández-Novales, Juan, Garde-Cerdán, Teresa, Marín-San Román, Sandra, Tardáguila, Javier, Diago, Maria P.
Other Authors: Agencia Estatal de Investigación (España)
Format: artículo biblioteca
Published: Elsevier BV 2023-11
Subjects:Multi-block, Chemometrics, Spectrometer, Convolutional neural networks, Multilayer perceptrons, Spectroscopy, Amino acids, Nitrogen compounds,
Online Access:http://hdl.handle.net/10261/337297
Tags: Add Tag
No Tags, Be the first to tag this record!
id dig-icvv-es-10261-337297
record_format koha
spelling dig-icvv-es-10261-3372972023-10-18T08:20:12Z Multi-sensor spectral fusion to model grape composition using deep learning Gutiérrez, Salvador Fernández-Novales, Juan Garde-Cerdán, Teresa Marín-San Román, Sandra Tardáguila, Javier Diago, Maria P. Agencia Estatal de Investigación (España) Ministerio de Ciencia, Innovación y Universidades (España) Universidad de Granada Consorcio de Bibliotecas Universitarias de Andalucía Multi-block Chemometrics Spectrometer Convolutional neural networks Multilayer perceptrons Spectroscopy Amino acids Nitrogen compounds Spectral instruments can be useful for the rapid assessment of chemical compounds in different targets, and their use have been already reported for the modeling of grape composition comparing two spectral ranges. Still, with the increased easiness of acquiring data with several sensors, it would be valuable to explore spectral fusion techniques for the modeling with deep learning, seeking to obtain improved performance. Therefore, the objective of this work was to develop multi-sensor spectral fusion approaches for the deep learning modeling of grape composition. From 128 grape samples, two spectra per sample were acquired from two different ranges using two sensors (visible and shortwave near infrared, 570–1000 nm; and wider NIR 1100–2100 nm). From each sample, 15 grape nitrogen compounds were analyzed by wet chemistry. Three different data fusion approaches are defined using neural networks and deep learning, testing several ways of structuring and merging the input spectra. Statistical analyses supported that (i) the proposed deep learning fusion architectures performed better than single spectral range models, and (ii) neural networks have better modeling capabilities than partial least squares in spectral fusion. The results demonstrate the potential of deep learning for spectral data fusion in grape nitrogen composition regression, and potentially other traits in food and agriculture spectroscopy. This work has been supported by the Spanish State Research Agency through project PID2019-105381GA-I00 (iScience). Funding for open access charge: Universidad de Granada / CBUA. 2023-10-18T07:22:34Z 2023-10-18T07:22:34Z 2023-11 2023-10-18T07:22:34Z artículo doi: 10.1016/j.inffus.2023.101865 issn: 1566-2535 e-issn: 1872-6305 Information Fusion 99: 101865 (2023) http://hdl.handle.net/10261/337297 #PLACEHOLDER_PARENT_METADATA_VALUE# info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-105381GA-I00/ES/DESCUBRIMIENTO DE RELACIONES COMPLEJAS Y OCULTAS EN EL DESARROLLO Y TRANSFERENCIA DEL CONOCIMIENTO A TRAVES DE TECNICAS INTELIGENTES/ Publisher's version http://dx.doi.org/10.1016/j.inffus.2023.101865 Sí open application/pdf Elsevier BV
institution ICVV ES
collection DSpace
country España
countrycode ES
component Bibliográfico
access En linea
databasecode dig-icvv-es
tag biblioteca
region Europa del Sur
libraryname Biblioteca del ICVV España
topic Multi-block
Chemometrics
Spectrometer
Convolutional neural networks
Multilayer perceptrons
Spectroscopy
Amino acids
Nitrogen compounds
Multi-block
Chemometrics
Spectrometer
Convolutional neural networks
Multilayer perceptrons
Spectroscopy
Amino acids
Nitrogen compounds
spellingShingle Multi-block
Chemometrics
Spectrometer
Convolutional neural networks
Multilayer perceptrons
Spectroscopy
Amino acids
Nitrogen compounds
Multi-block
Chemometrics
Spectrometer
Convolutional neural networks
Multilayer perceptrons
Spectroscopy
Amino acids
Nitrogen compounds
Gutiérrez, Salvador
Fernández-Novales, Juan
Garde-Cerdán, Teresa
Marín-San Román, Sandra
Tardáguila, Javier
Diago, Maria P.
Multi-sensor spectral fusion to model grape composition using deep learning
description Spectral instruments can be useful for the rapid assessment of chemical compounds in different targets, and their use have been already reported for the modeling of grape composition comparing two spectral ranges. Still, with the increased easiness of acquiring data with several sensors, it would be valuable to explore spectral fusion techniques for the modeling with deep learning, seeking to obtain improved performance. Therefore, the objective of this work was to develop multi-sensor spectral fusion approaches for the deep learning modeling of grape composition. From 128 grape samples, two spectra per sample were acquired from two different ranges using two sensors (visible and shortwave near infrared, 570–1000 nm; and wider NIR 1100–2100 nm). From each sample, 15 grape nitrogen compounds were analyzed by wet chemistry. Three different data fusion approaches are defined using neural networks and deep learning, testing several ways of structuring and merging the input spectra. Statistical analyses supported that (i) the proposed deep learning fusion architectures performed better than single spectral range models, and (ii) neural networks have better modeling capabilities than partial least squares in spectral fusion. The results demonstrate the potential of deep learning for spectral data fusion in grape nitrogen composition regression, and potentially other traits in food and agriculture spectroscopy.
author2 Agencia Estatal de Investigación (España)
author_facet Agencia Estatal de Investigación (España)
Gutiérrez, Salvador
Fernández-Novales, Juan
Garde-Cerdán, Teresa
Marín-San Román, Sandra
Tardáguila, Javier
Diago, Maria P.
format artículo
topic_facet Multi-block
Chemometrics
Spectrometer
Convolutional neural networks
Multilayer perceptrons
Spectroscopy
Amino acids
Nitrogen compounds
author Gutiérrez, Salvador
Fernández-Novales, Juan
Garde-Cerdán, Teresa
Marín-San Román, Sandra
Tardáguila, Javier
Diago, Maria P.
author_sort Gutiérrez, Salvador
title Multi-sensor spectral fusion to model grape composition using deep learning
title_short Multi-sensor spectral fusion to model grape composition using deep learning
title_full Multi-sensor spectral fusion to model grape composition using deep learning
title_fullStr Multi-sensor spectral fusion to model grape composition using deep learning
title_full_unstemmed Multi-sensor spectral fusion to model grape composition using deep learning
title_sort multi-sensor spectral fusion to model grape composition using deep learning
publisher Elsevier BV
publishDate 2023-11
url http://hdl.handle.net/10261/337297
work_keys_str_mv AT gutierrezsalvador multisensorspectralfusiontomodelgrapecompositionusingdeeplearning
AT fernandeznovalesjuan multisensorspectralfusiontomodelgrapecompositionusingdeeplearning
AT gardecerdanteresa multisensorspectralfusiontomodelgrapecompositionusingdeeplearning
AT marinsanromansandra multisensorspectralfusiontomodelgrapecompositionusingdeeplearning
AT tardaguilajavier multisensorspectralfusiontomodelgrapecompositionusingdeeplearning
AT diagomariap multisensorspectralfusiontomodelgrapecompositionusingdeeplearning
_version_ 1781881428553760768