Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey

Abstract: Massive amounts of data are generated every day from all kinds of sources, from numerical data generated by sensors to veiled messages on social networks. Transforming these data into properly organized pieces of information and transforming it into resources for decision-making is complicated, not only because of the speed and volume at which it is produced, but due to the fact the high complexity of the context in which it is generated. Often, the first step in analyzing the data is to separate it into categories that correspond to segments of interest in that context. However, in many real cases, the limits of these segments and even the number of existing segments is unknown. Clustering techniques allow defining the classes of entities in a data set with sufficient relevance. However, those techniques usually work only with numerical data. Surveys are a very useful tool for collecting data in ill-defined contexts, but these data usually contain values that are not only numerical but of a very diverse nature. This paper presents a modification to the Isodata method to process data with mixed numerical and categorical values. The resulting algorithm is tested by analyzing the results of the 2021 Stack Overflow developer survey. The results obtained in the clustering of such data are sound and show that the Isodata method, with the proposed adaptations, can be successfully employed to discover patterns in complex mixed data.

Saved in:
Bibliographic Details
Main Authors: Soto de la Cruz,Ramón, Castro-Espinoza,Félix Agustín, Soto,Liz
Format: Digital revista
Language:English
Published: Instituto Politécnico Nacional, Centro de Investigación en Computación 2023
Online Access:http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S1405-55462023000100173
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:scielo:S1405-55462023000100173
record_format ojs
spelling oai:scielo:S1405-554620230001001732023-06-13Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer SurveySoto de la Cruz,RamónCastro-Espinoza,Félix AgustínSoto,Liz Clustering Isodata mixed data clustering Abstract: Massive amounts of data are generated every day from all kinds of sources, from numerical data generated by sensors to veiled messages on social networks. Transforming these data into properly organized pieces of information and transforming it into resources for decision-making is complicated, not only because of the speed and volume at which it is produced, but due to the fact the high complexity of the context in which it is generated. Often, the first step in analyzing the data is to separate it into categories that correspond to segments of interest in that context. However, in many real cases, the limits of these segments and even the number of existing segments is unknown. Clustering techniques allow defining the classes of entities in a data set with sufficient relevance. However, those techniques usually work only with numerical data. Surveys are a very useful tool for collecting data in ill-defined contexts, but these data usually contain values that are not only numerical but of a very diverse nature. This paper presents a modification to the Isodata method to process data with mixed numerical and categorical values. The resulting algorithm is tested by analyzing the results of the 2021 Stack Overflow developer survey. The results obtained in the clustering of such data are sound and show that the Isodata method, with the proposed adaptations, can be successfully employed to discover patterns in complex mixed data.info:eu-repo/semantics/openAccessInstituto Politécnico Nacional, Centro de Investigación en ComputaciónComputación y Sistemas v.27 n.1 20232023-03-01info:eu-repo/semantics/articletext/htmlhttp://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S1405-55462023000100173en10.13053/cys-27-1-4539
institution SCIELO
collection OJS
country México
countrycode MX
component Revista
access En linea
databasecode rev-scielo-mx
tag revista
region America del Norte
libraryname SciELO
language English
format Digital
author Soto de la Cruz,Ramón
Castro-Espinoza,Félix Agustín
Soto,Liz
spellingShingle Soto de la Cruz,Ramón
Castro-Espinoza,Félix Agustín
Soto,Liz
Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
author_facet Soto de la Cruz,Ramón
Castro-Espinoza,Félix Agustín
Soto,Liz
author_sort Soto de la Cruz,Ramón
title Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
title_short Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
title_full Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
title_fullStr Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
title_full_unstemmed Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
title_sort isodata-based method for clustering surveys responses with mixed data: the 2021 stackoverflow developer survey
description Abstract: Massive amounts of data are generated every day from all kinds of sources, from numerical data generated by sensors to veiled messages on social networks. Transforming these data into properly organized pieces of information and transforming it into resources for decision-making is complicated, not only because of the speed and volume at which it is produced, but due to the fact the high complexity of the context in which it is generated. Often, the first step in analyzing the data is to separate it into categories that correspond to segments of interest in that context. However, in many real cases, the limits of these segments and even the number of existing segments is unknown. Clustering techniques allow defining the classes of entities in a data set with sufficient relevance. However, those techniques usually work only with numerical data. Surveys are a very useful tool for collecting data in ill-defined contexts, but these data usually contain values that are not only numerical but of a very diverse nature. This paper presents a modification to the Isodata method to process data with mixed numerical and categorical values. The resulting algorithm is tested by analyzing the results of the 2021 Stack Overflow developer survey. The results obtained in the clustering of such data are sound and show that the Isodata method, with the proposed adaptations, can be successfully employed to discover patterns in complex mixed data.
publisher Instituto Politécnico Nacional, Centro de Investigación en Computación
publishDate 2023
url http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S1405-55462023000100173
work_keys_str_mv AT sotodelacruzramon isodatabasedmethodforclusteringsurveysresponseswithmixeddatathe2021stackoverflowdevelopersurvey
AT castroespinozafelixagustin isodatabasedmethodforclusteringsurveysresponseswithmixeddatathe2021stackoverflowdevelopersurvey
AT sotoliz isodatabasedmethodforclusteringsurveysresponseswithmixeddatathe2021stackoverflowdevelopersurvey
_version_ 1769607144519237632