Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey
Abstract: Massive amounts of data are generated every day from all kinds of sources, from numerical data generated by sensors to veiled messages on social networks. Transforming these data into properly organized pieces of information and transforming it into resources for decision-making is complicated, not only because of the speed and volume at which it is produced, but due to the fact the high complexity of the context in which it is generated. Often, the first step in analyzing the data is to separate it into categories that correspond to segments of interest in that context. However, in many real cases, the limits of these segments and even the number of existing segments is unknown. Clustering techniques allow defining the classes of entities in a data set with sufficient relevance. However, those techniques usually work only with numerical data. Surveys are a very useful tool for collecting data in ill-defined contexts, but these data usually contain values that are not only numerical but of a very diverse nature. This paper presents a modification to the Isodata method to process data with mixed numerical and categorical values. The resulting algorithm is tested by analyzing the results of the 2021 Stack Overflow developer survey. The results obtained in the clustering of such data are sound and show that the Isodata method, with the proposed adaptations, can be successfully employed to discover patterns in complex mixed data.
Main Authors: | , , |
---|---|
Format: | Digital revista |
Language: | English |
Published: |
Instituto Politécnico Nacional, Centro de Investigación en Computación
2023
|
Online Access: | http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S1405-55462023000100173 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
oai:scielo:S1405-55462023000100173 |
---|---|
record_format |
ojs |
spelling |
oai:scielo:S1405-554620230001001732023-06-13Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer SurveySoto de la Cruz,RamónCastro-Espinoza,Félix AgustínSoto,Liz Clustering Isodata mixed data clustering Abstract: Massive amounts of data are generated every day from all kinds of sources, from numerical data generated by sensors to veiled messages on social networks. Transforming these data into properly organized pieces of information and transforming it into resources for decision-making is complicated, not only because of the speed and volume at which it is produced, but due to the fact the high complexity of the context in which it is generated. Often, the first step in analyzing the data is to separate it into categories that correspond to segments of interest in that context. However, in many real cases, the limits of these segments and even the number of existing segments is unknown. Clustering techniques allow defining the classes of entities in a data set with sufficient relevance. However, those techniques usually work only with numerical data. Surveys are a very useful tool for collecting data in ill-defined contexts, but these data usually contain values that are not only numerical but of a very diverse nature. This paper presents a modification to the Isodata method to process data with mixed numerical and categorical values. The resulting algorithm is tested by analyzing the results of the 2021 Stack Overflow developer survey. The results obtained in the clustering of such data are sound and show that the Isodata method, with the proposed adaptations, can be successfully employed to discover patterns in complex mixed data.info:eu-repo/semantics/openAccessInstituto Politécnico Nacional, Centro de Investigación en ComputaciónComputación y Sistemas v.27 n.1 20232023-03-01info:eu-repo/semantics/articletext/htmlhttp://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S1405-55462023000100173en10.13053/cys-27-1-4539 |
institution |
SCIELO |
collection |
OJS |
country |
México |
countrycode |
MX |
component |
Revista |
access |
En linea |
databasecode |
rev-scielo-mx |
tag |
revista |
region |
America del Norte |
libraryname |
SciELO |
language |
English |
format |
Digital |
author |
Soto de la Cruz,Ramón Castro-Espinoza,Félix Agustín Soto,Liz |
spellingShingle |
Soto de la Cruz,Ramón Castro-Espinoza,Félix Agustín Soto,Liz Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey |
author_facet |
Soto de la Cruz,Ramón Castro-Espinoza,Félix Agustín Soto,Liz |
author_sort |
Soto de la Cruz,Ramón |
title |
Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey |
title_short |
Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey |
title_full |
Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey |
title_fullStr |
Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey |
title_full_unstemmed |
Isodata-Based Method for Clustering Surveys Responses with Mixed Data: The 2021 StackOverflow Developer Survey |
title_sort |
isodata-based method for clustering surveys responses with mixed data: the 2021 stackoverflow developer survey |
description |
Abstract: Massive amounts of data are generated every day from all kinds of sources, from numerical data generated by sensors to veiled messages on social networks. Transforming these data into properly organized pieces of information and transforming it into resources for decision-making is complicated, not only because of the speed and volume at which it is produced, but due to the fact the high complexity of the context in which it is generated. Often, the first step in analyzing the data is to separate it into categories that correspond to segments of interest in that context. However, in many real cases, the limits of these segments and even the number of existing segments is unknown. Clustering techniques allow defining the classes of entities in a data set with sufficient relevance. However, those techniques usually work only with numerical data. Surveys are a very useful tool for collecting data in ill-defined contexts, but these data usually contain values that are not only numerical but of a very diverse nature. This paper presents a modification to the Isodata method to process data with mixed numerical and categorical values. The resulting algorithm is tested by analyzing the results of the 2021 Stack Overflow developer survey. The results obtained in the clustering of such data are sound and show that the Isodata method, with the proposed adaptations, can be successfully employed to discover patterns in complex mixed data. |
publisher |
Instituto Politécnico Nacional, Centro de Investigación en Computación |
publishDate |
2023 |
url |
http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S1405-55462023000100173 |
work_keys_str_mv |
AT sotodelacruzramon isodatabasedmethodforclusteringsurveysresponseswithmixeddatathe2021stackoverflowdevelopersurvey AT castroespinozafelixagustin isodatabasedmethodforclusteringsurveysresponseswithmixeddatathe2021stackoverflowdevelopersurvey AT sotoliz isodatabasedmethodforclusteringsurveysresponseswithmixeddatathe2021stackoverflowdevelopersurvey |
_version_ |
1769607144519237632 |