Data quality in a big data context

"In each of the phases of a Big Data analysis process, data quality (DQ) plays a key role. Given the particular characteristics of the data at hand, the traditional DQ methods used for relational databases, based on quality dimensions and metrics, must be adapted and extended, in order to captu...

Descripción completa

Detalles Bibliográficos
Autores principales: Arolfo, Franco A., Vaisman, Alejandro Ariel
Formato: Ponencias en Congresos acceptedVersion
Lenguaje:Inglés
Publicado: 2019
Materias:
CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
Acceso en línea:http://ri.itba.edu.ar/handle/123456789/1615
Aporte de:
Repositorio Institucional Instituto Tecnológico de Buenos Aires (ITBA) de Instituto Tecnológico de Buenos Aires (ITBA)
id I32-R138-123456789-1615
record_format dspace
spelling I32-R138-123456789-16152022-12-07T14:13:59Z Data quality in a big data context Arolfo, Franco A. Vaisman, Alejandro Ariel CALIDAD DE DATOS ANALISIS DE DATOS REDES SOCIALES "In each of the phases of a Big Data analysis process, data quality (DQ) plays a key role. Given the particular characteristics of the data at hand, the traditional DQ methods used for relational databases, based on quality dimensions and metrics, must be adapted and extended, in order to capture the new characteristics that Big Data introduces. This paper dives into this problem, re-defining the DQ dimensions and metrics for a Big Data scenario, where data may arrive, for example, as unstructured documents in real time. This general scenario is instantiated to study the concrete case of Twitter feeds. Further, the paper also describes the implementation of a system that acquires tweets in real time, and computes the quality of each tweet, applying the quality metrics that are defined formally in the paper. The implementation includes a web user interface that allows filtering the tweets for example by keywords, and visualizing the quality of a data stream in many different ways. Experiments are performed and their results discussed." 2019-06-14T19:05:27Z 2019-06-14T19:05:27Z 2018 Ponencias en Congresos info:eu-repo/semantics/acceptedVersion 978-3319-98-397-4 0302-9743 http://ri.itba.edu.ar/handle/123456789/1615 en info:eu-repo/semantics/altIdentifier/doi/10.1007/978-3-319-98398-1_11 info:eu-repo/grantAgreement/ANPCyT/PICT/2014-0787/AR. Ciudad Autónoma de Buenos Aires application/pdf
institution Instituto Tecnológico de Buenos Aires (ITBA)
institution_str I-32
repository_str R-138
collection Repositorio Institucional Instituto Tecnológico de Buenos Aires (ITBA)
language Inglés
topic CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
spellingShingle CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
Arolfo, Franco A.
Vaisman, Alejandro Ariel
Data quality in a big data context
topic_facet CALIDAD DE DATOS
ANALISIS DE DATOS
REDES SOCIALES
description "In each of the phases of a Big Data analysis process, data quality (DQ) plays a key role. Given the particular characteristics of the data at hand, the traditional DQ methods used for relational databases, based on quality dimensions and metrics, must be adapted and extended, in order to capture the new characteristics that Big Data introduces. This paper dives into this problem, re-defining the DQ dimensions and metrics for a Big Data scenario, where data may arrive, for example, as unstructured documents in real time. This general scenario is instantiated to study the concrete case of Twitter feeds. Further, the paper also describes the implementation of a system that acquires tweets in real time, and computes the quality of each tweet, applying the quality metrics that are defined formally in the paper. The implementation includes a web user interface that allows filtering the tweets for example by keywords, and visualizing the quality of a data stream in many different ways. Experiments are performed and their results discussed."
format Ponencias en Congresos
acceptedVersion
author Arolfo, Franco A.
Vaisman, Alejandro Ariel
author_facet Arolfo, Franco A.
Vaisman, Alejandro Ariel
author_sort Arolfo, Franco A.
title Data quality in a big data context
title_short Data quality in a big data context
title_full Data quality in a big data context
title_fullStr Data quality in a big data context
title_full_unstemmed Data quality in a big data context
title_sort data quality in a big data context
publishDate 2019
url http://ri.itba.edu.ar/handle/123456789/1615
work_keys_str_mv AT arolfofrancoa dataqualityinabigdatacontext
AT vaismanalejandroariel dataqualityinabigdatacontext
_version_ 1765660968214331392

Ejemplares similares