Data Quality for AI Tool: Exploratory Data Analysis on IBM API
By A. Jariwala, Aayushi Chaudhari, C. Bhatt, Dac-Nhuong Le. 2022
A huge amount of data is produced in every domain these days. Thus for applying automation on any dataset, the appropriately trained data plays an important role in achieving efficient and accurate results. According to data researchers, data scientists spare 80% of their time in preparing and organizing the data. To overcome this tedious task, IBM Research has developed a Data Quality for AI tool, which has varieties of metrics that can be applied to different datasets (in .csv format) to identify the quality of data. In this paper, we will be representing how the IBM API toolkit will be useful for different variants of datasets and showcase the results for each metrics in graphical form. This paper might be found useful for the readers to understand the working flow of the IBM data purifier tool, thus we have represented the entire flow of how to use IBM data quality for the AI toolkit in the form of architecture.
Subfields: Evaluation & Benchmarks
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Evaluation & Benchmarks
- Tristan Thrush
- Douwe Kiela
- Angelina McMillan-Major
- Yacine Jernite
- Alexandra Sasha Luccioni
- Margaret Mitchell
- Nazneen Rajani
- Mohit Bansal
Citations in the corpus
- Measuring Data (2022, methodology): “…for example, IBM’s tool for data “quality analysis”, which uses a series of “quality scores” to enable formalized and systematic data preparation (Jariwala et al., 2022); Google’s “Know Your Data" tool, created specifically for AI practitioners, has also helped shed light on the contents and…”