What is Dingo?

Dingo is an open-source data quality evaluation tool designed to automatically detect data quality issues in datasets. It supports various data types, including text and multimodal datasets, and offers built-in rules, model evaluation methods, and custom options.

How does Dingo help with MCP Servers?

Dingo includes an experimental Model Context Protocol (MCP) server, allowing AI models to access and interact with external data sources and tools. This integration enhances the ability of AI models to understand context and provide accurate responses.

What types of data sources does Dingo support?

Dingo supports local files, Hugging Face datasets, and S3 storage. It handles pre-training, fine-tuning, and evaluation datasets across text and image modalities.

Can I customize the evaluation rules in Dingo?

Yes, Dingo supports custom rules and models, allowing you to tailor the evaluation process to your specific needs. You can create custom rules using Python and register them with the @Model.rule_register decorator.

What are the key data quality metrics evaluated by Dingo?

Dingo evaluates data quality across seven key dimensions: Completeness, Effectiveness, Fluency, Relevance, Security, Similarity, and Understandability.

Does Dingo integrate with LLMs for evaluation?

Yes, Dingo integrates with powerful language models like OpenAI’s GPT series, Kimi, and local models like Llama3 for more nuanced and context-aware data quality assessments.

How can I use Dingo with the UBOS platform?

By integrating Dingo with UBOS, you can ensure that your AI Agents are powered by high-quality data. UBOS can ingest data, Dingo validates the data quality, and UBOS transforms the validated data for AI Agent training and deployment.

What kind of reports does Dingo generate?

Dingo generates detailed reports that highlight data quality issues, providing actionable insights for remediation. These reports include an overall summary, a list of problematic data, and a list of high-quality data.

How do I install Dingo?

You can install Dingo using pip: pip install dingo-python.

Is Dingo free to use?

Yes, Dingo is an open-source tool and is free to use under the Apache 2.0 license.