Frequently Asked Questions (FAQ) about Better Fetch

Q: What is Better Fetch? A: Better Fetch is a Model Context Protocol (MCP) server designed to fetch, clean, and convert web content into structured markdown files for AI consumption, analysis, and other applications.

Q: What is an MCP Server? A: MCP (Model Context Protocol) is an open protocol that standardizes how applications provide context to Large Language Models (LLMs). An MCP server acts as a bridge, allowing AI models to access and interact with external data sources and tools, like Better Fetch.

Q: How does Better Fetch clean web content? A: Better Fetch removes ads, navigation elements, scripts, and other noise from the extracted content, focusing on the main content areas of a webpage.

Q: Can I control how deep Better Fetch crawls a website? A: Yes, you can configure the maximum crawl depth to control how many levels of linked pages Better Fetch will process.

Q: Can I limit the number of pages Better Fetch processes? A: Yes, you can set a maximum page limit to prevent excessive crawling and ensure efficient resource utilization.

Q: Does Better Fetch support single-page extraction? A: Yes, Better Fetch offers a single-page extraction mode for scenarios where only a single page’s content is needed.

Q: Can I filter URLs based on patterns? A: Yes, you can use include and exclude patterns based on regular expressions to target specific URLs or sections of a website.

Q: What output format does Better Fetch generate? A: Better Fetch generates clean, well-structured markdown files with preserved code blocks, links, and metadata.

Q: What are some use cases for Better Fetch? A: Better Fetch can be used for documentation processing, content analysis & research, and AI training & context preparation.

Q: How does Better Fetch integrate with UBOS? A: Better Fetch can be integrated with UBOS, a full-stack AI Agent Development Platform, to enrich AI Agent knowledge, automate data collection, and improve AI Agent accuracy.

Q: Where can I find the Better Fetch documentation? A: You can find documentation and usage examples in the project’s README file and Wiki.

Q: Is Better Fetch free to use? A: Please refer to the project’s license (MIT License) for details on usage and distribution.

Q: How can I contribute to Better Fetch? A: You can contribute by forking the repository, creating a feature branch, making changes, and opening a pull request.