Self-hosted documentation crawler and Markdown MCP server that lets Claude query crawled technical documentation, list files, read sections, search content, inspect metadata, and keep generated Markdown in sync.
DevDocs runs a multi-container Docker stack with frontend, backend, MCP, and Crawl4AI services; use the reviewed commit below instead of executing a moving branch tip., The crawler can fetch and process external websites, so review crawl targets, rate limits, robots rules, and site terms before crawling., The backend and crawler use a Crawl4AI API token; replace the demo token before shared or production use., The MCP container mounts generated Markdown and logs, and its tools can read, search, sync, and expose that content to the MCP client., Local services are exposed on development ports by the Docker stack; do not expose them on untrusted networks without authentication and network controls.
Privacy notes
Crawled pages, generated Markdown, JSON metadata, source URLs, tags, search queries, local logs, and MCP tool outputs may contain proprietary documentation, customer data, internal architecture, or third-party website content., The Markdown MCP server can reveal full document text, section contents, table of contents, metadata, and search snippets to the connected model provider., Logs, crawl results, mounted volumes, and container transcripts can retain documentation-derived content after an MCP session ends., Optional LLM-related Crawl4AI environment variables can route documentation-derived content to external model providers if configured., Keep storage directories, crawl outputs, API tokens, and generated documentation artifacts out of public repositories unless publication is explicitly approved.
Author
CyberAGI
Submitted by
oktofeesh1
Claim status
unclaimed
Last verified
2026-06-06
Decision playbook
Review trust signals before you adopt
Signals are present but mixed. Use the checklist below to confirm the source and operational safety for your environment.
Compare context
Selected
0
Current score
63
Baseline
—
Delta
No baseline selected
No major trust-signal divergence detected in the current selection.
Source and provenance checks
Needs review
Confirm ownership and provenance before trusting install instructions.
Source link availableRequired
Open the canonical repository and verify ownership.
Done
Source provenance statusRequired
Marked as source-backed.
Done
Metadata reviewed
No reviewed flag detected in metadata.
Pending
Safety and privacy checks
Complete
Validate risk disclosures before installation or API wiring.
Safety notes presentRequired
Review the listed safety guidance before running commands.
Done
Privacy notes presentRequired
Review data handling notes before connecting accounts or secrets.
Done
Trust level risk gateRequired
Trust level does not block evaluation.
Done
Package and install checks
Needs review
Check package metadata and artifact integrity signals.
Install payload available
Install or copy payload is available for review.
Done
Package verification flag
No package verification flag provided.
Pending
Checksum metadata
No checksum provided for downloaded artifact.
Pending
Compare-driven decision checks
Needs review
Use compare context to validate trade-offs before adoption.
Compare tray has multiple entries
Add at least one more entry to compare trust differences.
5 safety and 5 privacy notes across 5 risk areas. Review closely: credentials & tokens, network access, third-party handling.
5 areas
SafetyExecution & processesDevDocs runs a multi-container Docker stack with frontend, backend, MCP, and Crawl4AI services; use the reviewed commit below instead of executing a moving branch tip.
SafetyExecution & processesThe crawler can fetch and process external websites, so review crawl targets, rate limits, robots rules, and site terms before crawling.
SafetyCredentials & tokensThe backend and crawler use a Crawl4AI API token; replace the demo token before shared or production use.
SafetyData retentionThe MCP container mounts generated Markdown and logs, and its tools can read, search, sync, and expose that content to the MCP client.
SafetyNetwork accessLocal services are exposed on development ports by the Docker stack; do not expose them on untrusted networks without authentication and network controls.
PrivacyThird-party handlingCrawled pages, generated Markdown, JSON metadata, source URLs, tags, search queries, local logs, and MCP tool outputs may contain proprietary documentation, customer data, internal architecture, or third-party website content.
PrivacyThird-party handlingThe Markdown MCP server can reveal full document text, section contents, table of contents, metadata, and search snippets to the connected model provider.
PrivacyCredentials & tokensLogs, crawl results, mounted volumes, and container transcripts can retain documentation-derived content after an MCP session ends.
PrivacyThird-party handlingOptional LLM-related Crawl4AI environment variables can route documentation-derived content to external model providers if configured.
PrivacyCredentials & tokensKeep storage directories, crawl outputs, API tokens, and generated documentation artifacts out of public repositories unless publication is explicitly approved.
Disclosure: Apache-2.0-licensed open-source project. The entry focuses on the repository's Docker-backed Fast Markdown MCP server and documentation-crawling workflow.
Safety notes
DevDocs runs a multi-container Docker stack with frontend, backend, MCP, and Crawl4AI services; use the reviewed commit below instead of executing a moving branch tip.
The crawler can fetch and process external websites, so review crawl targets, rate limits, robots rules, and site terms before crawling.
The backend and crawler use a Crawl4AI API token; replace the demo token before shared or production use.
The MCP container mounts generated Markdown and logs, and its tools can read, search, sync, and expose that content to the MCP client.
Local services are exposed on development ports by the Docker stack; do not expose them on untrusted networks without authentication and network controls.
Privacy notes
Crawled pages, generated Markdown, JSON metadata, source URLs, tags, search queries, local logs, and MCP tool outputs may contain proprietary documentation, customer data, internal architecture, or third-party website content.
The Markdown MCP server can reveal full document text, section contents, table of contents, metadata, and search snippets to the connected model provider.
Logs, crawl results, mounted volumes, and container transcripts can retain documentation-derived content after an MCP session ends.
Optional LLM-related Crawl4AI environment variables can route documentation-derived content to external model providers if configured.
Keep storage directories, crawl outputs, API tokens, and generated documentation artifacts out of public repositories unless publication is explicitly approved.
Prerequisites
Docker and Docker Compose available on the host that will run DevDocs.
Git access to clone the DevDocs repository and check out reviewed commit `9845479d0aeb7523abaab85723d0dfcf832fe1d3` before running the Docker startup script.
MCP client support for launching stdio servers through `docker exec -i`.
Documentation URLs reviewed for crawling permissions, robots rules, and terms of service.
Storage, logs, crawl results, and Markdown output directories scoped to documentation you are authorized to crawl and query.
Schema details
Install type
cli
Troubleshooting
No
Source repository stats
Scope
Source repo
Collection metadata
Estimated setup
20 minutes
Difficulty
advanced
Tool listing metadata
Disclosure
Apache-2.0-licensed open-source project. The entry focuses on the repository's Docker-backed Fast Markdown MCP server and documentation-crawling workflow.
DevDocs combines a documentation crawler, a local web UI, and a Docker-backed
Fast Markdown MCP server. The crawler writes documentation into local Markdown
and metadata files, while the MCP server exposes those files to Claude through
tools for listing files, reading Markdown, searching content, finding tagged
documents, inspecting sections, and getting document statistics.
Use it when you want Claude to work from a private or self-hosted copy of
technical documentation instead of repeatedly searching the live web. The
upstream Docker setup runs the MCP process over stdin/stdout through
docker exec -i, so the client communicates with the devdocs-mcp container
rather than a public network endpoint.
These sources were reviewed on 2026-06-06 at commit
9845479d0aeb7523abaab85723d0dfcf832fe1d3. Use the pinned commit for the
Docker startup script and MCP setup reviewed here; inspect upstream changes
before running newer branch tips.
Features
Crawl and store technical documentation as Markdown and JSON metadata.
Run a local Fast Markdown MCP server inside the DevDocs Docker stack.
List available Markdown files.
Read full Markdown files with basic metadata.
Search across generated Markdown content.
Search metadata tags.
Return document statistics.
Retrieve a specific section by generated section ID.
Generate a table of contents from Markdown headings.
Run advanced section search with ranking and confidence scores.
Watch Markdown and metadata files so changes can be synchronized.
Installation
Clone the repository, check out the reviewed commit, and start the Docker stack
using the pinned upstream scripts:
git clone https://github.com/cyberagiinc/DevDocs.git
cd DevDocs
git checkout 9845479d0aeb7523abaab85723d0dfcf832fe1d3
./docker-start.sh
Connect Claude or another MCP client to the containerized MCP process:
Restart the MCP client after changing its server configuration. Keep the
generated Markdown storage mounted only where DevDocs and the approved MCP
client need access.
Use Cases
Give Claude a searchable local copy of framework or library docs.
Crawl internal engineering documentation for private agent workflows.
Ask Claude to find relevant sections across generated Markdown docs.
Query a table of contents before reading a large document.
Keep documentation snapshots available when live pages change.
Build a local research workflow around Crawl4AI output and Markdown MCP
search.
Safety and Privacy
DevDocs can crawl websites and convert them into model-visible local Markdown.
Before crawling, confirm that the target permits automated access and that the
depth, concurrency, and selected URLs are appropriate. Avoid crawling customer
portals, authenticated pages, or internal knowledge bases unless you have
explicit approval and a retention plan.
The MCP server exposes generated Markdown files, metadata, sections, tags,
search snippets, and document statistics to the connected model provider. Treat
the storage, logs, and crawl_results directories as sensitive. Replace
the default Crawl4AI demo token before shared use, avoid exposing local service
ports on untrusted networks, and keep optional LLM provider API keys out of
logs, shell history, screenshots, and repository files.
Duplicate Check
No cyberagiinc/DevDocs, DevDocs MCP Server, Fast Markdown MCP from DevDocs,
or matching source URL entry was found in content/mcp or README.md.
Show that DevDocs MCP Server is listed on HeyClaude. Paste this Markdown into your README — it renders the badge and links back to this page.
[](https://heyclau.de/entry/mcp/devdocs-mcp-server)
How it compares
DevDocs MCP Server side by side with 3 alternatives on trust, install, platform support, and disclosed safety notes — all from reviewed registry metadata.
Self-hosted documentation crawler and Markdown MCP server that lets Claude query crawled technical documentation, list files, read sections, search content, inspect metadata, and keep generated Markdown in sync.
Official Agentset MCP server that lets Claude retrieve cited knowledge-base results from an Agentset namespace through the `knowledge-base-retrieve` tool, with optional tenant scoping and custom tool descriptions.
Local-first codebase intelligence MCP server that indexes repositories with tree-sitter, stores searchable chunks in DuckDB, and gives Claude semantic search, regex search, daemon status, and deep code research tools.
Code intelligence MCP server with a Zig core for local project indexing, structural outlines, symbol lookup, search, dependency graphs, snapshots, remote public-repo queries, and fallback edits.
✓DevDocs runs a multi-container Docker stack with frontend, backend, MCP, and Crawl4AI services; use the reviewed commit below instead of executing a moving branch tip.
The crawler can fetch and process external websites, so review crawl targets, rate limits, robots rules, and site terms before crawling.
The backend and crawler use a Crawl4AI API token; replace the demo token before shared or production use.
The MCP container mounts generated Markdown and logs, and its tools can read, search, sync, and expose that content to the MCP client.
Local services are exposed on development ports by the Docker stack; do not expose them on untrusted networks without authentication and network controls.
✓The MCP server sends Claude's retrieval queries to the Agentset API using the configured API key and namespace.
The `knowledge-base-retrieve` tool can return up to 100 results per call and can rerank results by relevance.
Namespace and tenant selection control which indexed documents are searchable; review them before connecting a shared agent.
API keys should be scoped, rotated, and stored only in the MCP server environment or a secret manager.
Custom tool descriptions can influence when the model calls the retrieval tool, so review them before use in production workflows.
✓ChunkHound reads source files, Markdown, text, PDFs, and supported config files under the target directory and stores indexed chunks in a local database.
Realtime indexing and daemon mode can continue watching project files after the initial MCP connection.
Code research and web search tools require embedding, reranking, and LLM configuration and may invoke local CLIs or external model APIs depending on settings.
Exclude generated files, vendored dependencies, secrets, large artifacts, and unrelated repositories before indexing broad workspace roots.
Review MCP client configuration carefully when using an absolute project path in a global Claude Desktop config.
✓CodeDB indexes local projects and exposes file tree, outline, search, symbol, caller, dependency, read, snapshot, project, and context tools to the MCP client.
CodeDB's `codedb_edit` tool exists as a fallback editing tool and can create, replace, insert, delete, or modify files when used by a client without native edit tooling.
The npm package runs a postinstall step that downloads a native binary from GitHub Releases; review package and release provenance in environments that restrict native binaries.
Remote repo queries use the public `api.wiki.codes` service and should be treated as network access outside the local repository.
The upstream README marks the project as alpha software, with parser coverage and snapshot formats still stabilizing.
Privacy notes
✓Crawled pages, generated Markdown, JSON metadata, source URLs, tags, search queries, local logs, and MCP tool outputs may contain proprietary documentation, customer data, internal architecture, or third-party website content.
The Markdown MCP server can reveal full document text, section contents, table of contents, metadata, and search snippets to the connected model provider.
Logs, crawl results, mounted volumes, and container transcripts can retain documentation-derived content after an MCP session ends.
Optional LLM-related Crawl4AI environment variables can route documentation-derived content to external model providers if configured.
Keep storage directories, crawl outputs, API tokens, and generated documentation artifacts out of public repositories unless publication is explicitly approved.
✓Retrieved chunks can include private documents, product specs, policies, support content, internal procedures, historical project information, or customer-specific data.
Retrieval queries, namespace IDs, tenant IDs, document chunks, citations, and tool outputs may be visible to the MCP client, model provider, Agentset logs, and application telemetry.
Tenant IDs are useful for data segregation, but incorrect tenant or namespace configuration can expose the wrong knowledge base.
Do not paste API keys, namespace IDs, tenant IDs, or retrieved private chunks into shared issue reports, screenshots, or repository files.
✓Indexed chunks, file paths, symbols, comments, Markdown, PDFs, configuration values, database files, daemon state, and search results can reveal proprietary source code and internal architecture.
Embedding, reranking, LLM, and web search providers may receive code-derived queries or snippets if configured.
Local ChunkHound database files, logs, daemon state, and MCP transcripts may retain code-derived context after the session ends.
Avoid sharing ChunkHound databases, config files with API keys, verbose logs, research outputs, and screenshots from private repositories.
✓Local indexes, snapshots, file trees, symbol names, dependency graphs, snippets, read results, and search results can reveal proprietary code structure and implementation details.
Upstream documents sensitive-file blocking for patterns such as environment files, credentials, and keys, but users should still review ignore rules and avoid indexing secret-heavy directories.
CodeDB writes telemetry to `~/.codedb/telemetry.ndjson` unless `CODEDB_NO_TELEMETRY=1` is set, then syncs aggregate tool counts, latency, startup, file count, line count, language, version, and platform data on MCP session close.
Upstream telemetry docs state that source code, file contents, file paths, and search queries are not collected.
Remote public-repo queries and local MCP responses may still be logged by MCP clients, model providers, and terminal history.
Prerequisites
Docker and Docker Compose available on the host that will run DevDocs.
Git access to clone the DevDocs repository and check out reviewed commit `9845479d0aeb7523abaab85723d0dfcf832fe1d3` before running the Docker startup script.
MCP client support for launching stdio servers through `docker exec -i`.
Documentation URLs reviewed for crawling permissions, robots rules, and terms of service.
Agentset account or self-hosted Agentset deployment with a populated namespace.
Agentset API key with access to the namespace Claude should query.
Node.js 18.17 or newer for running the `@agentset/mcp` package.
Namespace ID selected with `--ns` or `AGENTSET_NAMESPACE_ID`.
Python 3.10 or newer and the `uv` package manager.
A local repository or workspace you are authorized to index.
ChunkHound JSON config reviewed for database path, excludes, embeddings, and LLM provider settings.
Optional embedding provider credentials for semantic search, or regex-only usage when no embedding key is configured.
macOS or Linux on x64 or arm64 for the published native binary launcher.
Node.js 18 or newer when using the `codedeebee` npm launcher.
A local project directory that the MCP client exposes through roots or launches from.
Review of which local repositories, file types, generated artifacts, and secrets patterns may be indexed.
Install
Clone the DevDocs repository, check out reviewed commit 9845479d0aeb7523abaab85723d0dfcf832fe1d3, run the Docker start script from that pinned revision, then configure Claude to call the `devdocs-mcp` container with `docker exec -i`.
Run `npx @agentset/mcp --ns <namespace-id>` with `AGENTSET_API_KEY` set in the MCP server environment.