Skip to main content

Browse the directory

Showing 2 resources for "crawler"
Saved
Active

Source-backed filter active — add entries to compare trust side by side.

Rollout signal scan

2 rollout risk signals in current results

Biggest gaps: metadata review, package integrity. 0 entries have 2+ required gaps.

2 scanned

Install payload

Install payload is mixed and needs spot-checking.

watch

50% (1/2)

Adoption queue

Browse adoption queue · balanced

1/2 visible results are in hold tier and need mitigation before adoption.

ready 0caution 1hold 1

DevDocs MCP Server

1 blockers: Metadata review

caution

50/100

Request metadata review from maintainers or internal owners.

Collect package checksum or signed artifact information.

mcp/devdocs-mcp-server · trust review · confidence 67%

Crawl4AI

2 blockers: Metadata review, Install payload

hold

36/100

Request metadata review from maintainers or internal owners.

Add install/config payload for reproducible team rollout.

Collect package checksum or signed artifact information.

tools/crawl4ai · trust review · confidence 50%

Decision confidence

Decision confidence scan · balanced

1/2 results are low-confidence and need review before adoption.

high 0medium 1low 1

DevDocs MCP Server

Address Metadata review, Package integrity before broader rollout.

medium

54/100

Missing: Metadata reviewMissing: Package integrity

mcp/devdocs-mcp-server · trust review

Crawl4AI

Hold adoption until Metadata review, Package integrity are resolved.

low

36/100

Missing: Metadata reviewMissing: Package integrityMissing: Install payload

tools/crawl4ai · trust review

Freshness distribution

Current results are broadly fresh

Median age 36 days; all 2 scanned entries are within 90 days.

median 36d

Aging

91–180 days

0%

0 entries

Stale

> 180 days

0%

0 entries

Crawl4AI logo
Crawl4AIby unclecode · submitted by davion-knight

Open-source, LLM-friendly Python web crawler and scraper that turns web pages into clean, LLM-ready Markdown for RAG, agents, and data pipelines, with an async browser pool, caching, structured extraction, and adaptive deep crawling.

Self-hosted documentation crawler and Markdown MCP server that lets Claude query crawled technical documentation, list files, read sections, search content, inspect metadata, and keep generated Markdown in sync.