Show HN: PyScrappy, self-healing web scraping selectors plus an MCP server
19 points - yesterday at 7:46 AM
Sourcerhythmshahriar
yesterday at 5:29 PM
does the inmemory cache has a max size to eviction policy, or will a long running mcp server with cache_ttl enabled accumulate entries indefinitely until process restart?
vedaant00
yesterday at 11:20 PM
Good question. PyScrappy's shared response cache is LRU-bounded with a configurable max size (cache_max_size, default 512), so it won't grow indefinitely even for a long-running MCP server hitting many distinct URLs. Oldest entries are evicted at the cap, expired ones are dropped on access, and reads promote to most-recently-used, so it stays bounded regardless of access pattern. Just shipped this in the latest release.
kunaaldhawan1
yesterday at 8:03 PM
[flagged]
bloody_hopes
yesterday at 8:24 PM
[flagged]