skill

website-scraping

Generic playbook for extracting structured data from any website — hotel prices, flight fares, e-commerce listings, real estate, jobs, competitor product catalogues, anything where the goal is to turn one or more URLs into clean records on disk. Use this skill whenever the user mentions scraping, harvesting, extracting, or pulling data from a website; names a specific site or competitor they want data from; asks how to handle JavaScript-rendered pages, Cloudflare blocks, bot detection, Turnstile challenges, or Playwright; wants to monitor prices over time; needs to automate a copy-paste research task; or says things like "just get the data from X" or "I need a script that grabs N from site Y". Covers recon, picking the lightest extraction tool that works, surviving anti-bot defences, and writing clean JSONL output with a run manifest. Scope is scraping only — landing data in a database, scheduling, and downstream pipeline work are explicitly out of scope and live in other tools.

Description as published by the maintainer. Source

• active

active — Most recent push to the repository was 2026-07-27.

Signals

These are separate measurements of different things. They are deliberately not combined into one score, because a popularity number that mixes website traffic with saves and stars cannot be checked or acted on.

Will this work with your setup?

No harness stated by the author and no install path convention detected. Compatibility is untested.

We have not run this skill against a task with and without it enabled, so we cannot tell you whether it improves anything, what it costs in tokens, or whether it duplicates behaviour your harness already has. When we have run that test, the result will appear on this page with the task, the versions and the budget it used.

The skill definition lives at web-scraping/website-scraping/SKILL.md in https://github.com/moonlight-lupin/agent-skills.

Where to get it

• Repository — https://github.com/moonlight-lupin/agent-skills

Also from moonlight-lupin

• moonlight-lupin-agent-skills-claude-plugin-converter — last commit 2026-07-27
  Convert Claude Code plugins into self-contained Hermes plugins — discovery analysis then full conversion
• moonlight-lupin-agent-skills-decision-log — last commit 2026-07-27
  ADR-style decision journal for agents and teams. Create numbered decision records, track superseding chains, schedule p…
• moonlight-lupin-agent-skills-document-converter — last commit 2026-07-27
  Convert between document formats: Markdown↔HTML, CSV↔JSON, YAML↔TOML, JSON↔YAML, CSV↔Markdown table, HTML→plain text, J…
• moonlight-lupin-agent-skills-fact-checker — last commit 2026-07-27
  Targeted claim verification pipeline. Given a factual assertion, search multiple independent sources, cross-check for a…
• moonlight-lupin-agent-skills-file-organizer — last commit 2026-07-27
  Use when the user wants to organize, tidy, or restructure a messy directory (Downloads, Desktop, documents folder). LLM…
• moonlight-lupin-agent-skills-library-rag — last commit 2026-07-27
  Semantic search over a personal library using bge-m3 embeddings + sqlite-vec. Index books, documents, any text corpus;…
• moonlight-lupin-agent-skills-log-analyzer — last commit 2026-07-27
  Parse agent log files to identify error patterns, rate limit hits, timeout clusters, tool failures, and component-level…
• moonlight-lupin-agent-skills-media-analyzer — last commit 2026-07-27
  Technique-focused media analysis. Detects rhetorical tools (loaded language, cherry-picking, source selection bias, fra…
• moonlight-lupin-agent-skills-news-monitoring — last commit 2026-07-27
  Recurring topic/news monitoring with web search, multi-language sources, digest formatting, and automated delivery via…
• moonlight-lupin-agent-skills-scheduled-summary — last commit 2026-07-27
  Cron-driven cross-session digest. Aggregates session activity, cron job outputs, memory changes, and tool usage stats i…