scraper — independent software & tools

24 independent scraper listings the big search engines bury.

• ohara2

  github · Free · by hashamcomp-tech

  Self-hosted personal library for scraped web novels — read online or offline, no ads, no tracking.

• apify

  npm · Free · by GitHub Actions

  The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify-client

  npm · Free · by GitHub Actions

  Apify API client for JavaScript

• @crawlee/core

  npm · Free · by GitHub Actions

  The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• domparser-rs

  npm · Free · by xusd320

  A super fast html parser and manipulator written in rust.

• firecrawl-cli

  npm · Free · by GitHub Actions

  Command-line interface for Firecrawl. Scrape, crawl, and extract data from any website directly from your terminal.

• google-news-url-decoder

  npm · Free · by zindont

  A Node.js library to decode Google News URLs to their original source URLs.

• google-play-scraper

  npm · Free · by facundoolano

  scrapes app data from google play store

• @mendable/firecrawl-js

  npm · Free · by hello_sideguide

  JavaScript SDK for Firecrawl API

• openbrand

  npm · Free · by ethanjyx

  Extract brand assets (logos, colors, backdrops) from any website URL

• tiktok-live-connector

  npm · Free · by GitHub Actions

  Node.js library to receive live stream chat events like comments and gifts from TikTok LIVE.

• twitter-openapi-typescript

  npm · Free · by fa0311

  Implementation of Twitter internal API in TypeScript

• url-metadata

  npm · Free · by laurengarcia

  Fetch a URL and scrape its metadata using Node.js or the browser. Can parse metadata from HTML strings or Response objects as well.

• @vreden/youtube_scraper

  npm · Free · by vredenofficiall

  A simple YouTube video downloader for audio and video formats with resolusi and quality.

• Fentry-AutoCrate

  github · Free · by brittojo7n

  This is a pre-configured script with GitHub Actions workflow to automatically claim the "Regular Crate" on fentry

• Discord-Joiner-Token-Scraper

  github · Free · by romulusharish

  🤖 Automate Discord server joins using user tokens, streamlining bulk invitations while providing structured responses for each token processed.

• API-Header-Spoofer

  github · Free · by tensei3san

• app-store-scraper

  npm · Free · by facundoolano

  scrape data from the itunes app store

• @bochilteam/scraper

  npm · Free · by bochilgaming

  Browserless scraper module

• cheerio

  npm · Free · by feedic

  The fast, flexible & elegant library for parsing and manipulating HTML and XML.

• htmlmetaparser

  npm · Free · by blakeembrey

  A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and AppLinks.

• robots-parser

  npm · Free · by samclarke

  A specification compliant robots.txt parser with wildcard (*) matching support.

• unfurl.js

  npm · Free · by jacktuck

  Scraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based

• website-scraper

  npm · Free · by GitHub Actions

  Download website to a local directory (including all css, images, js, etc.)