Contrib.social

Add Link to Link scraper

Open on Drupal.org →
Created on 14 May 2024, 6 months ago
Updated 29 May 2024, 6 months ago

Problem/Motivation

Right now you can only scrape one page, it would be cool to be able to scrape a whole page structure.

Proposed resolution

Make the following options available outside of the normal Scrapingbot stuff:
Depth
Include Source URL
Host Only
Body Only
Exclude Pages
Types to Scrape (incl Other Types)

If it runs in batch mode, run the actual scrapes in batch mode.

✨ Feature request
Status

Fixed

Version

1.0

Component

Code

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024