/oss · 2 merged

D4Vinci/Scrapling

A Python framework for web scraping, from a single request to a full crawl.

the project on GitHub (opens in a new tab)
  1. 4 Nov 2026

    Pasted curl commands with the redirect flag now convert

    What was broken
    Scrapling can turn a curl command into its own request. Commands with the common flag for following redirects were refused with an error.
    What I changed
    The flag is now accepted. Requests already follow redirects, so nothing else changes.
    Why it matters
    Curl commands copied from docs or a browser work without editing.

    see the code, #554 (opens in a new tab)

  2. 4 Nov 2026

    XPath questions that return a single value now work

    What was broken
    Scrapling pulls data from web pages with XPath. Asking for one value, like the text of a heading or a count of items, crashed instead of answering.
    What I changed
    The value now comes back the normal way, including an empty text or a zero.
    Why it matters
    Scripts can read text and count items in one query, with the same answers as the parsel library.

    see the code, #552 (opens in a new tab)

← every project