r/pythoncoding • • Jul 11 '23

Hrequests: An elegant webscraping library

Hrequests is a powerful yet elegant webscraping and automation library.

Features

  • Single interface for HTTP and headless browsing

  • Integrated fast HTML parser

  • High performance concurrency without using threading

  • Automatic generation of browser-like headers

  • Supports HTTP/2

  • Replication of browser TLS fingerprints

  • JSON serializing up to 10x faster than the standard library

  • Minimal depedence on the python standard libraries

💻 Browser crawling

  • Simple, uncomplicated browser automation

  • Human-like cursor movement and typing

  • JavaScript rendering and screenshots

  • Headless and headful support

  • No CORS

  • Coming soon: Hcaptcha solver

No performance loss compared to requests. Absolutely no tradeoffs. Runs 100% threadsafe.

Hrequests is a simple, configurable, feature-rich, replacement for the requests library.

I'm aiming to make webscraping as simple as possible while transparently handling the annoying end.

Feel free to take a look. Any support would mean a lot ❤️ https://github.com/daijro/hrequests

5 Upvotes

3 comments sorted by

1

u/audentis Jul 11 '23

Looks good! Regular requests is pretty barebones.

1

u/xbt_ Feb 04 '25

Hi, is it possible to do x,y coordinate clicks or keyboard presses with this? I haven't seen it's possible.

1

u/sunnyinchernobyl Jul 11 '23

Your timing is impeccable. I’ve just started looking into this :)