Port details |
- py-cloudscraper Python module to bypass Cloudflare's anti-bot page
- 1.2.71 net =2 1.2.71Version of this port present on the latest quarterly branch.
- Maintainer: tcberner@FreeBSD.org
- Port Added: 2019-12-07 18:26:41
- Last Update: 2023-06-27 19:34:34
- Commit Hash: 3d9a815
- People watching this port, also watch:: jdictionary, py311-Automat, py311-python-gdsii, py39-PyOpenGL, p5-Sane
- Also Listed In: python
- License: MIT
- WWW:
- https://pypi.org/project/cloudscraper/
- Description:
- A simple Python module to bypass Cloudflare's anti-bot page (also known as "I'm
Under Attack Mode", or IUAM), implemented with Requests. Cloudflare changes
their techniques periodically, so I will update this repo frequently.
This can be useful if you wish to scrape or crawl a website protected with
Cloudflare. Cloudflare's anti-bot page currently just checks if the client
supports Javascript, though they may add additional techniques in the future.
Due to Cloudflare continually changing and hardening their protection page,
cloudscraper requires a JavaScript Engine/interpreter to solve Javascript
challenges. This allows the script to easily impersonate a regular web browser
without explicitly deobfuscating and parsing Cloudflare's Javascript.
- ¦ ¦ ¦ ¦
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - There is no configure plist information for this port.
- Dependency lines:
-
- ${PYTHON_PKGNAMEPREFIX}cloudscraper>0:net/py-cloudscraper@${PY_FLAVOR}
- Conflicts:
- CONFLICTS_INSTALL:
- py39-cloudflare-scrape-1.*
- To install the port:
- cd /usr/ports/net/py-cloudscraper/ && make install clean
- To add the package, run one of these commands:
- pkg install net/py-cloudscraper
- pkg install py39-cloudscraper
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above. NOTE: This is a Python port. Instead of py39-cloudscraper listed in the above command, you can pick from the names under the Packages section.- PKGNAME: py39-cloudscraper
- Package flavors (<flavor>: <package>)
- distinfo:
- TIMESTAMP = 1682740096
SHA256 (cloudscraper-1.2.71.tar.gz) = 429c6e8aa6916d5bad5c8a5eac50f3ea53c9ac22616f6cb21b18dcc71517d0d3
SIZE (cloudscraper-1.2.71.tar.gz) = 93261
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- py39-setuptools>=63.1.0 : devel/py-setuptools@py39
- python3.9 : lang/python39
- Test dependencies:
-
- python3.9 : lang/python39
- Runtime dependencies:
-
- py39-openssl>17.0 : security/py-openssl@py39
- py39-requests>0 : www/py-requests@py39
- py39-Js2Py>0 : devel/py-Js2Py@py39
- py39-requests-toolbelt>0 : www/py-requests-toolbelt@py39
- py39-brotli>0 : archivers/py-brotli@py39
- py39-setuptools>=63.1.0 : devel/py-setuptools@py39
- python3.9 : lang/python39
- There are no ports dependent upon this port
Configuration Options:
- No options to configure
- Options name:
- net_py-cloudscraper
- USES:
- python
- FreshPorts was unable to extract/find any pkg message
- Master Sites:
|
Commit History - (may be incomplete: for full details, see links to repositories near top of page) |
Commit | Credits | Log message |
1.2.71 27 Jun 2023 19:34:34 |
Rene Ladan (rene) |
all: remove explicit versions in USES=python for "3.x+"
The logic in USES=python will automatically convert this to 3.8+ by
itself.
Adjust two ports that only had Python 3.7 mentioned but build fine
on Python 3.8 too.
finance/quickfix: mark BROKEN with PYTHON
libtool: compile: c++ -DHAVE_CONFIG_H -I. -I../.. -I -I. -I.. -I../.. -I../C++
-DLIBICONV_PLUG -DPYTHON_MAJOR_VERSION=3 -Wno-unused-variable
-Wno-maybe-uninitialized -O2 -pipe -DLIBICONV_PLUG -fstack-protector-strong
-fno-strict-aliasing -DLIBICONV_PLUG -Wall -ansi
-Wno-unused-command-line-argument -Wpointer-arith -Wwrite-strings
-Wno-overloaded-virtual -Wno-deprecated-declarations -Wno-deprecated -std=c++0x
-MT _quickfix_la-QuickfixPython.lo -MD -MP -MF
.deps/_quickfix_la-QuickfixPython.Tpo -c QuickfixPython.cpp -fPIC -DPIC -o
.libs/_quickfix_la-QuickfixPython.o
warning: unknown warning option '-Wno-maybe-uninitialized'; did you mean
'-Wno-uninitialized'? [-Wunknown-warning-option]
QuickfixPython.cpp:175:11: fatal error: 'Python.h' file not found
^~~~~~~~~~
1 warning and 1 error generated.
Reviewed by: portmgr, vishwin, yuri
Differential Revision: <https://reviews.freebsd.org/D40568> |
1.2.71 29 Apr 2023 03:50:36 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.71 |
1.2.69 25 Feb 2023 15:29:44 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.69 |
1.2.68 11 Jan 2023 15:58:34 |
Dmitry Marakasov (amdmi3) |
*/*: rename CHEESESHOP to PYPI in MASTER_SITES
PR: 267994
Differential revision: D37518
Approved by: bapt |
1.2.68 10 Jan 2023 08:58:51 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.68 |
1.2.67 09 Jan 2023 16:56:08 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.67 |
1.2.66 23 Nov 2022 15:28:49 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.66 |
1.2.65 10 Nov 2022 15:09:11 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.65 |
07 Sep 2022 21:58:51 |
Stefan Eßer (se) |
Remove WWW entries moved into port Makefiles
Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.
This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.
Approved by: portmgr (tcberner) |
1.2.64 07 Sep 2022 21:10:59 |
Stefan Eßer (se) |
Add WWW entries to port Makefiles
It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.
Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.
There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.
(Only the first 15 lines of the commit message are shown above ) |
1.2.64 31 Aug 2022 07:07:51 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.64 |
1.2.63 30 Aug 2022 10:37:52 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.63 |
1.2.62 29 Aug 2022 10:58:24 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.62 |
1.2.60 15 Mar 2022 17:10:08 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.60 |
1.2.58 16 Apr 2021 08:46:44 |
Tobias C. Berner (tcberner) |
net/py-cloudscraper: update to 1.2.58 |
1.2.56 07 Apr 2021 08:09:01 |
Mathieu Arnold (mat) |
One more small cleanup, forgotten yesterday.
Reported by: lwhsu |
1.2.56 06 Apr 2021 14:31:07 |
Mathieu Arnold (mat) |
Remove # $FreeBSD$ from Makefiles. |
1.2.56 14 Feb 2021 07:59:50 |
tcberner |
net/py-cloudscraper: update to 1.2.56 |
1.2.54 30 Jan 2021 18:54:30 |
tcberner |
net/py-cloudscraper: update to 1.2.54 |
1.2.52 07 Jan 2021 19:43:57 |
tcberner |
net/py-cloudscraper: update to 1.2.52 |
1.2.50 28 Dec 2020 23:02:15 |
antoine |
Drop python 2.7 support from a few ports
With hat: portmgr |
1.2.50 22 Dec 2020 18:22:39 |
tcberner |
net/py-cloudscraper: update to 1.2.50 |
1.2.48 10 Nov 2020 05:55:31 |
tcberner |
net/py-cloudscraper: update to 1.2.48 |
1.2.46 29 Jul 2020 13:37:09 |
tcberner |
net/py-cloudscraper: update to 1.2.46 |
1.2.44 26 Jul 2020 14:49:02 |
tcberner |
net/py-cloudscraper: update to 1.2.44 |
1.2.42 03 Jul 2020 07:03:20 |
tcberner |
net/py-cloudscraper: update pkg-descr's WWW |
1.2.42 03 Jul 2020 07:02:42 |
tcberner |
net/py-cloudscraper: update to 1.2.42
- switch away from github (404) |
1.2.38 16 Jun 2020 17:35:05 |
tcberner |
net/py-cloudscraper: update to 1.2.38 |
1.2.36 13 May 2020 13:05:39 |
tcberner |
net/py-cloudscraper: update to 1.2.36 |
1.2.34 22 Apr 2020 19:14:48 |
tcberner |
net/py-cloudscraper: update to 1.2.34 |
1.2.32 03 Apr 2020 21:20:50 |
tcberner |
net/py-cloudscraper: update to 1.2.32 |
1.2.30 21 Mar 2020 09:00:39 |
tcberner |
net/py-cloudscraper: update to 1.2.30 |
1.2.28 12 Mar 2020 17:52:22 |
tcberner |
net/py-cloudscraper: update to 1.2.28 |
1.2.26 05 Mar 2020 20:05:18 |
tcberner |
net/py-cloudscraper: update to 1.2.26 |
1.2.24 21 Feb 2020 17:28:57 |
tcberner |
net/py-cloudscraper: update to 1.2.24 |
1.2.23 15 Feb 2020 18:36:17 |
tcberner |
net/py-cloudscraper: update to 1.2.23 |
1.2.22 14 Feb 2020 19:49:49 |
tcberner |
net/py-cloudscraper: update to 1.2.22 |
1.2.20 17 Jan 2020 07:11:49 |
tcberner |
net/py-cloudscraper: update to 1.2.20 |
1.2.18 31 Dec 2019 18:24:47 |
tcberner |
net/py-cloudscraper: update to 1.2.18 |
1.2.16 13 Dec 2019 17:28:09 |
tcberner |
net/py-cloudscraper: update to 1.2.16 |
1.2.9 07 Dec 2019 18:26:36 |
tcberner |
net/py-cloudscraper: Python module to bypass Cloudflare's anti-bot page |