notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Want a good monitor light? See my photosAll times are UTC
Ukraine
Port details
webcrawl Download web sites without user interaction by following links
1.10_2 www on this many watch lists=9 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 1.10_2Version of this port present on the latest quarterly branch.
Maintainer: demon@FreeBSD.org search for ports maintained by this maintainer
Port Added: unknown
Last Update: 2024-01-11 13:59:36
Commit Hash: 7074d7f
People watching this port, also watch:: webmin, tripwire, wget, xinetd, nmap
License: not specified in port
Description:
WebCrawl is a program designed to download an entire web-site without user interaction (although an interactive mode is available). It works simply by starting with a single web page, and following all links from that page to attempt to recreate the directory structure on the remote server.
cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
Expand this list (2 items)
Collapse this list.
  1. bin/webcrawl
  2. share/man/man1/webcrawl.1.gz
Collapse this list.
Dependency lines:
  • webcrawl>0:www/webcrawl
To install the port:
cd /usr/ports/www/webcrawl/ && make install clean
To add the package, run one of these commands:
  • pkg install www/webcrawl
  • pkg install webcrawl
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: webcrawl
Flavors: there is no flavor information for this port.
distinfo:
SHA256 (webcrawl-1.10.tgz) = f0bdac391c0f2a87d9db100232ad8aff5d3c10bc32e06880c9ee69cbbd3b4a79 SIZE (webcrawl-1.10.tgz) = 18890

Packages (timestamps in pop-ups are UTC):
webcrawl
ABIaarch64amd64armv6armv7i386powerpcpowerpc64powerpc64le
FreeBSD:13:latest1.10_21.10_2-1.10_21.10_2---
FreeBSD:13:quarterly1.10_21.10_21.10_11.10_21.10_21.10_11.10_11.10_1
FreeBSD:14:latest1.10_21.10_21.10_11.10_21.10_21.10_1-1.10_1
FreeBSD:14:quarterly1.10_21.10_2-1.10_21.10_21.10_11.10_11.10_1
FreeBSD:15:latest1.10_21.10_2n/a1.10_2n/a1.10_21.10_21.10_2
This port has no dependencies.
There are no ports dependent upon this port

Configuration Options:
No options to configure
Options name:
www_webcrawl
USES:
tar:tgz
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (4 items)
Collapse this list.
  1. ftp://ftp.icm.edu.pl/pub/Linux/sunsite/apps/www/mirroring/
  2. ftp://ftp.sun.ac.za/pub/mirrors/sunsite.unc.edu/pub/Linux/apps/www/mirroring/
  3. http://www.gtlib.gatech.edu/pub/Linux/apps/www/mirroring/
  4. https://www.ibiblio.org/pub/Linux/apps/www/mirroring/
Collapse this list.

Number of commits found: 19

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
1.10_2
11 Jan 2024 13:59:36
commit hash: 7074d7f6aec43269666bcbbfd162d977b7c64277commit hash: 7074d7f6aec43269666bcbbfd162d977b7c64277commit hash: 7074d7f6aec43269666bcbbfd162d977b7c64277commit hash: 7074d7f6aec43269666bcbbfd162d977b7c64277 files touched by this commit
Baptiste Daroussin (bapt) search for other commits by this committer
MANPREFIX: eliminate usage of MANPREFIX

While here move some manpages to share/man
1.10_1
20 Jul 2022 14:23:26
commit hash: e915e756715f12e5e0e46993b1265f44690b4a90commit hash: e915e756715f12e5e0e46993b1265f44690b4a90commit hash: e915e756715f12e5e0e46993b1265f44690b4a90commit hash: e915e756715f12e5e0e46993b1265f44690b4a90 files touched by this commit
Tobias C. Berner (tcberner) search for other commits by this committer
www: remove 'Created by' lines

A big Thank You to the original contributors of these ports:

  *
  *  <hvo.pm@xs4all.nl>
  *  Aaron Dalton <aaron@FreeBSD.org>
  *  Aaron Dalton <aaron@daltons.ca>
  *  Aaron LI <aly@aaronly.me>
  *  Aaron Zauner <az_mail@gmx.at>
  *  Abel Chow <achow@transoft.net>
  *  Adam Weinberger <adamw@FreeBSD.org>
  *  Ade Lovett <ade@FreeBSD.org>
  *  Adrian Steinmann <ast@marabu.ch>
  *  Akinori MUSHA aka knu <knu@idaemons.org>
(Only the first 15 lines of the commit message are shown above View all of this commit message)
1.10_1
06 Apr 2021 14:31:07
commit hash: 305f148f482daf30dcf728039d03d019f88344ebcommit hash: 305f148f482daf30dcf728039d03d019f88344ebcommit hash: 305f148f482daf30dcf728039d03d019f88344ebcommit hash: 305f148f482daf30dcf728039d03d019f88344eb files touched by this commit
Mathieu Arnold (mat) search for other commits by this committer
Remove # $FreeBSD$ from Makefiles.
1.10_1
18 Feb 2021 21:29:41
Revision:565993Original commit files touched by this commit
demon search for other commits by this committer
Unbreak build with clang11.
1.10_1
18 Feb 2021 06:45:33
Revision:565904Original commit files touched by this commit
linimon search for other commits by this committer
Mark BROKEN in 13/14 (via latest llvm update).
1.10_1
14 May 2015 10:15:09
Revision:386312Original commit files touched by this commit
mat search for other commits by this committer
MASTER_SITES cleanup.

- Replace ${MASTER_SITE_FOO} with FOO.
- Merge MASTER_SITE_SUBDIR into MASTER_SITES when possible. (This means 99.9%
  of the time.)
- Remove occurrences of MASTER_SITE_LOCAL when no subdirectory was present and
  no hint of what it should be was present.
- Fix some logic.
- And generally, make things more simple and easy to understand.

While there, add magic values to the FESTIVAL, GENTOO, GIMP, GNUPG, QT and
SAMBA macros.

Also, replace some EXTRACT_SUFX occurences with USES=tar:*.

Checked by:	make fetch-urlall-list
With hat:	portmgr
Sponsored by:	Absolight
1.10_1
29 Jul 2014 15:49:47
Revision:363346Original commit files touched by this commit
adamw search for other commits by this committer
Rename www/ patch-xy patches to reflect the files they modify.
1.10_1
13 Mar 2014 14:57:17
Revision:348079Original commit files touched by this commit
ehaupt search for other commits by this committer
Support staging
1.10_1
20 Sep 2013 23:36:54
Revision:327776Original commit files touched by this commit
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
www)
1.10_1
24 Oct 2011 09:11:38
Original commit files touched by this commit
dougb search for other commits by this committer
The vast majority of pkg-descr files had the following format when they
had both lines:

Author: ...
WWW: ....

So standardize on that, and move them to the end of the file when necessary.

Also fix some more whitespace, and remove more "signature tags" of varying
forms, like -- name, etc.

s/AUTHOR/Author/

A few other various formatting issues
1.10_1
19 Mar 2011 12:38:54
Original commit files touched by this commit
miwi search for other commits by this committer
- Get Rid MD5 support
1.10_1
24 Jan 2006 03:14:23
Original commit files touched by this commit
edwin search for other commits by this committer
SHA256ify

Approved by: krion@
1.10_1
18 Mar 2004 18:01:13
Original commit files touched by this commit
trevor search for other commits by this committer
Add size data, approved by maintainers.
1.10_1
06 Feb 2004 13:12:53
Original commit files touched by this commit
trevor search for other commits by this committer
Use PLIST_FILES (bento-tested, marcus-reviewed).
1.10_1
07 Mar 2003 06:12:57
Original commit files touched by this commit
ade search for other commits by this committer
Clear moonlight beckons.
Requiem mors pacem pkg-comment,
And be calm ports tree.

E Nomini Patri, E Fili, E Spiritu Sancti.
08 Nov 2001 06:48:32
commit hash: fp1.20618@dev.null.freshports.orgcommit hash: fp1.20618@dev.null.freshports.orgcommit hash: fp1.20618@dev.null.freshports.orgcommit hash: fp1.20618@dev.null.freshports.org files touched by this commit
demon search for other commits by this committer
Add support for virtual hosts.    
05 Feb 2001 15:33:58
commit hash: fp1.9243@dev.null.freshports.orgcommit hash: fp1.9243@dev.null.freshports.orgcommit hash: fp1.9243@dev.null.freshports.orgcommit hash: fp1.9243@dev.null.freshports.org files touched by this commit
olgeni search for other commits by this committer
Some spaces -> tabs for ports/www.    
13 Nov 2000 12:45:41
commit hash: fp1.6372@dev.null.freshports.orgcommit hash: fp1.6372@dev.null.freshports.orgcommit hash: fp1.6372@dev.null.freshports.orgcommit hash: fp1.6372@dev.null.freshports.org files touched by this commit
demon search for other commits by this committer
Change MAINTAINER field.   I am now at FreeBSD dot org    
08 Oct 2000 08:11:25
commit hash: fp1.4827@dev.null.freshports.orgcommit hash: fp1.4827@dev.null.freshports.orgcommit hash: fp1.4827@dev.null.freshports.orgcommit hash: fp1.4827@dev.null.freshports.org files touched by this commit
asami search for other commits by this committer
Convert category www to new layout.  

Number of commits found: 19