notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)

Why was the website so slow for so long?

The cause of the slowdown was a change to the ZFS dataset. In conjunction with the database server, very little caching was being done. This combination resulted in increased disk I/O as the system churned through the database. Details in the blog post which outlines the various things which changed. Many graphs.

Port details
webcrawl Download web sites without user interaction by following links
1.10_1 www on this many watch lists=7 search for ports that depend on this port Find issues related to this port Report an issue related to this port 1.10Version of this port present on the latest quarterly branch.
Maintainer: demon@FreeBSD.org search for ports maintained by this maintainer
Port Added: unknown
Last Update: 2015-05-14 11:15:09
SVN Revision: 386312
License: not specified in port
Description:
SVNWeb
pkg-plist: as obtained via: make generate-plist
Expand this list (2 items)
  1. bin/webcrawl
  2. man/man1/webcrawl.1.gz
Collapse this list.
Dependency lines:
  • webcrawl>0:www/webcrawl
To install the port: cd /usr/ports/www/webcrawl/ && make install clean
To add the package: pkg install webcrawl
PKGNAME: webcrawl
Flavors: there is no flavor information for this port.
distinfo:

There are no ports dependent upon this port

Configuration Options

USES:

Master Sites:
  1. ftp://ftp.icm.edu.pl/pub/Linux/sunsite/apps/www/mirroring/
  2. ftp://ftp.sun.ac.za/pub/mirrors/sunsite.unc.edu/pub/Linux/apps/www/mirroring/
  3. http://www.gtlib.gatech.edu/pub/Linux/apps/www/mirroring/
  4. http://www.ibiblio.org/pub/Linux/apps/www/mirroring/

Number of commits found: 14

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
14 May 2015 10:15:09
Original commit files touched by this commit  1.10_1
Revision:386312
mat search for other commits by this committer
MASTER_SITES cleanup.

- Replace ${MASTER_SITE_FOO} with FOO.
- Merge MASTER_SITE_SUBDIR into MASTER_SITES when possible. (This means 99.9%
  of the time.)
- Remove occurrences of MASTER_SITE_LOCAL when no subdirectory was present and
  no hint of what it should be was present.
- Fix some logic.
- And generally, make things more simple and easy to understand.

While there, add magic values to the FESTIVAL, GENTOO, GIMP, GNUPG, QT and
SAMBA macros.

Also, replace some EXTRACT_SUFX occurences with USES=tar:*.

Checked by:	make fetch-urlall-list
With hat:	portmgr
Sponsored by:	Absolight
29 Jul 2014 15:49:47
Original commit files touched by this commit  1.10_1
Revision:363346
adamw search for other commits by this committer
Rename www/ patch-xy patches to reflect the files they modify.
13 Mar 2014 14:57:17
Original commit files touched by this commit  1.10_1
Revision:348079
ehaupt search for other commits by this committer
Support staging
20 Sep 2013 23:36:54
Original commit files touched by this commit  1.10_1
Revision:327776
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
www)
24 Oct 2011 09:11:38
Original commit files touched by this commit  1.10_1

dougb search for other commits by this committer
The vast majority of pkg-descr files had the following format when they
had both lines:

Author: ...
WWW: ....

So standardize on that, and move them to the end of the file when necessary.

Also fix some more whitespace, and remove more "signature tags" of varying
forms, like -- name, etc.

s/AUTHOR/Author/

A few other various formatting issues
19 Mar 2011 12:38:54
Original commit files touched by this commit  1.10_1

miwi search for other commits by this committer
- Get Rid MD5 support
24 Jan 2006 03:14:23
Original commit files touched by this commit  1.10_1

edwin search for other commits by this committer
SHA256ify

Approved by: krion@
18 Mar 2004 18:01:13
Original commit files touched by this commit  1.10_1

trevor search for other commits by this committer
Add size data, approved by maintainers.
06 Feb 2004 13:12:53
Original commit files touched by this commit  1.10_1

trevor search for other commits by this committer
Use PLIST_FILES (bento-tested, marcus-reviewed).
07 Mar 2003 06:12:57
Original commit files touched by this commit  1.10_1

ade search for other commits by this committer
Clear moonlight beckons.
Requiem mors pacem pkg-comment,
And be calm ports tree.

E Nomini Patri, E Fili, E Spiritu Sancti.
08 Nov 2001 06:48:32
Original commit files touched by this commit

demon search for other commits by this committer
Add support for virtual hosts.    
05 Feb 2001 15:33:58
Original commit files touched by this commit

olgeni search for other commits by this committer
Some spaces -> tabs for ports/www.    
13 Nov 2000 12:45:41
Original commit files touched by this commit

demon search for other commits by this committer
Change MAINTAINER field.   I am now at FreeBSD dot org    
08 Oct 2000 08:11:25
Original commit files touched by this commit

asami search for other commits by this committer
Convert category www to new layout.  

Number of commits found: 14

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
The latest upgrade!
Privacy
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
mbedtlsFeb 24
mbedtlsFeb 24
opensmtpdFeb 24
opensmtpdFeb 24
opensmtpdFeb 24
weechatFeb 21
webkit2-gtk3Feb 19
dovecotFeb 13
gitlab-ceFeb 13
grub2-bhyveFeb 12
libexifFeb 11
linux-flashplayerFeb 11
nginxFeb 09
nginx-develFeb 09
ksh93Feb 07

12 vulnerabilities affecting 52 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last updated:
2020-02-25 03:07:51


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 38444
Broken 646
Deprecated 418
Ignore 917
Forbidden 3
Restricted 150
No CDROM 72
Vulnerable 24
Expired 4
Set to expire 390
Interactive 0
new 24 hours 5
new 48 hours6
new 7 days28
new fortnight52
new month311

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2020 Dan Langille. All rights reserved.