notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Want a good monitor light? See my photosAll times are UTC
Ukraine
This referral link gives you 10% off a Fastmail.com account and gives me a discount on my Fastmail account.
New feature planned: get notified when the package is available. Now is the time to contribute ideas/suggestions.
Port details
p5-Web-Scraper Web Scraping Toolkit inspired by Scrapi
0.38 www on this many watch lists=2 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 0.38Version of this port present on the latest quarterly branch.
Maintainer: perl@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2007-12-12 08:15:22
Last Update: 2022-09-07 21:58:51
Commit Hash: fb16dfe
People watching this port, also watch:: nspr, qemu, mkvtoolnix, oniguruma, gnupg1
Also Listed In: perl5
License: ART10 GPLv1+
WWW:
https://metacpan.org/release/Web-Scraper
Description:
Web::Scraper is a web scraper toolkit, inspired by Ruby's equivalent Scrapi.
Homepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
Expand this list (14 items)
Collapse this list.
  1. /usr/local/share/licenses/p5-Web-Scraper-0.38/catalog.mk
  2. /usr/local/share/licenses/p5-Web-Scraper-0.38/LICENSE
  3. /usr/local/share/licenses/p5-Web-Scraper-0.38/ART10
  4. /usr/local/share/licenses/p5-Web-Scraper-0.38/GPLv1+
  5. bin/scraper
  6. lib/perl5/site_perl/Web/Scraper.pm
  7. lib/perl5/site_perl/Web/Scraper/Filter.pm
  8. lib/perl5/site_perl/Web/Scraper/LibXML.pm
  9. lib/perl5/site_perl/man/man3/Web::Scraper.3.gz
  10. lib/perl5/site_perl/man/man3/Web::Scraper::Filter.3.gz
  11. lib/perl5/site_perl/man/man3/Web::Scraper::LibXML.3.gz
  12. @owner
  13. @group
  14. @mode
Collapse this list.
Dependency lines:
  • p5-Web-Scraper>0:www/p5-Web-Scraper
To install the port:
cd /usr/ports/www/p5-Web-Scraper/ && make install clean
To add the package, run one of these commands:
  • pkg install www/p5-Web-Scraper
  • pkg install p5-Web-Scraper
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: p5-Web-Scraper
Flavors: there is no flavor information for this port.
distinfo:
SHA256 (Web-Scraper-0.38.tar.gz) = f95b6e5f8d7feebe116d05bf59a2b7cf1a51ed9d30bca80123430ec4567543bf SIZE (Web-Scraper-0.38.tar.gz) = 25738

Packages (timestamps in pop-ups are UTC):
p5-Web-Scraper
ABIlatestquarterly
FreeBSD:13:aarch640.380.38
FreeBSD:13:amd640.380.38
FreeBSD:13:armv60.380.38
FreeBSD:13:armv70.380.38
FreeBSD:13:i3860.380.38
FreeBSD:13:powerpc-0.38
FreeBSD:13:powerpc640.380.38
FreeBSD:13:powerpc64le-0.38
FreeBSD:14:aarch640.380.38
FreeBSD:14:amd640.380.38
FreeBSD:14:armv60.38-
FreeBSD:14:armv70.380.38
FreeBSD:14:i3860.380.38
FreeBSD:14:powerpc0.380.38
FreeBSD:14:powerpc64-0.38
FreeBSD:14:powerpc64le0.380.38
FreeBSD:15:aarch640.38-
FreeBSD:15:amd640.38-
FreeBSD:15:armv70.38-
FreeBSD:15:powerpc0.38-
FreeBSD:15:powerpc640.38-
FreeBSD:15:powerpc64le0.38-
 
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. p5-HTML-Parser>0 : www/p5-HTML-Parser
  2. p5-HTML-Selector-XPath>=0.03 : www/p5-HTML-Selector-XPath
  3. p5-HTML-Tagset>0 : www/p5-HTML-Tagset
  4. p5-HTML-TreeBuilder-LibXML>=0.04 : www/p5-HTML-TreeBuilder-LibXML
  5. p5-HTML-TreeBuilder-XPath>=0.08 : www/p5-HTML-TreeBuilder-XPath
  6. p5-HTML-Tree>=3.23 : www/p5-HTML-Tree
  7. p5-UNIVERSAL-require>0 : devel/p5-UNIVERSAL-require
  8. p5-URI>0 : net/p5-URI
  9. p5-XML-XPathEngine>=0.08 : textproc/p5-XML-XPathEngine
  10. p5-YAML>0 : textproc/p5-YAML
  11. p5-libwww>=5.827 : www/p5-libwww
  12. perl5>=5.32.r0<5.33 : lang/perl5.32
  13. p5-Module-Build-Tiny>=0.039 : devel/p5-Module-Build-Tiny
  14. perl5>=5.32.r0<5.33 : lang/perl5.32
Runtime dependencies:
  1. p5-HTML-Parser>0 : www/p5-HTML-Parser
  2. p5-HTML-Selector-XPath>=0.03 : www/p5-HTML-Selector-XPath
  3. p5-HTML-Tagset>0 : www/p5-HTML-Tagset
  4. p5-HTML-TreeBuilder-LibXML>=0.04 : www/p5-HTML-TreeBuilder-LibXML
  5. p5-HTML-TreeBuilder-XPath>=0.08 : www/p5-HTML-TreeBuilder-XPath
  6. p5-HTML-Tree>=3.23 : www/p5-HTML-Tree
  7. p5-UNIVERSAL-require>0 : devel/p5-UNIVERSAL-require
  8. p5-URI>0 : net/p5-URI
  9. p5-XML-XPathEngine>=0.08 : textproc/p5-XML-XPathEngine
  10. p5-YAML>0 : textproc/p5-YAML
  11. p5-libwww>=5.827 : www/p5-libwww
  12. perl5>=5.32.r0<5.33 : lang/perl5.32
This port is required by:
for Build
  1. finance/p5-Finance-Quote
  2. graphics/p5-Gimp
  3. japanese/p5-WWW-MobileCarrierJP
  4. www/p5-Scrappy
  5. www/p5-WWW-HatenaDiary
  6. www/p5-WWW-Mixi-Scraper
  7. www/p5-Web-Scraper-Config
for Run
  1. finance/p5-Finance-Quote
  2. graphics/p5-Gimp
  3. japanese/p5-WWW-MobileCarrierJP
  4. www/p5-Scrappy
  5. www/p5-WWW-HatenaDiary
  6. www/p5-WWW-Mixi-Scraper
  7. www/p5-Web-Scraper-Config

Configuration Options:
No options to configure
Options name:
www_p5-Web-Scraper
USES:
perl5 shebangfix
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (13 items)
Collapse this list.
  1. ftp://ftp.auckland.ac.nz/pub/perl/CPAN/authors/id/M/MI/MIYAGAWA/
  2. ftp://ftp.cpan.org/pub/CPAN/authors/id/M/MI/MIYAGAWA/
  3. ftp://ftp.cpan.org/pub/CPAN/modules/by-module/Web/
  4. ftp://ftp.funet.fi/pub/languages/perl/CPAN/authors/id/M/MI/MIYAGAWA/
  5. ftp://ftp.kddlabs.co.jp/lang/perl/CPAN/authors/id/M/MI/MIYAGAWA/
  6. ftp://ftp.mirrorservice.org/sites/cpan.perl.org/CPAN/authors/id/M/MI/MIYAGAWA/
  7. http://backpan.perl.org/authors/id/M/MI/MIYAGAWA/
  8. http://ftp.jaist.ac.jp/pub/CPAN/authors/id/M/MI/MIYAGAWA/
  9. http://ftp.twaren.net/Unix/Lang/CPAN/authors/id/M/MI/MIYAGAWA/
  10. https://cpan.metacpan.org/authors/id/M/MI/MIYAGAWA/
  11. https://cpan.metacpan.org/modules/by-module/Web/
  12. https://www.cpan.org/authors/id/M/MI/MIYAGAWA/
Collapse this list.

Number of commits found: 34

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
07 Sep 2022 21:58:51
commit hash: fb16dfecae4a6efac9f3a78e0b759fb7a3c53de4commit hash: fb16dfecae4a6efac9f3a78e0b759fb7a3c53de4commit hash: fb16dfecae4a6efac9f3a78e0b759fb7a3c53de4commit hash: fb16dfecae4a6efac9f3a78e0b759fb7a3c53de4 files touched by this commit
Stefan Eßer (se) search for other commits by this committer
Remove WWW entries moved into port Makefiles

Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.

This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.

Approved by:		portmgr (tcberner)
0.38
07 Sep 2022 21:10:59
commit hash: b7f05445c00f2625aa19b4154ebcbce5ed2daa52commit hash: b7f05445c00f2625aa19b4154ebcbce5ed2daa52commit hash: b7f05445c00f2625aa19b4154ebcbce5ed2daa52commit hash: b7f05445c00f2625aa19b4154ebcbce5ed2daa52 files touched by this commit
Stefan Eßer (se) search for other commits by this committer
Add WWW entries to port Makefiles

It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.

Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.

There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.
(Only the first 15 lines of the commit message are shown above View all of this commit message)
0.38
20 Jul 2022 14:23:26
commit hash: e915e756715f12e5e0e46993b1265f44690b4a90commit hash: e915e756715f12e5e0e46993b1265f44690b4a90commit hash: e915e756715f12e5e0e46993b1265f44690b4a90commit hash: e915e756715f12e5e0e46993b1265f44690b4a90 files touched by this commit
Tobias C. Berner (tcberner) search for other commits by this committer
www: remove 'Created by' lines

A big Thank You to the original contributors of these ports:

  *
  *  <hvo.pm@xs4all.nl>
  *  Aaron Dalton <aaron@FreeBSD.org>
  *  Aaron Dalton <aaron@daltons.ca>
  *  Aaron LI <aly@aaronly.me>
  *  Aaron Zauner <az_mail@gmx.at>
  *  Abel Chow <achow@transoft.net>
  *  Adam Weinberger <adamw@FreeBSD.org>
  *  Ade Lovett <ade@FreeBSD.org>
  *  Adrian Steinmann <ast@marabu.ch>
  *  Akinori MUSHA aka knu <knu@idaemons.org>
(Only the first 15 lines of the commit message are shown above View all of this commit message)
0.38
06 Apr 2021 14:31:07
commit hash: 305f148f482daf30dcf728039d03d019f88344ebcommit hash: 305f148f482daf30dcf728039d03d019f88344ebcommit hash: 305f148f482daf30dcf728039d03d019f88344ebcommit hash: 305f148f482daf30dcf728039d03d019f88344eb files touched by this commit
Mathieu Arnold (mat) search for other commits by this committer
Remove # $FreeBSD$ from Makefiles.
0.38
05 Jul 2019 19:15:24
Revision:505931Original commit files touched by this commit
sunpoet search for other commits by this committer
Add NO_ARCH
0.38
06 Oct 2018 13:06:45
Revision:481365Original commit files touched by this commit
des search for other commits by this committer
Fix every instance of RUN_DEPENDS:=${BUILD_DEPENDS} in p5 ports, except
for where it resulted in a change in output from build-depends-list or
run-depends-list.

Approved by:	portmgr (adamw)
0.38
27 May 2018 20:15:20
Revision:470993Original commit files touched by this commit
sunpoet search for other commits by this committer
Update WWW

search.cpan.org is shutting down.
It will redirect to metacpan.org after June 25, 2018.

With hat:	perl
0.38
15 Sep 2017 08:58:50
Revision:449893Original commit files touched by this commit
mat search for other commits by this committer
Fix license information for portgs that use "the same license as Perl".

Sponsored by:	Absolight
0.38
01 Apr 2016 14:33:58
Revision:412351Original commit files touched by this commit
mat search for other commits by this committer
Remove ${PORTSDIR}/ from dependencies, categories v, w, x, y, and z.

With hat:	portmgr
Sponsored by:	Absolight
0.38
12 Jan 2015 18:36:59
Revision:376876Original commit files touched by this commit
sunpoet search for other commits by this committer
- Update to 0.38
- Sort PLIST

Changes:	http://search.cpan.org/dist/Web-Scraper/Changes
0.37_1
26 Nov 2014 13:08:38
Revision:373448Original commit files touched by this commit
mat search for other commits by this committer
Change the way Perl modules are installed, update the default Perl to 5.18.

Before, we had:

  site_perl :           lib/perl5/site_perl/5.18
  site_perl/perl_arch : lib/perl5/site_perl/5.18/mach
  perl_man3 :           lib/perl5/5.18/man/man3

Now we have:

  site_perl : lib/perl5/site_perl
  site_arch : lib/perl5/site_perl/mach/5.18
  perl_man3 : lib/perl5/site_perl/man/man3

Modules without any .so will be installed at the same place regardless of the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
0.37
07 Nov 2013 16:38:14
Revision:333137Original commit files touched by this commit
vanilla search for other commits by this committer
Support STAGEDIR.
0.37
20 Sep 2013 23:36:54
Revision:327776Original commit files touched by this commit
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
www)
0.37
29 Aug 2013 04:08:54
Revision:325559Original commit files touched by this commit
sunpoet search for other commits by this committer
- Use single space after WWW:
0.37
02 Aug 2013 18:52:11
Revision:324174Original commit files touched by this commit
mat search for other commits by this committer
- Convert to new perl framework
- Trim Makefile header
- Remove MAKE_JOBS_SAFE=yes, it's the default.
0.37
19 Dec 2012 08:48:23
Revision:309228Original commit files touched by this commit
jadawin search for other commits by this committer
- Update to 0.37
- Changelog: http://cpansearch.perl.org/src/MIYAGAWA/Web-Scraper-0.37/Changes
0.36
21 Nov 2011 14:36:51
Original commit files touched by this commit
sunpoet search for other commits by this committer
- Update to 0.36
- Add BUILD_DEPENDS and TEST_DEPENDS

Changes:        http://search.cpan.org/dist/Web-Scraper/Changes
Feature safe:   yes
0.35
07 Oct 2011 11:22:46
Original commit files touched by this commit
culot search for other commits by this committer
- Fix LICENSE (Artistic 1 instead of Artistic 2)
- Pet portlint(1)

PR:             ports/161336
Submitted by:   Simon Olofsson <simon@olofsson.de>
0.35
28 Sep 2011 14:07:41
Original commit files touched by this commit
sunpoet search for other commits by this committer
- Update to 0.35

Changes:        http://search.cpan.org/dist/Web-Scraper/Changes
0.34
08 Sep 2011 13:20:15
Original commit files touched by this commit
az search for other commits by this committer
- Replace ../../authors in MASTER_SITE_SUBDIR with CPAN:CPANID macro.
  See http://wiki.freebsd.org/Perl for details.
- Change maintainership from ports@ to perl@ for ports in this changeset.

With perl@ hat
0.34
28 Feb 2011 11:13:15
Original commit files touched by this commit
bapt search for other commits by this committer
- update to 0.34
- add licenses
- changes: http://cpansearch.perl.org/src/MIYAGAWA/Web-Scraper-0.34/Changes
0.33
18 Feb 2011 14:56:13
Original commit files touched by this commit
clsung search for other commits by this committer
- Update to 0.33
0.32
24 Sep 2010 02:03:44
Original commit files touched by this commit
pgollucci search for other commits by this committer
- only 13% of the p5- ports embed @comment $FreeBSD$:
  so standarize and remove it

With Hat:   perl@
0.32
04 Feb 2010 09:30:46
Original commit files touched by this commit
tobez search for other commits by this committer
Update to 0.32.

Changes:        http://search.cpan.org/dist/Web-Scraper/Changes
0.31_2
28 Jul 2009 11:46:59
Original commit files touched by this commit
tobez search for other commits by this committer
Hmm, fun with QAT.
0.31_1
28 Jul 2009 11:30:38
Original commit files touched by this commit
tobez search for other commits by this committer
Pacify QAT.  Not sure how my own tests did not catch this.
0.31
28 Jul 2009 11:23:10
Original commit files touched by this commit
tobez search for other commits by this committer
Update to 0.31.

Changes:        http://search.cpan.org/dist/Web-Scraper/Changes
0.30
15 Jul 2009 00:27:18
Original commit files touched by this commit
pgollucci search for other commits by this committer
- Update to 0.30

PR:             ports/136692
Submitted by:   TERAMOTO Masahiro <markun@onohara.to>
Tested by:      Cezary Morga <cm@therek.net>
0.28
02 Apr 2009 13:47:41
Original commit files touched by this commit
tobez search for other commits by this committer
Update to 0.28.
0.27
27 Mar 2009 22:24:47
Original commit files touched by this commit
miwi search for other commits by this committer
- Update to 0.27
0.26
19 Jan 2009 16:54:07
Original commit files touched by this commit
jadawin search for other commits by this committer
- Update to 0.26
0.25
15 Jan 2009 10:13:27
Original commit files touched by this commit
jadawin search for other commits by this committer
- Update to 0.25
0.24
12 Feb 2008 23:11:16
Original commit files touched by this commit
miwi search for other commits by this committer
- Update to 0.12

PR:             120554
Submitted by:   Masahiro Teramoto <markun@onohara.to> (maintainer)
0.22
12 Dec 2007 08:01:53
Original commit files touched by this commit
clsung search for other commits by this committer
Web::Scraper is a web scraper toolkit, inspired by Ruby's equivalent
Scrapi.

WWW:    http://search.cpan.org/dist/Web-Scraper/

PR:             ports/117554
Submitted by:   Gea-Suan Lin <gslin at gslin.org>

Number of commits found: 34