FreshPorts -- The Place For Ports If you buy from Amazon USA, please support us by using this link.
Follow us
Blog
Twitter

Port details
p5-Scrappy All Powerful Web Harvester, Spider, Scraper fully automated
0.94112090_1 www on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port
Maintainer: tobez@FreeBSD.org search for ports maintained by this maintainer
Port Added: 27 Jan 2011 12:43:55
Also Listed In: perl5
License: not specified in port
Scrappy is an easy (and hopefully fun) way of scraping, spidering,
and/or harvesting information from web pages, web services, and more.
Scrappy is a feature rich, flexible, intelligent web automation tool.

WWW: http://search.cpan.org/dist/Scrappy/
SVNWeb : Homepage : PortsMon

To install the port: cd /usr/ports/www/p5-Scrappy/ && make install clean
To add the package: pkg install p5-Scrappy

PKGNAME: p5-Scrappy


NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.

Build dependencies:
  1. p5-File-ShareDir-Install>=0.03 : devel/p5-File-ShareDir-Install
  2. p5-Array-Unique>=0 : devel/p5-Array-Unique
  3. p5-DateTime>=0 : devel/p5-DateTime
  4. p5-DateTime-Format-SQLite>=0 : devel/p5-DateTime-Format-SQLite
  5. p5-File-Find-Rule>=0 : devel/p5-File-Find-Rule
  6. p5-File-ShareDir>=0 : devel/p5-File-ShareDir
  7. p5-File-Slurp>=0 : devel/p5-File-Slurp
  8. p5-File-Util>=0 : devel/p5-File-Util
  9. p5-HTML-Tree>=0 : www/p5-HTML-Tree
  10. p5-Moose>=0 : devel/p5-Moose
  11. p5-Parallel-ForkManager>=0 : devel/p5-Parallel-ForkManager
  12. p5-Template-Toolkit>=0 : www/p5-Template-Toolkit
  13. p5-Try-Tiny>=0 : lang/p5-Try-Tiny
  14. p5-String-TT>=0 : devel/p5-String-TT
  15. p5-URI>=0 : net/p5-URI
  16. p5-WWW-Mechanize>=0 : www/p5-WWW-Mechanize
  17. p5-Web-Scraper>=0 : www/p5-Web-Scraper
  18. p5-YAML-Syck>=0 : textproc/p5-YAML-Syck
  19. perl5>=5.20<5.21 : lang/perl5.20
Runtime dependencies:
  1. p5-File-ShareDir-Install>=0.03 : devel/p5-File-ShareDir-Install
  2. p5-Array-Unique>=0 : devel/p5-Array-Unique
  3. p5-DateTime>=0 : devel/p5-DateTime
  4. p5-DateTime-Format-SQLite>=0 : devel/p5-DateTime-Format-SQLite
  5. p5-File-Find-Rule>=0 : devel/p5-File-Find-Rule
  6. p5-File-ShareDir>=0 : devel/p5-File-ShareDir
  7. p5-File-Slurp>=0 : devel/p5-File-Slurp
  8. p5-File-Util>=0 : devel/p5-File-Util
  9. p5-HTML-Tree>=0 : www/p5-HTML-Tree
  10. p5-Moose>=0 : devel/p5-Moose
  11. p5-Parallel-ForkManager>=0 : devel/p5-Parallel-ForkManager
  12. p5-Template-Toolkit>=0 : www/p5-Template-Toolkit
  13. p5-Try-Tiny>=0 : lang/p5-Try-Tiny
  14. p5-String-TT>=0 : devel/p5-String-TT
  15. p5-URI>=0 : net/p5-URI
  16. p5-WWW-Mechanize>=0 : www/p5-WWW-Mechanize
  17. p5-Web-Scraper>=0 : www/p5-Web-Scraper
  18. p5-YAML-Syck>=0 : textproc/p5-YAML-Syck
  19. perl5>=5.20<5.21 : lang/perl5.20
There are no ports dependent upon this port

Configuration Options
     No options to configure

USES:
perl5

Master Sites:
  1. ftp://ftp.auckland.ac.nz/pub/perl/CPAN/authors/id/A/AW/AWNCORP/
  2. ftp://ftp.cpan.org/pub/CPAN/authors/id/A/AW/AWNCORP/
  3. ftp://ftp.cpan.org/pub/CPAN/modules/by-module/Scrappy/
  4. ftp://ftp.funet.fi/pub/languages/perl/CPAN/authors/id/A/AW/AWNCORP/
  5. ftp://ftp.kddlabs.co.jp/lang/perl/CPAN/authors/id/A/AW/AWNCORP/
  6. ftp://ftp.mirrorservice.org/sites/cpan.perl.org/CPAN/authors/id/A/AW/AWNCORP/
  7. ftp://ftp.sunet.se/pub/lang/perl/CPAN/authors/id/A/AW/AWNCORP/
  8. http://backpan.perl.org/authors/id/A/AW/AWNCORP/
  9. http://cpan.metacpan.org/authors/id/A/AW/AWNCORP/
  10. http://cpan.metacpan.org/modules/by-module/Scrappy/
  11. http://distcache.FreeBSD.org/ports-distfiles/
  12. http://ftp.jaist.ac.jp/pub/CPAN/authors/id/A/AW/AWNCORP/
  13. http://ftp.twaren.net/Unix/Lang/CPAN/authors/id/A/AW/AWNCORP/
  14. http://www.cpan.dk/authors/id/A/AW/AWNCORP/
  15. http://www.cpan.org/authors/id/A/AW/AWNCORP/

Number of commits found: 10

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
01 Apr 2016 14:33:58
Original commit files touched by this commit  0.94112090_1
Revision:412351
mat search for other commits by this committer
Remove ${PORTSDIR}/ from dependencies, categories v, w, x, y, and z.

With hat:	portmgr
Sponsored by:	Absolight
14 Sep 2015 12:19:50
Original commit files touched by this commit  0.94112090_1
Revision:396892
mat search for other commits by this committer
Make it so that the default Perl is always called perl5.

- Move Perl's man1 files along with its man3 files.
- Move where Perl installs its modules man1 pages.
- Convert the ports installing man1 pages.
- Make different Perl versions installable at the same time.
  Though you should note that only the default version can be used to
  install Perl modules, and the non default Perl versions cannot use the
  modules installed via ports if they contain .so as they are installed
  in a version specific directory.

Reviewed by:	bapt (the Mk bits)
Exp-run by:	antoine
Sponsored by:	Absolight
Differential Revision:	https://reviews.freebsd.org/D3542
26 Nov 2014 13:08:38
Original commit files touched by this commit  0.94112090_1
Revision:373448
mat search for other commits by this committer
Change the way Perl modules are installed, update the default Perl to 5.18.

Before, we had:

  site_perl :           lib/perl5/site_perl/5.18
  site_perl/perl_arch : lib/perl5/site_perl/5.18/mach
  perl_man3 :           lib/perl5/5.18/man/man3

Now we have:

  site_perl : lib/perl5/site_perl
  site_arch : lib/perl5/site_perl/mach/5.18
  perl_man3 : lib/perl5/site_perl/man/man3

Modules without any .so will be installed at the same place regardless of the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
29 Jan 2014 12:23:20
Original commit files touched by this commit  0.94112090
Revision:341724
miwi search for other commits by this committer
- Stage support
20 Sep 2013 23:36:54
Original commit files touched by this commit  0.94112090
Revision:327776
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
www)
05 Aug 2013 15:05:30
Original commit files touched by this commit  0.94112090
Revision:324276
az search for other commits by this committer
- Convert to new perl framework
- Trim Makefile header

Approved by:	tobez@ (maintainer)
15 Nov 2012 09:20:14
Original commit files touched by this commit  0.94112090
Revision:307443
tobez search for other commits by this committer
Update to 0.94112090.

Changes: http://cpansearch.perl.org/src/AWNCORP/Scrappy-0.94112090/Changes

Feature safe:	yes
21 Jan 2012 17:40:15
Original commit files touched by this commit  0.62
eadler search for other commits by this committer
At the moment 1385 ports use BUILD_DEPENDS= ${RUN_DEPENDS} and 450
ports use BUILD_DEPENDS:= ${RUN_DEPENDS}. This patch fixes ports that are
currently broken. This is a temporary measure until we organically stop using
:= or someone(s) spend a lot of time changing all the ports over.

Explicit duplication > := > = and this just moves ports one step to the left

Approved by:    portmgr
21 Jun 2011 06:58:49
Original commit files touched by this commit  0.62
az search for other commits by this committer
- Replace ../../authors in MASTER_SITE_SUBDIR with CPAN:CPANID macro.
  See http://wiki.freebsd.org/Perl for details.
- Change maintainership from ports@ to perl@ for ports in this changeset.
- Remove MD5 checksum
- Utilize CPAN macro
27 Jan 2011 12:43:45
Original commit files touched by this commit  0.62
tobez search for other commits by this committer
Add www/p5-Scrappy 0.62, a web crawler Perl module.

Feature safe:   yes

Number of commits found: 10

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
The latest upgrade!
Privacy
Forums
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
mercurialMay 01
mariadb100-serverApr 30
mariadb101-serverApr 30
mariadb55-serverApr 30
mysql55-serverApr 30
mysql56-serverApr 30
mysql57-serverApr 30
percona55-serverApr 30
logstashApr 28
subversionApr 28
subversion18Apr 28
ntpApr 27
ntp-develApr 27
firefoxApr 26
firefox-esrApr 26

15 vulnerabilities affecting 48 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 25993
Broken 283
Deprecated 61
Ignore 549
Forbidden 0
Restricted 203
No CDROM 86
Vulnerable 58
Expired 27
Set to expire 48
Interactive 0
new 24 hours 2
new 48 hours4
new 7 days20
new fortnight40
new month119

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2014 Dan Langille. All rights reserved.