FreshPorts -- The Place For Ports If you buy from Amazon USA, please support us by using this link.
Follow us
Blog
Twitter

I am looking for an LTO tape library. Do you have one to spare?
Port details
p5-Scrappy All Powerful Web Harvester, Spider, Scraper fully automated
0.94112090_1 www on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port
Maintainer: tobez@FreeBSD.org search for ports maintained by this maintainer
Port Added: 27 Jan 2011 12:43:55
Also Listed In: perl5
License: not specified in port
Scrappy is an easy (and hopefully fun) way of scraping, spidering,
and/or harvesting information from web pages, web services, and more.
Scrappy is a feature rich, flexible, intelligent web automation tool.

WWW: http://search.cpan.org/dist/Scrappy/
SVNWeb : Homepage : Distfiles Availability : PortsMon

NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.

Build dependencies:
  1. p5-File-ShareDir-Install>=0.03 : devel/p5-File-ShareDir-Install
  2. p5-Array-Unique>=0 : devel/p5-Array-Unique
  3. p5-DateTime>=0 : devel/p5-DateTime
  4. p5-DateTime-Format-SQLite>=0 : devel/p5-DateTime-Format-SQLite
  5. p5-File-Find-Rule>=0 : devel/p5-File-Find-Rule
  6. p5-File-ShareDir>=0 : devel/p5-File-ShareDir
  7. p5-File-Slurp>=0 : devel/p5-File-Slurp
  8. p5-File-Util>=0 : devel/p5-File-Util
  9. p5-HTML-Tree>=0 : www/p5-HTML-Tree
  10. p5-Moose>=0 : devel/p5-Moose
  11. p5-Parallel-ForkManager>=0 : devel/p5-Parallel-ForkManager
  12. p5-Template-Toolkit>=0 : www/p5-Template-Toolkit
  13. p5-Try-Tiny>=0 : lang/p5-Try-Tiny
  14. p5-String-TT>=0 : devel/p5-String-TT
  15. p5-URI>=0 : net/p5-URI
  16. p5-WWW-Mechanize>=0 : www/p5-WWW-Mechanize
  17. p5-Web-Scraper>=0 : www/p5-Web-Scraper
  18. p5-YAML-Syck>=0 : textproc/p5-YAML-Syck
  19. /usr/local/bin/perl5.18.4 : lang/perl5.18
Runtime dependencies:
  1. p5-File-ShareDir-Install>=0.03 : devel/p5-File-ShareDir-Install
  2. p5-Array-Unique>=0 : devel/p5-Array-Unique
  3. p5-DateTime>=0 : devel/p5-DateTime
  4. p5-DateTime-Format-SQLite>=0 : devel/p5-DateTime-Format-SQLite
  5. p5-File-Find-Rule>=0 : devel/p5-File-Find-Rule
  6. p5-File-ShareDir>=0 : devel/p5-File-ShareDir
  7. p5-File-Slurp>=0 : devel/p5-File-Slurp
  8. p5-File-Util>=0 : devel/p5-File-Util
  9. p5-HTML-Tree>=0 : www/p5-HTML-Tree
  10. p5-Moose>=0 : devel/p5-Moose
  11. p5-Parallel-ForkManager>=0 : devel/p5-Parallel-ForkManager
  12. p5-Template-Toolkit>=0 : www/p5-Template-Toolkit
  13. p5-Try-Tiny>=0 : lang/p5-Try-Tiny
  14. p5-String-TT>=0 : devel/p5-String-TT
  15. p5-URI>=0 : net/p5-URI
  16. p5-WWW-Mechanize>=0 : www/p5-WWW-Mechanize
  17. p5-Web-Scraper>=0 : www/p5-Web-Scraper
  18. p5-YAML-Syck>=0 : textproc/p5-YAML-Syck
  19. /usr/local/bin/perl5.18.4 : lang/perl5.18
There are no ports dependent upon this port

To install the port: cd /usr/ports/www/p5-Scrappy/ && make install clean
To add the package: pkg install www/p5-Scrappy


Configuration Options
     No options to configure

Master Sites:
  1. ftp://ftp.auckland.ac.nz/pub/perl/CPAN/authors/id/A/AW/AWNCORP/
  2. ftp://ftp.cpan.org/pub/CPAN/authors/id/A/AW/AWNCORP/
  3. ftp://ftp.cpan.org/pub/CPAN/modules/by-module/
  4. ftp://ftp.funet.fi/pub/languages/perl/CPAN/authors/id/A/AW/AWNCORP/
  5. ftp://ftp.kddlabs.co.jp/lang/perl/CPAN/authors/id/A/AW/AWNCORP/
  6. ftp://ftp.mirrorservice.org/sites/cpan.perl.org/CPAN/authors/id/A/AW/AWNCORP/
  7. ftp://ftp.sunet.se/pub/lang/perl/CPAN/authors/id/A/AW/AWNCORP/
  8. http://backpan.perl.org/authors/id/A/AW/AWNCORP/
  9. http://cpan.metacpan.org/authors/id/A/AW/AWNCORP/
  10. http://distcache.FreeBSD.org/ports-distfiles/
  11. http://ftp.jaist.ac.jp/pub/CPAN/authors/id/A/AW/AWNCORP/
  12. http://ftp.twaren.net/Unix/Lang/CPAN/authors/id/A/AW/AWNCORP/
  13. http://www.cpan.dk/authors/id/A/AW/AWNCORP/
  14. http://www.cpan.dk/modules/by-module/
  15. http://www.cpan.org/authors/id/A/AW/AWNCORP/

Number of commits found: 8

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
26 Nov 2014 13:08:38
Original commit files touched by this commit  0.94112090_1
Revision:373448
mat search for other commits by this committer
Change the way Perl modules are installed, update the default Perl to 5.18.

Before, we had:

  site_perl :           lib/perl5/site_perl/5.18
  site_perl/perl_arch : lib/perl5/site_perl/5.18/mach
  perl_man3 :           lib/perl5/5.18/man/man3

Now we have:

  site_perl : lib/perl5/site_perl
  site_arch : lib/perl5/site_perl/mach/5.18
  perl_man3 : lib/perl5/site_perl/man/man3

Modules without any .so will be installed at the same place regardless of the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
29 Jan 2014 12:23:20
Original commit files touched by this commit  0.94112090
Revision:341724
miwi search for other commits by this committer
- Stage support
20 Sep 2013 23:36:54
Original commit files touched by this commit  0.94112090
Revision:327776
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
www)
05 Aug 2013 15:05:30
Original commit files touched by this commit  0.94112090
Revision:324276
az search for other commits by this committer
- Convert to new perl framework
- Trim Makefile header

Approved by:	tobez@ (maintainer)
15 Nov 2012 09:20:14
Original commit files touched by this commit  0.94112090
Revision:307443
tobez search for other commits by this committer
Update to 0.94112090.

Changes: http://cpansearch.perl.org/src/AWNCORP/Scrappy-0.94112090/Changes

Feature safe:	yes
21 Jan 2012 17:40:15
Original commit files touched by this commit  0.62
eadler search for other commits by this committer
At the moment 1385 ports use BUILD_DEPENDS= ${RUN_DEPENDS} and 450
ports use BUILD_DEPENDS:= ${RUN_DEPENDS}. This patch fixes ports that are
currently broken. This is a temporary measure until we organically stop using
:= or someone(s) spend a lot of time changing all the ports over.

Explicit duplication > := > = and this just moves ports one step to the left

Approved by:    portmgr
21 Jun 2011 06:58:49
Original commit files touched by this commit  0.62
az search for other commits by this committer
- Replace ../../authors in MASTER_SITE_SUBDIR with CPAN:CPANID macro.
  See http://wiki.freebsd.org/Perl for details.
- Change maintainership from ports@ to perl@ for ports in this changeset.
- Remove MD5 checksum
- Utilize CPAN macro
27 Jan 2011 12:43:45
Original commit files touched by this commit  0.62
tobez search for other commits by this committer
Add www/p5-Scrappy 0.62, a web crawler Perl module.

Feature safe:   yes

Number of commits found: 8

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD

This site
What is FreshPorts?
About the authors
FAQ
How big is it?
The latest upgrade!
Privacy
Forums
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
muttDec 23
muttDec 23
ntpDec 20
ntp-develDec 20
gitDec 19
otrsDec 16
mod_dav_svnDec 15
subversionDec 15
subversion16Dec 15
subversion17Dec 15
nvidia-driverDec 14
nvidia-driver-173Dec 14
nvidia-driver-304Dec 14
asterisk11Dec 11
bind99Dec 11

10 vulnerabilities affecting 28 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 24439
Broken 148
Deprecated 75
Ignore 399
Forbidden 2
Restricted 207
No CDROM 93
Vulnerable 20
Expired 0
Set to expire 70
Interactive 0
new 24 hours 6
new 48 hours7
new 7 days22
new fortnight43
new month99

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2014 Dan Langille. All rights reserved.