FreshPorts -- The Place For Ports If you buy from Amazon USA, please support us by using this link.
Follow us
Blog
Twitter

Please give me your LTO-4 or better tape library and I'll put it to good use.
Port details
p5-Scrappy All Powerful Web Harvester, Spider, Scraper fully automated
0.94112090_1 www on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port
Maintainer: tobez@FreeBSD.org search for ports maintained by this maintainer
Port Added: 27 Jan 2011 12:43:55
Also Listed In: perl5
License: not specified in port
Scrappy is an easy (and hopefully fun) way of scraping, spidering,
and/or harvesting information from web pages, web services, and more.
Scrappy is a feature rich, flexible, intelligent web automation tool.

WWW: http://search.cpan.org/dist/Scrappy/
SVNWeb : Homepage : Distfiles Availability : PortsMon

NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.

Build dependencies:
  1. p5-File-ShareDir-Install>=0.03 : devel/p5-File-ShareDir-Install
  2. p5-Array-Unique>=0 : devel/p5-Array-Unique
  3. p5-DateTime>=0 : devel/p5-DateTime
  4. p5-DateTime-Format-SQLite>=0 : devel/p5-DateTime-Format-SQLite
  5. p5-File-Find-Rule>=0 : devel/p5-File-Find-Rule
  6. p5-File-ShareDir>=0 : devel/p5-File-ShareDir
  7. p5-File-Slurp>=0 : devel/p5-File-Slurp
  8. p5-File-Util>=0 : devel/p5-File-Util
  9. p5-HTML-Tree>=0 : www/p5-HTML-Tree
  10. p5-Moose>=0 : devel/p5-Moose
  11. p5-Parallel-ForkManager>=0 : devel/p5-Parallel-ForkManager
  12. p5-Template-Toolkit>=0 : www/p5-Template-Toolkit
  13. p5-Try-Tiny>=0 : lang/p5-Try-Tiny
  14. p5-String-TT>=0 : devel/p5-String-TT
  15. p5-URI>=0 : net/p5-URI
  16. p5-WWW-Mechanize>=0 : www/p5-WWW-Mechanize
  17. p5-Web-Scraper>=0 : www/p5-Web-Scraper
  18. p5-YAML-Syck>=0 : textproc/p5-YAML-Syck
  19. perl5.18.4 : lang/perl5.18
Runtime dependencies:
  1. p5-File-ShareDir-Install>=0.03 : devel/p5-File-ShareDir-Install
  2. p5-Array-Unique>=0 : devel/p5-Array-Unique
  3. p5-DateTime>=0 : devel/p5-DateTime
  4. p5-DateTime-Format-SQLite>=0 : devel/p5-DateTime-Format-SQLite
  5. p5-File-Find-Rule>=0 : devel/p5-File-Find-Rule
  6. p5-File-ShareDir>=0 : devel/p5-File-ShareDir
  7. p5-File-Slurp>=0 : devel/p5-File-Slurp
  8. p5-File-Util>=0 : devel/p5-File-Util
  9. p5-HTML-Tree>=0 : www/p5-HTML-Tree
  10. p5-Moose>=0 : devel/p5-Moose
  11. p5-Parallel-ForkManager>=0 : devel/p5-Parallel-ForkManager
  12. p5-Template-Toolkit>=0 : www/p5-Template-Toolkit
  13. p5-Try-Tiny>=0 : lang/p5-Try-Tiny
  14. p5-String-TT>=0 : devel/p5-String-TT
  15. p5-URI>=0 : net/p5-URI
  16. p5-WWW-Mechanize>=0 : www/p5-WWW-Mechanize
  17. p5-Web-Scraper>=0 : www/p5-Web-Scraper
  18. p5-YAML-Syck>=0 : textproc/p5-YAML-Syck
  19. perl5.18.4 : lang/perl5.18
There are no ports dependent upon this port

To install the port: cd /usr/ports/www/p5-Scrappy/ && make install clean
To add the package: pkg install www/p5-Scrappy


Configuration Options
     No options to configure

USES:
perl5

Master Sites:
  1. ftp://ftp.auckland.ac.nz/pub/perl/CPAN/authors/id/A/AW/AWNCORP/
  2. ftp://ftp.cpan.org/pub/CPAN/authors/id/A/AW/AWNCORP/
  3. ftp://ftp.cpan.org/pub/CPAN/modules/by-module/
  4. ftp://ftp.funet.fi/pub/languages/perl/CPAN/authors/id/A/AW/AWNCORP/
  5. ftp://ftp.kddlabs.co.jp/lang/perl/CPAN/authors/id/A/AW/AWNCORP/
  6. ftp://ftp.mirrorservice.org/sites/cpan.perl.org/CPAN/authors/id/A/AW/AWNCORP/
  7. ftp://ftp.sunet.se/pub/lang/perl/CPAN/authors/id/A/AW/AWNCORP/
  8. http://backpan.perl.org/authors/id/A/AW/AWNCORP/
  9. http://cpan.metacpan.org/authors/id/A/AW/AWNCORP/
  10. http://distcache.FreeBSD.org/ports-distfiles/
  11. http://ftp.jaist.ac.jp/pub/CPAN/authors/id/A/AW/AWNCORP/
  12. http://ftp.twaren.net/Unix/Lang/CPAN/authors/id/A/AW/AWNCORP/
  13. http://www.cpan.dk/authors/id/A/AW/AWNCORP/
  14. http://www.cpan.dk/modules/by-module/
  15. http://www.cpan.org/authors/id/A/AW/AWNCORP/

Number of commits found: 8

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
26 Nov 2014 13:08:38
Original commit files touched by this commit  0.94112090_1
Revision:373448
mat search for other commits by this committer
Change the way Perl modules are installed, update the default Perl to 5.18.

Before, we had:

  site_perl :           lib/perl5/site_perl/5.18
  site_perl/perl_arch : lib/perl5/site_perl/5.18/mach
  perl_man3 :           lib/perl5/5.18/man/man3

Now we have:

  site_perl : lib/perl5/site_perl
  site_arch : lib/perl5/site_perl/mach/5.18
  perl_man3 : lib/perl5/site_perl/man/man3

Modules without any .so will be installed at the same place regardless of the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
29 Jan 2014 12:23:20
Original commit files touched by this commit  0.94112090
Revision:341724
miwi search for other commits by this committer
- Stage support
20 Sep 2013 23:36:54
Original commit files touched by this commit  0.94112090
Revision:327776
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
www)
05 Aug 2013 15:05:30
Original commit files touched by this commit  0.94112090
Revision:324276
az search for other commits by this committer
- Convert to new perl framework
- Trim Makefile header

Approved by:	tobez@ (maintainer)
15 Nov 2012 09:20:14
Original commit files touched by this commit  0.94112090
Revision:307443
tobez search for other commits by this committer
Update to 0.94112090.

Changes: http://cpansearch.perl.org/src/AWNCORP/Scrappy-0.94112090/Changes

Feature safe:	yes
21 Jan 2012 17:40:15
Original commit files touched by this commit  0.62
eadler search for other commits by this committer
At the moment 1385 ports use BUILD_DEPENDS= ${RUN_DEPENDS} and 450
ports use BUILD_DEPENDS:= ${RUN_DEPENDS}. This patch fixes ports that are
currently broken. This is a temporary measure until we organically stop using
:= or someone(s) spend a lot of time changing all the ports over.

Explicit duplication > := > = and this just moves ports one step to the left

Approved by:    portmgr
21 Jun 2011 06:58:49
Original commit files touched by this commit  0.62
az search for other commits by this committer
- Replace ../../authors in MASTER_SITE_SUBDIR with CPAN:CPANID macro.
  See http://wiki.freebsd.org/Perl for details.
- Change maintainership from ports@ to perl@ for ports in this changeset.
- Remove MD5 checksum
- Utilize CPAN macro
27 Jan 2011 12:43:45
Original commit files touched by this commit  0.62
tobez search for other commits by this committer
Add www/p5-Scrappy 0.62, a web crawler Perl module.

Feature safe:   yes

Number of commits found: 8

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD

This site
What is FreshPorts?
About the authors
FAQ
How big is it?
The latest upgrade!
Privacy
Forums
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
proxychains-ngMay 29
krb5May 28
krb5-112May 28
tsharkMay 28
tshark-liteMay 28
wiresharkMay 28
wireshark-liteMay 28
curlMay 26
curlMay 26
cassandraMay 24
cassandra2May 24
py-saltMay 24
davmailMay 23
dnsmasqMay 23
dnsmasq-develMay 23

22 vulnerabilities affecting 39 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 24833
Broken 231
Deprecated 70
Ignore 499
Forbidden 1
Restricted 204
No CDROM 95
Vulnerable 21
Expired 9
Set to expire 59
Interactive 0
new 24 hours 8
new 48 hours13
new 7 days46
new fortnight77
new month167

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2014 Dan Langille. All rights reserved.