453b FreshPorts -- www/py-scrapy
FreshPorts -- The Place For Ports If you buy from Amazon USA, please support us by using this link.
Follow us
Blog
Twitter
Port details
py-scrapy 0.16.4 www on this many watch lists=1 search for ports that depend on this port
High level scraping and web crawling framework
Maintained by: clsung@FreeBSD.org search for ports maintained by this maintainer
Port Added: 14 Dec 2009 02:58:59
Also Listed In: python
License: BSD
Scrapy is a high level scraping and web crawling framework for writing
spiders to crawl and parse web pages for all kinds of purposes, from
information retrieval to monitoring or testing web sites.

WWW: http://scrapy.org/
SVNWeb : Main Web Site : Distfiles Availability : PortsMon

NOTE: FreshPorts displays only required dependencies information. Optional dependencies are not covered.

Required To Build:
  1. devel/py-setuptools
  2. lang/python27
Required To Run:
  1. devel/py-lxml
  2. databases/py-sqlite3
  3. www/py-w3lib
  4. security/py-openssl
  5. devel/py-setuptools
  6. lang/python27
  7. devel/py-twistedCore
There are no ports dependent upon this port

To install the port: cd /usr/ports/www/py-scrapy/ && make install clean
To add the package: pkg_add -r py27-Scrapy

Configuration Options 
===> The following configuration options are available for py27-Scrapy-0.16.4:
     SSL=on: SSL protocol
===> Use 'make config' to modify these settings
Master Sites:
  1. ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/
  2. http://b.pypi.python.org/packages/source/S/Scrapy/
  3. http://c.pypi.python.org/packages/source/S/Scrapy/
  4. http://d.pypi.python.org/packages/source/S/Scrapy/
  5. http://e.pypi.python.org/packages/source/S/Scrapy/
  6. http://f.pypi.python.org/packages/source/S/Scrapy/
  7. http://g.pypi.python.org/packages/source/S/Scrapy/
  8. http://pypi.crate.io/packages/source/S/Scrapy/
  9. http://pypi.inqbus.de/Scrapy/
  10. http://pypi.it.uwosh.edu/Scrapy/
  11. http://pypi.python.jp/Scrapy/
  12. http://pypi.python.org/packages/source/S/Scrapy/

Number of commits found: 8

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
12 Feb 2013 12:46:23
Original commit files touched by this commit  0.16.4
 clsung search for other commits by this committer 
- Update to 0.16.4
02 Dec 2012 10:58:49
Original commit files touched by this commit  0.16.2
 rm search for other commits by this committer 
- update to 0.16.2
- trim Makefile header
- remove indefinite article from COMMENT
- add LICENSE
- remove not needed BUILD_DEPENDS
- depend on TwistedCore via USE_TWISTED_RUN instead of direct dependency on
meta-port
- convert to optionsng
- convert PYTHON_SITELIBDIR usage with PYTHON_PKGNAMEPREFIX

PR:		173661
Submitted by:	rm (myself)
Approved by:	maintainer timeout (2 weeks+)
Feature safe:	yes
18 Nov 2011 02:22:51
Original commit files touched by this commit  0.12.0.2542
 clsung search for other commits by this committer 
- Unbreak
- take maintainership

PR:             ports/162557
Submitted by:   clsung
Approved by:    maintainer (qingfeng_AT_douban.com)
Feature safe:   yes
11 Jul 2011 20:48:01
Original commit files touched by this commit  0.12.0.2542
 pav search for other commits by this committer 
- Mark BROKEN: does not compile

Reported by:    pointyhat
28 Jun 2011 04:27:35
Original commit files touched by this commit  0.12.0.2542
 delphij search for other commits by this committer 
Update to version 0.12.0.2542, change maintainer email address to a new
one.

PR:             ports/158370
Submitted by:   maintainer
19 Mar 2011 12:38:54
Original commit files touched by this commit  0.10.3
 miwi search for other commits by this committer 
- Get Rid MD5 support
02 Oct 2010 07:55:19
Original commit files touched by this commit  0.10.3
 lwhsu search for other commits by this committer 
- Update to 0.10.3
- Add sqlite to RUN_DEPENDS
- Add support for SSL and JSON

PR:             ports/149884 (based on)
Submitted by:   lwhsu
Approved by:    maintainer timeout
14 Dec 2009 02:58:44
Original commit files touched by this commit  0.8
 wen search for other commits by this committer 
Scrapy is a high level scraping and web crawling framework for writing
spiders to crawl and parse web pages for all kinds of purposes, from
information retrieval to monitoring or testing web sites.

WWW: http://scrapy.org/

PR:             ports/136811
Submitted by:   Qing Feng <qingfeng@me.com>

Number of commits found: 8

285d
Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
otrsMay 23
otrsMay 23
otrsMay 23
otrsMay 23
chromiumMay 22
chromiumMay 22
firefox*May 21
firefox-devel*May 21
firefox-esr*May 21
firefox10*May 21
firefox15*May 21
firefox3*May 21
firefox3-devel*May 21
firefox35*May 21
firefox36*May 21

8 vulnerabilities affecting 24 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds


Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 24537
Broken 218
Deprecated 474
Ignore 633
Forbidden 2
Restricted 292
No CDROM 109
Vulnerable 25
Expired 132
Set to expire 512
Interactive 33
new 24 hours 4
new 48 hours8
new 7 days32
new fortnight63
new month215

This site
What is FreshPorts?
About the Authors
FAQ
How big is it?
The latest upgrade!
Privacy
Forums
Blog
Contact
8e7
Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD 		Valid HTML, CSS, and RSS.
Copyright © 2000-2013 DVL Software Limited. All rights reserved.
0