notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Port details
py-grab Site scraping framework
0.6.41 devel on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port
0.6.41Version of this port present on the latest quarterly branch.
Maintainer: rm@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2013-06-02 07:50:59
Last Update: 2018-07-10 18:00:26
SVN Revision: 474388
Also Listed In: python
License: MIT
Grab is a python web scraping framework. Grab provides tons of helpful methods
to scrape web sites and to process the scraped content:

 * Automatic cookies (session) support
 * HTTP and SOCKS proxy with and without authorization
 * Keep-Alive support
 * IDN support
 * Tools to work with web forms
 * Easy multipart file uploading
 * Flexible customization of HTTP requests
 * Automatic charset detection
 * Powerful API of extracting info from HTML documents with XPATH queries
 * Asynchronous API to make thousands of simultaneous queries. This part of
   library called Spider and it is too big to even list its features in this
   README.
 * Python 3 ready

WWW: http://grablib.org/
SVNWeb : Homepage

There is no configure plist information for this port.

Dependency lines:
  • py27-grab>0:devel/py-grab

To install the port: cd /usr/ports/devel/py-grab/ && make install clean
To add the package: pkg install py27-grab

PKGNAME: py27-grab

There is no flavor information for this port.

distinfo:

TIMESTAMP = 1531239928
SHA256 (grab-0.6.41.tar.gz) = 86aeba303179c1ec8779bd28d30d99458dc450747e537f2735965788651364e3
SIZE (grab-0.6.41.tar.gz) = 1062360


NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.

Build dependencies:
  1. py27-setuptools>0 : devel/py-setuptools@py27
  2. python2.7 : lang/python27
Runtime dependencies:
  1. py27-lxml>0 : devel/py-lxml@py27
  2. py27-pycurl>0 : ftp/py-pycurl@py27
  3. py27-weblib>0 : devel/py-weblib@py27
  4. py27-selection>0 : devel/py-selection@py27
  5. py27-six>0 : devel/py-six@py27
  6. py27-user_agent>0 : www/py-user_agent@py27
  7. py27-defusedxml>0 : devel/py-defusedxml@py27
  8. py27-setuptools>0 : devel/py-setuptools@py27
  9. python2.7 : lang/python27
There are no ports dependent upon this port

Configuration Options
     No options to configure

USES:
python

Master Sites:
  1. https://files.pythonhosted.org/packages/source/g/grab/
  2. https://pypi.org/packages/source/g/grab/
Notes from UPDATING
These upgrade notes are taken from /usr/ports/UPDATING
  • 2017-11-30
    Affects: */py*
    Author: mat@FreeBSD.org
    Reason: 
      Ports using Python via USES=python are now flavored.  All the py3-* ports
      have been removed and folded into their py-* master ports.
    
      People using Poudriere 3.2+ and binary packages do not have to do anything.
    
      For other people, to build the Python 3.6 version of, for example,
      databases/py-gdbm, you need to run:
    
        # make FLAVOR=py36 install
    
    

Number of commits found: 27

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
10 Jul 2018 17:00:26
Original commit files touched by this commit  0.6.41
Revision:474388
rm search for other commits by this committer
devel/py-grab: update to 0.6.41
20 Jun 2018 17:05:44
Original commit files touched by this commit  0.6.38
Revision:472884
mat search for other commits by this committer
Use PY_FLAVOR for dependencies.

FLAVOR is the current port's flavor, it should not be used outside of
this scope.

Sponsored by:	Absolight
30 Nov 2017 15:50:34
Original commit files touched by this commit  0.6.38
Revision:455210  Sanity Test Failure
mat search for other commits by this committer
Convert Python ports to FLAVORS.

  Ports using USE_PYTHON=distutils are now flavored.  They will
  automatically get flavors (py27, py34, py35, py36) depending on what
  versions they support.

  There is also a USE_PYTHON=flavors for ports that do not use distutils
  but need FLAVORS to be set.  A USE_PYTHON=noflavors can be set if
  using distutils but flavors are not wanted.

  A new USE_PYTHON=optsuffix that will add PYTHON_PKGNAMESUFFIX has been
  added to cope with Python ports that did not have the Python
  PKGNAMEPREFIX but are flavored.

  USES=python now also exports a PY_FLAVOR variable that contains the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
06 Jun 2017 20:51:30
Original commit files touched by this commit  0.6.38
Revision:442796
rm search for other commits by this committer
devel/py-grab: update to 0.6.38
07 Feb 2017 19:08:18
Original commit files touched by this commit  0.6.35
Revision:433582
rm search for other commits by this committer
devel/py-grab: update to 0.6.35
05 Feb 2017 16:07:34
Original commit files touched by this commit  0.6.34
Revision:433424
rm search for other commits by this committer
devel/py-grab: add missing dependency
05 Feb 2017 16:04:36
Original commit files touched by this commit  0.6.34
Revision:433423
rm search for other commits by this committer
devel/py-grab: update to 0.6.34
28 Jan 2017 09:58:31
Original commit files touched by this commit  0.6.33
Revision:432615
rm search for other commits by this committer
devel/py-grab: update to 0.6.33
13 Jan 2017 20:07:19
Original commit files touched by this commit  0.6.32
Revision:431417
rm search for other commits by this committer
devel/py-grab: update to 0.6.32
01 Apr 2016 14:00:57
Original commit files touched by this commit  0.6.30
Revision:412346
mat search for other commits by this committer
Remove ${PORTSDIR}/ from dependencies, categories d, e, f, and g.

With hat:	portmgr
Sponsored by:	Absolight
13 Dec 2015 13:45:04
Original commit files touched by this commit  0.6.30
Revision:403669
rm search for other commits by this committer
devel/py-grab: update to 0.6.30
12 Dec 2015 23:43:51
Original commit files touched by this commit  0.6.29_1
Revision:403641
sunpoet search for other commits by this committer
- Move ftp/py-curl to ftp/py-pycurl
- Bump PORTREVISION for dependent ports
15 Nov 2015 21:04:27
Original commit files touched by this commit  0.6.29
Revision:401731
rm search for other commits by this committer
devel/py-grab: update to 0.6.29
14 Aug 2015 18:49:02
Original commit files touched by this commit  0.6.22
Revision:394250
rm search for other commits by this committer
devel/py-grab: update to 0.6.22
13 Aug 2015 21:26:26
Original commit files touched by this commit  0.6.21
Revision:394195
rm search for other commits by this committer
devel/py-grab: update to 0.6.21
02 Apr 2015 18:29:25
Original commit files touched by this commit  0.5.5
Revision:383035
rm search for other commits by this committer
devel/py-grab: update to 0.5.5
22 Feb 2015 22:12:42
Original commit files touched by this commit  0.5.2_1
Revision:379633
rm search for other commits by this committer
devel/py-grab: remove erroneously added dependency on py-six
22 Feb 2015 22:01:18
Original commit files touched by this commit  0.5.2
Revision:379631
rm search for other commits by this committer
devel/py-grab: update to 0.5.2
22 Dec 2014 17:12:27
Original commit files touched by this commit  0.4.13_1
Revision:375249
feld search for other commits by this committer
Update "BSD" license in devel category
20 Oct 2014 16:04:14
Original commit files touched by this commit  0.4.13_1
Revision:371280
mva search for other commits by this committer
- Convert ports of devel/ to USES=python

Approved by:	portmgr (implicit)
10 Feb 2014 14:04:45
Original commit files touched by this commit  0.4.13_1
Revision:343636
rm search for other commits by this committer
- do not use easy_install, convert to auto-generated packing list
- move DIST_SUBDIR upper, where appropriate
- add trailing slash to WWW url, where appropriate
- bump PORTREVISION

Wasn't able to identify clauses amount for some BSD licenses, so bear with me.
13 Jan 2014 21:00:04
Original commit files touched by this commit  0.4.13
Revision:339634
rene search for other commits by this committer
Python cleanup:
- USE_PYTHON* = 2.X -> USE_PYTHON* = 2
- USE_PYTHON* = 2.X+ -> USE_PYTHON* = yes
Reviewed by:	python (mva, rm)
Approved by:	portmgr-lurkers (mat)
20 Sep 2013 17:13:47
Original commit files touched by this commit  0.4.13
Revision:327724
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
devel part 3)
14 Sep 2013 09:41:34
Original commit files touched by this commit  0.4.13
Revision:327256
rm search for other commits by this committer
- update to 0.4.13
28 Aug 2013 18:37:41
Original commit files touched by this commit  0.4.12
Revision:325549
rm search for other commits by this committer
- update to 0.4.12
11 Jun 2013 21:24:12
Original commit files touched by this commit  0.4.11
Revision:320646
rm search for other commits by this committer
- update to 0.4.11
02 Jun 2013 07:50:45
Original commit files touched by this commit  0.4.10
Revision:319642
rm search for other commits by this committer
Grab is site scraping framework. Grab could be used for:

 - website data mining
 - work with network API
 - automation of actions performed on websites

WWW: http://grablib.org/

Number of commits found: 27

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
The latest upgrade!
Privacy
Forums
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
zncJun 22
firefoxJun 21
firefox-esrJun 21
thunderbirdJun 21
thunderbirdJun 21
firefox*Jun 20
firefox-esr*Jun 20
vlcJun 20
vlcJun 20
waterfox*Jun 20
ImageMagick6*Jun 17
ImageMagick6-nox11*Jun 17
ImageMagick7*Jun 17
ImageMagick7-nox11*Jun 17
GraphicsMagickJun 16

16 vulnerabilities affecting 123 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last updated:
2019-06-22 13:48:42


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 36730
Broken 86
Deprecated 122
Ignore 308
Forbidden 3
Restricted 162
No CDROM 74
Vulnerable 32
Expired 14
Set to expire 92
Interactive 0
new 24 hours 4
new 48 hours7
new 7 days31
new fortnight65
new month160

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2019 Dan Langille. All rights reserved.