As an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Want a good monitor light? See my photos
All times are UTCnotbug
Ukraine
Menu ☰ Menu
Search engines are not blocked. Try using "site:www.freshports.org" and your search terms.
Volunteers wanted to help translate FreshPorts
Searches without login should now work. You must get asked to click a button.
Port details on branch 2023Q1
colly Elegant scraper and crawler framework for Golang
2.1.0_9 www Σ=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 2.3.0_1Version of this port present on the latest quarterly branch.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2023-02-17 10:51:08
Last Update: 2023-03-09 19:50:37
Commit Hash: 636f0a9
License: APACHE20
WWW:
https://go-colly.org/
Description: #
With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Features: * Clean API * Fast (>1k request/sec on a single core) * Manages request delays and maximum concurrency per domain * Automatic cookie and session handling * Sync/async/parallel scraping * Distributed scraping * Caching * Automatic encoding of non-unicode responses * Robots.txt support * Google App Engine support
Homepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages: #
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist #
Expand this list (14 items)
Collapse this list.
  1. bin/colly
  2. bin/colly-basic
  3. bin/colly-coursera_courses
  4. bin/colly-cryptocoinmarketcap
  5. bin/colly-factba.se
  6. bin/colly-hackernews_comments
  7. bin/colly-instagram
  8. bin/colly-openedx_courses
  9. bin/colly-reddit
  10. bin/colly-shopify_sitemap
  11. bin/colly-google_groups
  12. /usr/local/share/licenses/colly-2.1.0_9/catalog.mk
  13. /usr/local/share/licenses/colly-2.1.0_9/LICENSE
  14. /usr/local/share/licenses/colly-2.1.0_9/APACHE20
Collapse this list.
USE_RC_SUBR (Service Scripts)
  • no SUBR information found for this port
Dependency lines:
  • colly>0:www/colly
To install the port: #
cd /usr/ports/www/colly/ && make install clean
To add the package, run one of these commands:
  • pkg install www/colly
  • pkg install colly
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: colly
Flavors: there is no flavor information for this port. #
distinfo: #
TIMESTAMP = 1619068742 SHA256 (gocolly-colly-v2.1.0_GH0.tar.gz) = f687b922597649033cd388ff81c388b066b4d54b414e86ed1be82fb1c1b0cc3a SIZE (gocolly-colly-v2.1.0_GH0.tar.gz) = 81626

Expand this list (32 items)

Collapse this list.

SHA256 (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 50b671f7128ac6993b7388d4e8a76901afdcaa7c6889f45687a2acc0d0753ca4 SIZE (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 101380 SHA256 (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 5f2cee3689470b1adc7af495402ccf7e047c7216d865b4b2bf55e910638e31e2 SIZE (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 17419 SHA256 (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 059edb4ec919538d236b16bdc5871fe72875e1dd1f8da8b2d09c5d884ad33752 SIZE (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 7344 SHA256 (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = bbad1b253b8de0ba40b84747086f64438a9b7c0b7950771724e8036b045596ea SIZE (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = 13218 SHA256 (antchfx-xpath-v1.1.8_GH0.tar.gz) = 3295c4338b8961122139e2b9d18cfc6c65d45d95590e6131a46dc508e559e542 SIZE (antchfx-xpath-v1.1.8_GH0.tar.gz) = 25477 SHA256 (gobwas-glob-v0.2.3_GH0.tar.gz) = 325026fc78bcebcf31151b6e060f4e1c3321b04ded3dab63b63610b323c10850 SIZE (gobwas-glob-v0.2.3_GH0.tar.gz) = 25962 SHA256 (golang-appengine-v1.6.6_GH0.tar.gz) = 0c3d1e1c7ba0b97ea3457ddd169aac0667dbbb8c8d81e011632751f75bfbb624 SIZE (golang-appengine-v1.6.6_GH0.tar.gz) = 332981 SHA256 (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = b92f918daa48048fd360f14d1a4aed6e70c1176ae6b00b0dc04094bb088e9865 SIZE (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = 26047 SHA256 (golang-net-627f9648deb9_GH0.tar.gz) = a171ecd3ca1ca546c82806d7ddba1985b18da28530cb7479ea62d90ea1f81041 SIZE (golang-net-627f9648deb9_GH0.tar.gz) = 1177189 SHA256 (golang-protobuf-v1.4.2_GH0.tar.gz) = a1e486b3ed6f502c43e10cb28bde4e8f020a420ef9958d3fbe61801492c07c87 SIZE (golang-protobuf-v1.4.2_GH0.tar.gz) = 171778 SHA256 (golang-text-v0.3.2_GH0.tar.gz) = 0b9309698f5708531c5377ab1e29b423a6d9e20c55a8d386c3b8283428212f22 SIZE (golang-text-v0.3.2_GH0.tar.gz) = 7168069 SHA256 (jawher-mow.cli-v1.1.0_GH0.tar.gz) = af18e157df5c23a1a4f05cb45fadef0a0a6f18717582656d42f6287d2bdc398a SIZE (jawher-mow.cli-v1.1.0_GH0.tar.gz) = 65838 SHA256 (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = cba9e054e07ba95b23d16b409eb7ac157e6be68c024e3fed0bbfef78524d4802 SIZE (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = 8922 SHA256 (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 318e54ee12d09e9c76fc11cf85f6297360e6444b74a6a7882450501bb952ba56 SIZE (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 1227640 SHA256 (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = c8c970cb05a93c50941a1ee550db75c9fbc7e11374a59b9002c2d87ec55851ab SIZE (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = 267071 SHA256 (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 11c466c2c9252ab8908eb319189cd7769144d8d039765f6419d605be061098c2 SIZE (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 14170

Collapse this list.

No package information for this port in our database #
Sometimes this happens. Not all ports have packages. Perhaps there is a build error. Check the fallout link: pkg-fallout
Dependencies #
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies: #
  1. go119 : lang/go119
There are no ports dependent upon this port #
Configuration Options: #
No options to configure
Options name: #
www_colly
USES: #
go:modules
FreshPorts was unable to extract/find any pkg message #
Master Sites: #
Expand this list (1 items)
Collapse this list.
  1. https://codeload.github.com/gocolly/colly/tar.gz/v2.1.0?dummy=/
Collapse this list.

Number of commits found: 2 #

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
2.1.0_9
09 Mar 2023 19:50:37
commit hash: 636f0a9700972e851eb2139edc655a613f8c5a25commit hash: 636f0a9700972e851eb2139edc655a613f8c5a25commit hash: 636f0a9700972e851eb2139edc655a613f8c5a25commit hash: 636f0a9700972e851eb2139edc655a613f8c5a25 files touched by this commit		 Dmitri Goutnik (dmgk) search for other commits by this committer 
all: Bump PORTREVISION after lang/go119 update

Direct commit to quarterly to bump Go ports revisions after 61a665d2d8d2

Approved by:    ports-secteam (blanket)
2.1.0_8
17 Feb 2023 10:49:10
commit hash: 9ff952570bc5120a01d31a8406f17ad49ddfb2e9commit hash: 9ff952570bc5120a01d31a8406f17ad49ddfb2e9commit hash: 9ff952570bc5120a01d31a8406f17ad49ddfb2e9commit hash: 9ff952570bc5120a01d31a8406f17ad49ddfb2e9 files touched by this commit		 Dmitri Goutnik (dmgk) search for other commits by this committer 
all: Bump PORTREVISION after lang/go119 update

Direct commit to quarterly to bump Go ports revisions after f30271912e48

Approved by:	riggs (ports-secteam)

Number of commits found: 2

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Latest Vulnerabilities
libX11Oct 17
libXpmOct 17
libXrenderOct 17
libXtstOct 17
miniupnpdOct 16
mod_wsgiOct 16
p5-Text-CSV_XSOct 16
newsboatOct 15
nginxOct 15
nginx-develOct 15
nginx-fullOct 15
nginx-liteOct 15
nginx-module-cache-purgeOct 15
nsdOct 15
curlOct 14

33 vulnerabilities affecting 399 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2026-10-17 13:07:59 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 35266
Broken 74
Deprecated 339
Ignore 191
Forbidden 0
Restricted 1
No CDROM 1
Vulnerable 44
Expired 8
Set to expire 264
Interactive 0
new 24 hours 10
new 48 hours13
new 7 days69
new fortnight106
new month225
Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD 		Valid HTML, CSS, and RSS. Copyright © 2000-2026 Dan Langille. All rights reserved.