notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)Want a good monitor light? See my photosAll times are UTC		 Ukraine
I started running short on disk space for the non-production FreshPorts hosts. This time, I have decided to ask for donations. See my recent blog post which points to my Patreon account.
Server is being updated to FreeBSD 14.3 as you read this... and it is done.
Commit processing is stalled - it is a jail issue. I will work on it later today. 2025-09-17 12:17 UTC - It has been fixed. Sometime before 17:27 UTC.
Port details on branch 2023Q3
colly Elegant scraper and crawler framework for Golang
2.1.0_14 www on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 2.1.0_14Version of this port present on the latest quarterly branch.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2023-08-04 15:02:22
Last Update: 2023-09-08 14:39:12
Commit Hash: 793b61c
License: APACHE20
WWW:
https://go-colly.org/
Description:
With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Features: * Clean API * Fast (>1k request/sec on a single core) * Manages request delays and maximum concurrency per domain * Automatic cookie and session handling * Sync/async/parallel scraping * Distributed scraping * Caching * Automatic encoding of non-unicode responses * Robots.txt support * Google App Engine support
Homepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
Expand this list (14 items)
Collapse this list.
  1. bin/colly
  2. bin/colly-basic
  3. bin/colly-coursera_courses
  4. bin/colly-cryptocoinmarketcap
  5. bin/colly-factba.se
  6. bin/colly-hackernews_comments
  7. bin/colly-instagram
  8. bin/colly-openedx_courses
  9. bin/colly-reddit
  10. bin/colly-shopify_sitemap
  11. bin/colly-google_groups
  12. /usr/local/share/licenses/colly-2.1.0_14/catalog.mk
  13. /usr/local/share/licenses/colly-2.1.0_14/LICENSE
  14. /usr/local/share/licenses/colly-2.1.0_14/APACHE20
Collapse this list.
USE_RC_SUBR (Service Scripts)
  • no SUBR information found for this port
Dependency lines:
  • colly>0:www/colly
To install the port:
cd /usr/ports/www/colly/ && make install clean
To add the package, run one of these commands:
  • pkg install www/colly
  • pkg install colly
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: colly
Flavors: there is no flavor information for this port.
distinfo:
TIMESTAMP = 1619068742 SHA256 (gocolly-colly-v2.1.0_GH0.tar.gz) = f687b922597649033cd388ff81c388b066b4d54b414e86ed1be82fb1c1b0cc3a SIZE (gocolly-colly-v2.1.0_GH0.tar.gz) = 81626

Expand this list (32 items)

Collapse this list.

SHA256 (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 50b671f7128ac6993b7388d4e8a76901afdcaa7c6889f45687a2acc0d0753ca4 SIZE (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 101380 SHA256 (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 5f2cee3689470b1adc7af495402ccf7e047c7216d865b4b2bf55e910638e31e2 SIZE (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 17419 SHA256 (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 059edb4ec919538d236b16bdc5871fe72875e1dd1f8da8b2d09c5d884ad33752 SIZE (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 7344 SHA256 (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = bbad1b253b8de0ba40b84747086f64438a9b7c0b7950771724e8036b045596ea SIZE (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = 13218 SHA256 (antchfx-xpath-v1.1.8_GH0.tar.gz) = 3295c4338b8961122139e2b9d18cfc6c65d45d95590e6131a46dc508e559e542 SIZE (antchfx-xpath-v1.1.8_GH0.tar.gz) = 25477 SHA256 (gobwas-glob-v0.2.3_GH0.tar.gz) = 325026fc78bcebcf31151b6e060f4e1c3321b04ded3dab63b63610b323c10850 SIZE (gobwas-glob-v0.2.3_GH0.tar.gz) = 25962 SHA256 (golang-appengine-v1.6.6_GH0.tar.gz) = 0c3d1e1c7ba0b97ea3457ddd169aac0667dbbb8c8d81e011632751f75bfbb624 SIZE (golang-appengine-v1.6.6_GH0.tar.gz) = 332981 SHA256 (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = b92f918daa48048fd360f14d1a4aed6e70c1176ae6b00b0dc04094bb088e9865 SIZE (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = 26047 SHA256 (golang-net-627f9648deb9_GH0.tar.gz) = a171ecd3ca1ca546c82806d7ddba1985b18da28530cb7479ea62d90ea1f81041 SIZE (golang-net-627f9648deb9_GH0.tar.gz) = 1177189 SHA256 (golang-protobuf-v1.4.2_GH0.tar.gz) = a1e486b3ed6f502c43e10cb28bde4e8f020a420ef9958d3fbe61801492c07c87 SIZE (golang-protobuf-v1.4.2_GH0.tar.gz) = 171778 SHA256 (golang-text-v0.3.2_GH0.tar.gz) = 0b9309698f5708531c5377ab1e29b423a6d9e20c55a8d386c3b8283428212f22 SIZE (golang-text-v0.3.2_GH0.tar.gz) = 7168069 SHA256 (jawher-mow.cli-v1.1.0_GH0.tar.gz) = af18e157df5c23a1a4f05cb45fadef0a0a6f18717582656d42f6287d2bdc398a SIZE (jawher-mow.cli-v1.1.0_GH0.tar.gz) = 65838 SHA256 (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = cba9e054e07ba95b23d16b409eb7ac157e6be68c024e3fed0bbfef78524d4802 SIZE (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = 8922 SHA256 (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 318e54ee12d09e9c76fc11cf85f6297360e6444b74a6a7882450501bb952ba56 SIZE (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 1227640 SHA256 (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = c8c970cb05a93c50941a1ee550db75c9fbc7e11374a59b9002c2d87ec55851ab SIZE (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = 267071 SHA256 (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 11c466c2c9252ab8908eb319189cd7769144d8d039765f6419d605be061098c2 SIZE (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 14170

Collapse this list.

Packages (timestamps in pop-ups are UTC):
colly
ABIaarch64amd64armv6armv7i386powerpcpowerpc64powerpc64le
FreeBSD:13:latest2.1.0_282.1.0_29-2.1.0_282.1.0_29---
FreeBSD:13:quarterly2.1.0_262.1.0_26-2.1.0_262.1.0_26---
FreeBSD:14:latest2.1.0_282.1.0_29-2.1.0_272.1.0_29---
FreeBSD:14:quarterly2.1.0_262.1.0_26-2.1.0_262.1.0_26---
FreeBSD:15:latest2.1.0_282.1.0_29n/a2.1.0_26n/a---
FreeBSD:15:quarterly--n/a-n/a---
FreeBSD:16:latest--n/a-n/a---
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. go120 : lang/go120
There are no ports dependent upon this port
Configuration Options:
No options to configure
Options name:
www_colly
USES:
go:modules
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (1 items)
Collapse this list.
  1. https://codeload.github.com/gocolly/colly/tar.gz/v2.1.0?dummy=/
Collapse this list.

Number of commits found: 2

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
2.1.0_14
08 Sep 2023 14:39:12
commit hash: 793b61c98913da3088efd5af67684d2eded3e992commit hash: 793b61c98913da3088efd5af67684d2eded3e992commit hash: 793b61c98913da3088efd5af67684d2eded3e992commit hash: 793b61c98913da3088efd5af67684d2eded3e992 files touched by this commit		 Dmitri Goutnik (dmgk) search for other commits by this committer 
all: Bump PORTREVISION after lang/go120 update

Approved by:	ports-secteam (blanket)
2.1.0_13
04 Aug 2023 14:36:07
commit hash: e7d39fc40a601f25b64b6f73a05219343c290162commit hash: e7d39fc40a601f25b64b6f73a05219343c290162commit hash: e7d39fc40a601f25b64b6f73a05219343c290162commit hash: e7d39fc40a601f25b64b6f73a05219343c290162 files touched by this commit		 Dmitri Goutnik (dmgk) search for other commits by this committer 
all: Bump PORTREVISION after lang/go{119,120} update

Approved by:	ports-secteam (blanket)

Number of commits found: 2
Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
pcre2Sep 20
jenkinsSep 17
jenkins-ltsSep 17
cups*Sep 16
chromiumSep 11
gitlabSep 11
ungoogled-chromiumSep 11
chromiumSep 07
ungoogled-chromiumSep 07
exiv2Sep 04
exiv2Sep 04
py-django42Sep 04
py-django51Sep 04
py-django52Sep 04
linux-viebSep 03

6 vulnerabilities affecting 166 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2025-09-20 08:13:42 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 33644
Broken 126
Deprecated 181
Ignore 244
Forbidden 0
Restricted 2
No CDROM 1
Vulnerable 35
Expired 15
Set to expire 125
Interactive 0
new 24 hours 4
new 48 hours15
new 7 days38
new fortnight76
new month155
Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD 		Valid HTML, CSS, and RSS. Copyright © 2000-2025 Dan Langille. All rights reserved.