notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)Want a good monitor light? See my photosAll times are UTC		 Ukraine

Bot filter coming soon

To deter bots pegging the database CPU to 100%, a bot testing filter to be added to the website. This should not affect newsfeeds etc. Anubis seems light-weight - it is already in use within the FreeBSD Project. This notice is just a heads up in case you see something odd. This notice will be updated after Anubis is installed.

Port details on branch 2024Q2
colly Elegant scraper and crawler framework for Golang
2.1.0_20 www on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 2.1.0_20Version of this port present on the latest quarterly branch.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2024-04-15 08:39:30
Last Update: 2024-06-15 09:57:50
Commit Hash: aa2919f
License: APACHE20
WWW:
https://go-colly.org/
Description:
With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Features: * Clean API * Fast (>1k request/sec on a single core) * Manages request delays and maximum concurrency per domain * Automatic cookie and session handling * Sync/async/parallel scraping * Distributed scraping * Caching * Automatic encoding of non-unicode responses * Robots.txt support * Google App Engine support
Homepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
Expand this list (14 items)
Collapse this list.
  1. bin/colly
  2. bin/colly-basic
  3. bin/colly-coursera_courses
  4. bin/colly-cryptocoinmarketcap
  5. bin/colly-factba.se
  6. bin/colly-hackernews_comments
  7. bin/colly-instagram
  8. bin/colly-openedx_courses
  9. bin/colly-reddit
  10. bin/colly-shopify_sitemap
  11. bin/colly-google_groups
  12. /usr/local/share/licenses/colly-2.1.0_20/catalog.mk
  13. /usr/local/share/licenses/colly-2.1.0_20/LICENSE
  14. /usr/local/share/licenses/colly-2.1.0_20/APACHE20
Collapse this list.
Dependency lines:
  • colly>0:www/colly
To install the port:
cd /usr/ports/www/colly/ && make install clean
To add the package, run one of these commands:
  • pkg install www/colly
  • pkg install colly
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: colly
Flavors: there is no flavor information for this port.
distinfo:
TIMESTAMP = 1619068742 SHA256 (gocolly-colly-v2.1.0_GH0.tar.gz) = f687b922597649033cd388ff81c388b066b4d54b414e86ed1be82fb1c1b0cc3a SIZE (gocolly-colly-v2.1.0_GH0.tar.gz) = 81626

Expand this list (32 items)

Collapse this list.

SHA256 (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 50b671f7128ac6993b7388d4e8a76901afdcaa7c6889f45687a2acc0d0753ca4 SIZE (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 101380 SHA256 (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 5f2cee3689470b1adc7af495402ccf7e047c7216d865b4b2bf55e910638e31e2 SIZE (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 17419 SHA256 (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 059edb4ec919538d236b16bdc5871fe72875e1dd1f8da8b2d09c5d884ad33752 SIZE (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 7344 SHA256 (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = bbad1b253b8de0ba40b84747086f64438a9b7c0b7950771724e8036b045596ea SIZE (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = 13218 SHA256 (antchfx-xpath-v1.1.8_GH0.tar.gz) = 3295c4338b8961122139e2b9d18cfc6c65d45d95590e6131a46dc508e559e542 SIZE (antchfx-xpath-v1.1.8_GH0.tar.gz) = 25477 SHA256 (gobwas-glob-v0.2.3_GH0.tar.gz) = 325026fc78bcebcf31151b6e060f4e1c3321b04ded3dab63b63610b323c10850 SIZE (gobwas-glob-v0.2.3_GH0.tar.gz) = 25962 SHA256 (golang-appengine-v1.6.6_GH0.tar.gz) = 0c3d1e1c7ba0b97ea3457ddd169aac0667dbbb8c8d81e011632751f75bfbb624 SIZE (golang-appengine-v1.6.6_GH0.tar.gz) = 332981 SHA256 (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = b92f918daa48048fd360f14d1a4aed6e70c1176ae6b00b0dc04094bb088e9865 SIZE (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = 26047 SHA256 (golang-net-627f9648deb9_GH0.tar.gz) = a171ecd3ca1ca546c82806d7ddba1985b18da28530cb7479ea62d90ea1f81041 SIZE (golang-net-627f9648deb9_GH0.tar.gz) = 1177189 SHA256 (golang-protobuf-v1.4.2_GH0.tar.gz) = a1e486b3ed6f502c43e10cb28bde4e8f020a420ef9958d3fbe61801492c07c87 SIZE (golang-protobuf-v1.4.2_GH0.tar.gz) = 171778 SHA256 (golang-text-v0.3.2_GH0.tar.gz) = 0b9309698f5708531c5377ab1e29b423a6d9e20c55a8d386c3b8283428212f22 SIZE (golang-text-v0.3.2_GH0.tar.gz) = 7168069 SHA256 (jawher-mow.cli-v1.1.0_GH0.tar.gz) = af18e157df5c23a1a4f05cb45fadef0a0a6f18717582656d42f6287d2bdc398a SIZE (jawher-mow.cli-v1.1.0_GH0.tar.gz) = 65838 SHA256 (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = cba9e054e07ba95b23d16b409eb7ac157e6be68c024e3fed0bbfef78524d4802 SIZE (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = 8922 SHA256 (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 318e54ee12d09e9c76fc11cf85f6297360e6444b74a6a7882450501bb952ba56 SIZE (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 1227640 SHA256 (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = c8c970cb05a93c50941a1ee550db75c9fbc7e11374a59b9002c2d87ec55851ab SIZE (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = 267071 SHA256 (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 11c466c2c9252ab8908eb319189cd7769144d8d039765f6419d605be061098c2 SIZE (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 14170

Collapse this list.

No package information for this port in our database
Sometimes this happens. Not all ports have packages. Perhaps there is a build error. Check the fallout link: pkg-fallout
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. go121 : lang/go121
There are no ports dependent upon this port
Configuration Options:
No options to configure
Options name:
www_colly
USES:
go:modules
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (1 items)
Collapse this list.
  1. https://codeload.github.com/gocolly/colly/tar.gz/v2.1.0?dummy=/
Collapse this list.

Number of commits found: 3

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
2.1.0_20
15 Jun 2024 09:57:50
commit hash: aa2919fafeb561c987ff7957a14f3bdbd4b62399commit hash: aa2919fafeb561c987ff7957a14f3bdbd4b62399commit hash: aa2919fafeb561c987ff7957a14f3bdbd4b62399commit hash: aa2919fafeb561c987ff7957a14f3bdbd4b62399 files touched by this commit		 Ashish SHUKLA (ashish) search for other commits by this committer 
all: Bump after lang/go121 update

MFH:		2024Q2
(cherry picked from commit 746fa696a12ef1ca798e36baf087f579375b8cd1)
2.1.0_19
13 May 2024 18:28:41
commit hash: 8db69aebd121759c5b407c78e9e82a26b229efb9commit hash: 8db69aebd121759c5b407c78e9e82a26b229efb9commit hash: 8db69aebd121759c5b407c78e9e82a26b229efb9commit hash: 8db69aebd121759c5b407c78e9e82a26b229efb9 files touched by this commit		 Ashish SHUKLA (ashish) search for other commits by this committer 
all: Bump after lang/go121 update

MFH:		2024Q2
(cherry picked from commit fce0cc32720e61042bc675152b116f9e61532e92)
2.1.0_18
15 Apr 2024 08:31:41
commit hash: 0bbb270314a986cf7200e39bb7c49823b7147b75commit hash: 0bbb270314a986cf7200e39bb7c49823b7147b75commit hash: 0bbb270314a986cf7200e39bb7c49823b7147b75commit hash: 0bbb270314a986cf7200e39bb7c49823b7147b75 files touched by this commit		 Ashish SHUKLA (ashish) search for other commits by this committer 
all: Bump after lang/go121 update

MFH:		2024Q2
(cherry picked from commit 32b284679a1954ef1e0c0d52c4741d00e36dc6e0)

Number of commits found: 3
Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
openh264Jun 22
clamavJun 20
clamavJun 20
chromiumJun 19
ungoogled-chromiumJun 19
navidromeJun 18
chromiumJun 17
chromiumJun 17
firefoxJun 17
ungoogled-chromiumJun 17
ungoogled-chromiumJun 17
firefoxJun 15
firefox-esrJun 15
thunderbirdJun 15
webminJun 15

15 vulnerabilities affecting 243 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2025-06-24 08:54:37 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 33392
Broken 142
Deprecated 279
Ignore 258
Forbidden 0
Restricted 2
No CDROM 1
Vulnerable 31
Expired 15
Set to expire 221
Interactive 0
new 24 hours 2
new 48 hours12
new 7 days75
new fortnight98
new month180
Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD 		Valid HTML, CSS, and RSS. Copyright © 2000-2025 Dan Langille. All rights reserved.