It was a few days ago that I was thinking about search engines crawling through this website. I began to wonder just how many web pages there are here. To calculate this total, it's not just a simple matter of counting files on disk. Most of the web pages are created from entries in the database. One recent evening, I started to design a formula to find out how many web pages there are. Roughly. This will not be 100% accurate, but it will be close.

First, let's count the number of pages on disk:

$ ls *.php | wc -l
69

There is a page for each category:

# select count(*) from categories;
 count
-------
   109
(1 row)


There are ports, and there are deleted ports. I'll show both:

# select count(*) from ports_all where status = 'A';
 count
-------
 24516

# select count(*) from ports_all where status = 'D';
 count
-------
  8401
(1 row)


There is a page for each file in the ports tree:

[dan@ngaio:/usr/ports] $ find . | wc -l
322084
[dan@ngaio:/usr/ports] $

There is a page for each commit:

# select count(*) from commit_log;
 count
-------
269938
(1 row)


For each commit, you can view the files modified by that commit for a particular port:

# select count(*) from commit_log_ports;
 count
-------
538046
(1 row)


For each day, there is a page showing the commits for that day. How many days do we have?

# select count(distinct commit_date) from commit_log;
 count
-------
  4730
(1 row)


Each user has a page:

# select count(*) from users;
 count
-------
 10806
(1 row)


For each watch list, there is a page:

# select count(*) from watch_list;
 count
-------
 11206
(1 row)


That gives a grand total of 1,189,905 pages. On my last count, that's about 0.014767% of the web pages on Google¹

Notes

• These statistics are updated daily.
• ¹The number of Google pages used in this calculation is 8,058,044,651.

The total space used by the FreshPorts database is:

# select pg_database_size('freshports.org');
 pg_database_size
------------------
18,357,363,512
(1 row)


That's bytes...

This value might be easier to parse: 17 GB

5 vulnerabilities affecting 20 ports have been reported in the past 14 days

^* - modified, not new

All vulnerabilities