notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)

Why was the website so slow for so long?

The cause of the slowdown was a change to the ZFS dataset. In conjunction with the database server, very little caching was being done. This combination resulted in increased disk I/O as the system churned through the database. Details in the blog post which outlines the various things which changed. Many graphs.

Port details
pgloader Import CSV data and Large Object to PostgreSQL
2.3.1_5 databases on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port 2.3.1Version of this port present on the latest quarterly branch.
Deprecated DEPRECATED: Uses deprecated version of python
Expiration Date EXPIRATION DATE: 2020-09-15
Maintainer: pea@raveland.org search for ports maintained by this maintainer
Port Added: 2008-06-03 08:39:18
Last Update: 2020-03-08 17:01:47
SVN Revision: 528058
License: not specified in port
Description:
SVNWeb : Homepage
pkg-plist: as obtained via: make generate-plist
Expand this list (50 items)
  1. bin/pgloader
  2. lib/python2.7/site-packages/pgloader/__init__.py
  3. lib/python2.7/site-packages/pgloader/csvreader.py
  4. lib/python2.7/site-packages/pgloader/db.py
  5. lib/python2.7/site-packages/pgloader/fixedreader.py
  6. lib/python2.7/site-packages/pgloader/lo.py
  7. lib/python2.7/site-packages/pgloader/logger.py
  8. lib/python2.7/site-packages/pgloader/options.py
  9. lib/python2.7/site-packages/pgloader/options.py.bak
  10. lib/python2.7/site-packages/pgloader/pgloader.py
  11. lib/python2.7/site-packages/pgloader/reader.py
  12. lib/python2.7/site-packages/pgloader/reformat/README
  13. lib/python2.7/site-packages/pgloader/reformat/__init__.py
  14. lib/python2.7/site-packages/pgloader/reformat/mysql.py
  15. lib/python2.7/site-packages/pgloader/reformat/pgtime.py
  16. lib/python2.7/site-packages/pgloader/textreader.py
  17. lib/python2.7/site-packages/pgloader/tools.py
  18. man/man1/pgloader.1.gz
  19. share/doc/pgloader/BUGS.txt
  20. share/doc/pgloader/TODO.txt
  21. share/doc/pgloader/pgloader.1.txt
  22. share/examples/pgloader/README
  23. share/examples/pgloader/allcols/allcols.data
  24. share/examples/pgloader/allcols/allcols.sql
  25. share/examples/pgloader/clob/clob.data
  26. share/examples/pgloader/clob/clob.out
  27. share/examples/pgloader/clob/clob.sql
  28. share/examples/pgloader/cluttered/cluttered.data
  29. share/examples/pgloader/cluttered/cluttered.sql
  30. share/examples/pgloader/csv/csv.data
  31. share/examples/pgloader/csv/csv.sql
  32. share/examples/pgloader/errors/errors.data
  33. share/examples/pgloader/errors/errors.sql
  34. share/examples/pgloader/fixed/fixed.data
  35. share/examples/pgloader/fixed/fixed.sql
  36. share/examples/pgloader/parallel.conf
  37. share/examples/pgloader/parallel.sections.conf
  38. share/examples/pgloader/parallel/parallel.data
  39. share/examples/pgloader/parallel/parallel.sql
  40. share/examples/pgloader/partial/partial.data
  41. share/examples/pgloader/partial/partial.sql
  42. share/examples/pgloader/pgloader.conf
  43. share/examples/pgloader/reformat/reformat.data
  44. share/examples/pgloader/reformat/reformat.sql
  45. share/examples/pgloader/serial/serial.data
  46. share/examples/pgloader/serial/serial.sql
  47. share/examples/pgloader/simple/simple.data
  48. share/examples/pgloader/simple/simple.sql
  49. share/examples/pgloader/udc/udc.data
  50. share/examples/pgloader/udc/udc.sql
Collapse this list.
Dependency lines:
  • pgloader>0:databases/pgloader
To install the port: cd /usr/ports/databases/pgloader/ && make install clean
To add the package: pkg install pgloader
PKGNAME: pgloader
Flavors: there is no flavor information for this port.
distinfo:
Packages:
pgloader
ABIlatestquarterly
FreeBSD:11:aarch642.3.1_32.3.1_5
FreeBSD:11:amd642.3.1_52.3.1_5
FreeBSD:11:i3862.3.1_52.3.1_5
FreeBSD:12:aarch642.3.1_32.3.1_5
FreeBSD:12:amd642.3.1_52.3.1_5
FreeBSD:12:i3862.3.1_52.3.1_5
FreeBSD:13:aarch642.3.1_5-
FreeBSD:13:amd642.3.1_5-
FreeBSD:13:i3862.3.1_5-
 

Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. python2.7 : lang/python27
Runtime dependencies:
  1. __init__.py : databases/py-psycopg2@py27
  2. python2.7 : lang/python27
There are no ports dependent upon this port

Configuration Options

USES:

Master Sites:
  1. http://pgfoundry.org/frs/download.php/1814/

Number of commits found: 19

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
08 Mar 2020 17:01:47
Original commit files touched by this commit  2.3.1_5
Revision:528058
antoine search for other commits by this committer
Deprecate some ports using deprecated version of python

With hat:	portmgr
26 Jul 2019 20:46:57
Original commit files touched by this commit  2.3.1_5
Revision:507372
gerald search for other commits by this committer
Bump PORTREVISION for ports depending on the canonical version of GCC
as defined in Mk/bsd.default-versions.mk which has moved from GCC 8.3
to GCC 9.1 under most circumstances now after revision 507371.

This includes ports
 - with USE_GCC=yes or USE_GCC=any,
 - with USES=fortran,
 - using Mk/bsd.octave.mk which in turn features USES=fortran, and
 - with USES=compiler specifying openmp, nestedfct, c11, c++0x, c++11-lang,
   c++11-lib, c++14-lang, c++17-lang, or gcc-c++11-lib
plus, everything INDEX-11 shows with a dependency on lang/gcc9 now.

PR:		238330
12 Dec 2018 01:35:36
Original commit files touched by this commit  2.3.1_4
Revision:487272
gerald search for other commits by this committer
Bump PORTREVISION for ports depending on the canonical version of GCC
defined via Mk/bsd.default-versions.mk which has moved from GCC 7.4 t
GCC 8.2 under most circumstances.

This includes ports
 - with USE_GCC=yes or USE_GCC=any,
 - with USES=fortran,
 - using Mk/bsd.octave.mk which in turn features USES=fortran, and
 - with USES=compiler specifying openmp, nestedfct, c11, c++0x, c++11-lang,
   c++11-lib, c++14-lang, c++17-lang, or gcc-c++11-lib
plus, as a double check, everything INDEX-11 showed depending on lang/gcc7.

PR:		231590
30 Nov 2017 15:50:34
Original commit files touched by this commit  2.3.1_3
Revision:455210  Sanity Test Failure
mat search for other commits by this committer
Convert Python ports to FLAVORS.

  Ports using USE_PYTHON=distutils are now flavored.  They will
  automatically get flavors (py27, py34, py35, py36) depending on what
  versions they support.

  There is also a USE_PYTHON=flavors for ports that do not use distutils
  but need FLAVORS to be set.  A USE_PYTHON=noflavors can be set if
  using distutils but flavors are not wanted.

  A new USE_PYTHON=optsuffix that will add PYTHON_PKGNAMESUFFIX has been
  added to cope with Python ports that did not have the Python
  PKGNAMEPREFIX but are flavored.

  USES=python now also exports a PY_FLAVOR variable that contains the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
22 Apr 2017 12:45:43
Original commit files touched by this commit  2.3.1_3
Revision:439170
miwi search for other commits by this committer
- Fix shebangs
23 May 2016 18:36:52
Original commit files touched by this commit  2.3.1_2
Revision:415738
amdmi3 search for other commits by this committer
Convert tab after WWW: in pkg-descrs to single space as per PHB

Approved by:	portmgr blanket
19 May 2016 10:21:25
Original commit files touched by this commit  2.3.1_2
Revision:415498
amdmi3 search for other commits by this committer
- Fix trailing whitespace in pkg-descrs, categories [a-f]*

Approved by:	portmgr blanket
01 Apr 2016 14:00:57
Original commit files touched by this commit  2.3.1_2
Revision:412346
mat search for other commits by this committer
Remove ${PORTSDIR}/ from dependencies, categories d, e, f, and g.

With hat:	portmgr
Sponsored by:	Absolight
20 Oct 2014 10:41:13
Original commit files touched by this commit  2.3.1_2
Revision:371255
bapt search for other commits by this committer
Cleanup plist
19 Oct 2014 08:50:18
Original commit files touched by this commit  2.3.1_2
Revision:371173
mva search for other commits by this committer
- Convert ports from databases/ and deskutils/ to new USES=python

Approved by:	portmgr (implicit)
03 Jul 2014 21:48:44
Original commit files touched by this commit  2.3.1_2
Revision:360463  Sanity Test Failure
adamw search for other commits by this committer
Nuke NOPORTDOCS. While, here, correct a couple offenders who label examples
with PORTDOCS. And, fix a couple WITH_foo invocations.
19 May 2014 12:24:39
Original commit files touched by this commit  2.3.1_2
Revision:354530
vanilla search for other commits by this committer
Support staging, sort pkg-plist.

Approved by:	portmgr@
13 Jan 2014 21:00:04
Original commit files touched by this commit  2.3.1_2
Revision:339634
rene search for other commits by this committer
Python cleanup:
- USE_PYTHON* = 2.X -> USE_PYTHON* = 2
- USE_PYTHON* = 2.X+ -> USE_PYTHON* = yes
Reviewed by:	python (mva, rm)
Approved by:	portmgr-lurkers (mat)
20 Sep 2013 16:13:49
Original commit files touched by this commit  2.3.1_2
Revision:327717
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
databases)
12 Feb 2012 15:31:34
Original commit files touched by this commit  2.3.1_2

rm search for other commits by this committer
- convert to using PYTHON_SITELIBDIR (not functional change)
25 Feb 2011 00:12:12
Original commit files touched by this commit  2.3.1_2
  Sanity Test Failure
miwi search for other commits by this committer
- Move over to py25+ or above
- While here kick md5 support
06 Jun 2008 13:17:10
Original commit files touched by this commit  2.3.1_1

edwin search for other commits by this committer
Bump portrevision due to upgrade of devel/gettext.

The affected ports are the ones with gettext as a run-dependency
according to ports/INDEX-7 (5007 of them) and the ones with USE_GETTEXT
in Makefile (29 of them).

PR:             ports/124340
Submitted by:   edwin@
Approved by:    portmgr (pav)
05 Jun 2008 12:07:02
Original commit files touched by this commit  2.3.1

miwi search for other commits by this committer
- Update to 2.3.1

Submitted by:   Pierre-Emmanuel André <pea@raveland.org>  (maintainer via
private mail)
03 Jun 2008 08:38:16
Original commit files touched by this commit  2.3.0

miwi search for other commits by this committer
pgloader imports data from a flat file and inserts it into one or
more PostgreSQL database tables. It uses a flat file per database
table, and you can configure as many Sections as you want, each one
associating a table name and a data file.

Data are parsed and rewritten, then given to PostgreSQL COPY command.
Parsing is necessary for dealing with end of lines and eventual trailing
separator characters, and for column reordering: your flat data file may
not have the same column order as the database table has.

pgloader is also able to load some large objects data into PostgreSQL,
as of now only Informix UNLOAD data files are supported. This command
gives large objects data location information into the main data file.
pgloader parse it add the text or bytea content properly escaped to the
COPY data.

pgloader issues some timing statistics every "commit_every" commits. At
the end of processing each section, a summary of overall operations,
numbers of rows copied and commits, time it took in seconds, errors
logged and database errors is issued.

WWW:    http://pgfoundry.org/projects/pgloader/

PR:             ports/124210
Submitted by:   Pierre-Emmanuel Andre

Number of commits found: 19

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
The latest upgrade!
Privacy
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
chromiumMay 24
piwigoMay 23
drupal7May 22
tomcat-develMay 22
tomcat7May 22
tomcat85May 22
tomcat9May 22
unboundMay 22
zabbix3-proxyMay 20
zabbix3-serverMay 20
rubygem-actionpack52May 19
rubygem-actionpack60May 19
rubygem-actionview52May 19
rubygem-actionview60May 19
rubygem-activestorage52May 19

14 vulnerabilities affecting 165 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last updated:
2020-05-24 19:56:04


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 39415
Broken 82
Deprecated 622
Ignore 372
Forbidden 5
Restricted 147
No CDROM 76
Vulnerable 24
Expired 17
Set to expire 577
Interactive 0
new 24 hours 3
new 48 hours14
new 7 days38
new fortnight83
new month251

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2020 Dan Langille. All rights reserved.