11:22 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Introduce PY_BACKPORTS.ZSTD

The minimal version is set to 1.0.0 because it is required by devel/py-hatch and
net/py-urllib3.

    fbf1a69

07:17 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CYTHON3_DEPENDS

- Cosmetic change

    3a890f6

07:17 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

    7e12fc1

16:32 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update USE_PYTHON=cython3{,_run,_test}

py-lupa 2.6 requires cython 3.1.6+.

    3314d66

22:40 Charlie Li (vishwin)  Author: Wen Heping

lang/python313: add

What's new: https://docs.python.org/3/whatsnew/3.13.html

Most notably, introduce free-threaded mode. As this mode changes
the ABI, the entire distribution lives in a separate hierarchy, and
thus a new child port (lang/python313t) and FLAVOR (py313t) are
introduced.

Co-authored-by: vishwin
PR: 274671
Differential Revision: https://reviews.freebsd.org/D49680

    edcf1d7

20:11 Matthias Andree (mandree) 

lang/python314: get port ready to ship

claim maintainership on the new port - not doing that with the
previous commit by wen@ to have a clear distinction who contributed
what.

- require archivers/zstd since it's part of the Python standard library:
  https://docs.python.org/3.14/whatsnew/3.14.html#whatsnew314-zstandard

- refresh Makefile.pre.in patch

- skip test_gdb without WITH_DEBUG

  test_gdb has test_pretty_print, which requires debug symbols.
  Skip it if WITH_DEBUG is not defined.

- drop --with-system-ffi configure option, which is no longer supported
  and its behaviour is now the default

- move sqlite3 extension back into port
  because the separate port fails to build
  (mark the external python:-3.13)

PR:		282176

    6064873

17:23 Matthias Andree (mandree) 

*: Revise USES=python:... version range constraints

and strip all lower bounds of 3.9 or 3.10 because they are implied now.

python:3.9-X  -> python:-X
python:3.9+   -> python
python:3.10-X -> python:-X
python:3.10+  -> python
(options such as ,build preserved)

    1403bb7

17:56 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Fix typo

Reported by:	Herbert J. Skuhra <herbert@gojira.at>

    4c35233

13:48 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Fix f68ce0bd2825dccfb0fcf52fecf6e4c0d2796d69

The CRYPTOGRAPHY_DEPENDS change is unintentional.

    35fabf2

00:00 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update PY_TOMLI

devel/py-pyproject-api 1.10.0 requires textproc/py-tomli 2.3+.

    f68ce0b

18:16 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Clean up USE_PYTHON=pytest4

Reported by:	adamw

    16fd422

11:30 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update PY_TOMLI

devel/py-requirements-detector 1.4.0 requires textproc/py-tomli 2.2.1+.

    c4d86b0

11:29 Po-Chuan Hsieh (sunpoet) 

lang/cython3: Update to 3.1.2

Changes:	https://github.com/cython/cython/releases
		https://github.com/cython/cython/blob/master/CHANGES.rst

    c16c62c

20:28 Charlie Li (vishwin) 

python.mk: rename PYTHON_EXT_SUFFIX to PYTHON_TAG, document, etc

EXT_SUFFIX, according to PEP 3149, refers to the full tag and
extension for compiled extension module objects, eg .cpython-311.so,
.cpython-313t.so, etc. We do not use the correct semantic meaning,
and this usage becomes ambiguous and confusing when tags do not
match between bytecode and compiled extension module objects.

Rename our PYTHON_EXT_SUFFIX to PYTHON_TAG to align with PEP 3147's
specification of a magic tag, which consists of implementation name
and shorthand version only. This is meant for bytecode and other
files containing this tag in their filename that do not depend on
a specific Python ABI for the same version. Chase all existing
consumers.

Introduce PYTHON_SOABI to align with PEP 3149's specification of a
tag, which consists of implementation name, shorthand version and
any ABI flags present (this and PYTHON_TAG are identical without
ABI flags). This is meant for compiled extension module objects and
other files that depend on a specific Python ABI for the same
version.

Add documentation for these variables that our PYTHON_EXT_SUFFIX
never had.

PR: 274671
Event: Kitchener-Waterloo Hackathon 202506

    4f0eba1

19:52 Charlie Li (vishwin) 

python.mk: move ABI flag removal modifier out of ${_VC}

Ugly hack needed by older bmake versions, ie not -CURRENT:

: bmake: "/usr/ports/Mk/Uses/python.mk" line 471: Unknown modifier "/"
: bmake: "/usr/ports/Mk/Uses/python.mk" line 471: Malformed conditional
(!empty(_PYTHON_VERSION_MAXIMUM) && (${_PYTHON_VERSION:${_VC}} >
${_PYTHON_VERSION_MAXIMUM:${_VC}}))

Fixes: ccaff6c14f2078ddc0edcbf26d7ee7e48b80c2a8
Reported by: cmt
PR: 274671
Event: Kitchener-Waterloo Hackathon 202506

    b2cf9fa

19:15 Charlie Li (vishwin) 

python.mk: prepare handling versions with ABI flags appended

Starting Python 3.13 there is an experimental free-threaded mode
that effectively warrants a separate distribution from "vanilla"
3.13. This mode includes appends an ABI flag so the resulting version
is 3.13t. Some of the logic for comparing versions and generating
flavours, amongst others, breaks since "3.13t" is not numeric, so
adjust accordingly. Also account for 3.13t being a child port as
the difference is one configure flag.

To this effect, introduce two new read-only public variables,
PYTHON_BASESUFFIX and PYTHON_BASEVER, for cases where the ABI flag
in PYTHON_SUFFIX and PYTHON_VER is not warranted. Shift PYTHON_EXT_SUFFIX
to use PYTHON_BASESUFFIX.

PR: 274671
Event: Kitchener-Waterloo Hackathon 202506

    ccaff6c

18:48 Charlie Li (vishwin) 

python.mk: privatise PYMAGICTAG

Used as a command to populate the correct tag for bytecode files
according to PEP 3147 under USE_PYTHON=py3kplist. Not for general
use.

Event: Kitchener-Waterloo Hackathon 202506

    5cfc141

18:21 Alexander Leidinger (netchild) 

Mk/Features: Add features for fortify, zeroregs and stack autoinit.

Those 3 features for ports go along with the cooresponding features from
the basesystem (some only availabe in -current).

The options you can put into make.conf for the ports collections are:

WITH_FORTIFY=yes
    This enables mitigations of common memory safety issues, such as buffer
    overflows, by adding checks to functions like memcpy, strcpy, sprintf,
    and others when the compiler can determine the size of the destination
    buffer at compile time.

WITH_STACK_AUTOINIT=yes
    This enables a compiler specific option to automatically initialize
    local (automatic) variables to prevent the use of uninitialized memory.

WITH_ZEROREGS=yes
    Zero call-used registers at function return to increase program
    security by either mitigating Return-Oriented Programming (ROP)
    attacks or preventing information leakage through registers.
    This depends upon support from the compiler for a given architecture.
    This is disabled for python ports, currently there are issues.

Approved by:	portmgr (mat)
PR:		284270

    7a489e9

20:00 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

    1ffb7e4

14:33 Muhammad Moinur Rahman (bofh) 

Mk/Uses: Add new variable PY_TYPING_EXTENSIONS

devel/py-typing-extensions is a common dependency while the python
version is less than 3.11. To make things easier for committers add a
new var PY_TYPING_EXTENSIONS only when the python version is less than
3.11. This variable is not supposed to be used when typing-extensions is
a hard requirement irrespective of python versions.

    9cb9ea7

12:43 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

    44c85c0

14:55 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Introduce USE_PYTHON=cython3{,_run,_test}

- Update USE_PYTHON=cython{,_run,_test}
- Convert all cython3 occurrence to USE_PYTHON=cython3*
- While I'm here, fix incorrect usage of combining cython3 in BUILD_DEPENDS and
USE_PYTHON=cython

It is added to simplify the future transition from Cython 0.29 to 3.

The minimal version is set to 3.0.12 because it is required by
devel/py-propcache.
The upper bound of version is set to 3.1 because it is limited by multiple
ports.

    150c001

01:59 Charlie Li (vishwin)  Author: Wen Heping

lang/python312: add 3.12.9

What's new: https://docs.python.org/3/whatsnew/3.12.html

PR: 271673
Co-authored-by: vishwin
Differential Revision: https://reviews.freebsd.org/D49679

    deb3169

17:10 Muhammad Moinur Rahman (bofh) 

Mk/Uses: Cosmetic changes on python.mk

Some of the comments were still refering to python38 post removal.

Approved by:	portmgr (blanket)

    664dd3e

15:34 Rene Ladan (rene) 

lang/python38: remove and unregister, it reached end-of-life in October 2024

This has to be done in one commit to avoid breaking INDEX

    ca15850

04:05 Charlie Li (vishwin) 

python.mk: remove setuptools from RUN_DEPENDS

Historically this was needed as a RUN_DEPENDS due to consumers using
the included pkg_resources, which has been deprecated for some time
now in favour of the importlib suite. (pkg_resources consumers are
strongly advised to migrate to importlib et al.)

PR: 270510
Reviewed by: crees, rm
Tested by: jhale, wen
exp-run by: antoine
Differential Revision: https://reviews.freebsd.org/D39303

    bc7ed2c

22:59 Charlie Li (vishwin) 

python.mk: allow do-configure with {HAS,GNU}_CONFIGURE under USE_PYTHON=pep517

Some non-Python software include optional Python package(s) whose
metadata is generated by a configure script. In those cases allow
do-configure to run instead of ignoring them completely when the
Python package is PEP-517-compliant.

    50b9e59

22:11 Rene Ladan (rene) 

Mk: Revert "Mk: unregister expired lang/python38 and update some comments"

This reverts commit ee12243bdd7f5fda05a716c29f90671307a5c059.

At least devel/include-what-you-use and emulators/libretro-mame still
require Python 3.8

    c6cba04

22:01 Rene Ladan (rene) 

Mk: unregister expired lang/python38 and update some comments

    ee12243

05:26 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update PY_TOMLI

devel/py-pyproject-fmt 2.3.0 requires textproc/py-tomli 2.0.2+.

    94235dd

16:55 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Introduce PY_TOMLI

- Convert ports to use PY_TOMLI to simplify Makefile.

The minimal version is set to 2.0.1 because it is required by multiple ports
such as devel/py-poetry.
The upper bound of version is set to 3 because it is limited by devel/py-poetry.

With hat:	python

    180cd73

13:04 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

    485b9da

14:23 Wen Heping (wen) 

math/py-numpy: Update to 1.26.4

PR:		277689
Reported by:	wen@
Exp-run by:	antoine@

    d3e0e54

13:51 Ruslan Makhmatkhanov (rm) 

Mk/Uses/python.mk: Switch to Python 3.11 as default

The switch is a collective effort of Wen Heping, Alastair Hogge,
Muhammad Moinur Rahman, Antoine Brodin, Vladimir Druzenko,
Thomas Zander, Daniel Engberg et al.

PR:		275494
Tested by:	antoine (multiple exp-runs)
With hat:   python

    62a23ef

12:37 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Introduce PY_EXCEPTIONGROUP

The minimal version is set to 1.1.1 because it is required by devel/py-cattrs.
Convert ports to use PY_EXCEPTIONGROUP to simplify Makefile.

With hat:	python

    0a4260b

14:50 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

Changes:	https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst
		https://cryptography.io/en/latest/changelog/
Security:	CVE-2024-26130

    719c503

20:21 Tijl Coosemans (tijl) 

Mk/*: Build with a clean environment

Both our make and gmake use the MAKEFLAGS environment variable but the
values aren't compatible and the latest version of gmake complains about
that.  To rule out that any environment variable can cause problems like
this, add a new command SETENVI=/usr/bin/env -i that clears the
environment, and use it to run upstream build systems with a clean
environment.

Introduce a new variable WRK_ENV that contains the environment to use
with SETENVI in all targets that run upstream build commands.  Variables
that are common between CONFIGURE_ENV and MAKE_ENV could be moved to
WRK_ENV but for now it just contains a minimal environment:

HOME=${WRKDIR}: Fixes USES=elixir ports that were using the user's HOME.
OSVERSION: For cross building; determines the output of uname -K and
getosreldate(3); affects net/freebsd-telnetd for example.
PATH: Fixes USES=gem ports that were using the user's PATH.
PWD=$${PWD}: Preserve current working directory; affects USES=go ports.
TERM: To preserve colored output to terminals.
TMPDIR: For users who define that.
UNAME_*: For cross building; determines the output of uname(1); affects
lang/python* for example.

This commit deals with everything under Mk/.  Ports that have their own
targets running upstream build commands can switch to SETENVI later.

The ports tree adds its definition of ARCH to the MAKEFLAGS environment
variable, which is interpreted by sub-makes as command line arguments,
which means that any definition of ARCH in upstream makefiles was
overridden.  The following ports required fixes now that this is no
longer the case.

games/iortcw, games/q3cellshading, games/tremulous:
These use Quake 3 engine code.  Fix use of ARCH.  Reduce diff between
FreeBSD code and Linux code.

games/legesmotus:
Remove ARCH related patches.

lang/ocaml:
Patch configure script so it detects amd64 correctly.  Also make the
powerpc case consistent with the other architectures.  This also affects
other ocaml ports like devel/ocaml-ocamlbuild and math/ocaml-num that
include a Makefile.config installed by lang/ocaml.  While here, use
SETENVI in check-test target.

net/libnatpmp:
Use of upstream definition of ARCH triggers installation in PREFIX/lib64
on amd64.  Disable this.

PR:		276478
Approved by:	portmgr (antoine)
Exp-run by:	antoine

    572f236

22:13 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update USE_PYTHON=cryptography*

Reference:	https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst#4106---2023-11-27
Security:	CVE-2023-49083

    cb35a21

10:30 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

py-pyhanko-certvalidator 0.26.2 requires py-cryptography 41.0.5+

    008c780

23:31 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update CRYPTOGRAPHY_DEPENDS

py-webauthn 1.11.0 requires py-cryptography 41.0.4+.

    3226ddb

00:46 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Remove PYTHON3_DEFAULT and use PYTHON_DEFAULT instead

- Remove unnecessary PYTHON3_DEFAULT
- Replace PYTHON3_DEFAULT with PYTHON_DEFAULT

Regarding DEFAULT_VERSIONS, both python and python3 point to the same value
which makes python3 a duplicate. And we do not really support python=2.7.
Therefore, use python for Python 3.x and python2 for legacy Python 2.7.

    9ef210b

14:19 Po-Chuan Hsieh (sunpoet) 

*: Replace USES=pycryptography* with USE_PYTHON=cryptography{,_build,_test}

- Introduce USE_PYTHON=cryptography{,_build,_test}
- Switch all 96 ports from USES=pycryptography to with
USE_PYTHON=cryptography{,_build,_test}
- Remove Mk/Uses/pycryptography.mk

PR:		273727
Approved by:	tcberner (portmgr)
Exp-run by:	antoine

    3754fc5

18:21 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Cosmetic change

    223c60c

17:21 Li-Wen Hsu (lwhsu)  Author: John Hein

python.mk: Improve CMake/Python integration

Suport FindPython.cmake, FindPython3.cmake, FindPython2.cmake modules by
adding Python{,2,3}_EXECUTABLE to CMAKE_ARGS in python.mk.

CMake supports more than one way to search for python.  Currently
python.mk passes -DPython_ADDITIONAL_VERSIONS=${PYTHON_VER} to help
FindPython{Interp,Libs}.cmake modules "find" the version of python that
a port build wants to use.

The FindPython{,2,3}.cmake modules don't know anything about
Python_ADDITIONAL_VERSIONS but use Python{,2,3}_EXECUTABLE as the hint.

PR:		262109

    aa9736e

12:56 Wen Heping (wen) 

math/py-numpy: Update to 1.25.0

PR:		272058
Reported by:	wen@
Exp-run by:	antoine@

    65c21fd

07:08 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Clean up after lang/python37 removal

    12c7567

19:32 Rene Ladan (rene) 

Mk/Uses: bit more cleanup in USES=python now that 3.7 is sunset

    c58ef91e

19:00 Rene Ladan (rene) 

Mk: unregister expired lang/python3.7

    53475f5

15:51 Rene Ladan (rene) 

Mk/Uses/python.mk: update version numbers in some examples

    e4fee285

07:04 Wen Heping (wen) 

Mk/Uses/python.mk: Fix a typo

PR:		271265
Reported by:	grahamperrin@freebsd.org

    9414f70

16:17 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Fix 34852a28b2b09ceb1b52db7ac15a192089c5e60c

PYTHON3_DEFAULT removal is planned for a PR.

    78d3d0b

16:05 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Fix PLIST issue for USE_PYTHON=pep517

Currently "USE_PYTHON=autoplist pep517" generates the PLIST as follows:
- Extract the list of installed files from the RECORD file to the intermediate
  PLIST (_PYTHONPKGLIST)
- Manipulate the intermediate PLIST
- Add list of pycache files to the intermediate PLIST

When the RECORD file contains foo.pyc entry, that file will be counted twice in
the PLIST at the end. It will cause check-plist error. This fix removes *.pyc
entries while manipulating the intermediate PLIST to ensure all pycache files
are only counted once.

    34852a2

18:27 Antoine Brodin (antoine) 

USE_PYTHON=pep517: package python bytecode

Compile and package python bytecode for python ports using pep517.
This can be revisited in the future with a trigger.

Approved by:	portmgr

    378e091

05:03 Charlie Li (vishwin) 

python.mk: use gpep517 as build frontend on Python 3.7

Should start allowing PEP-517 packages to build and unbreaking
circular dependencies, however short a shelf life, due to gpep517's
almost nonexistant Python dependency tree.

(PyPA build will continue as the preferred build frontend otherwise,
due to official stewardship, but does not preclude a DEFAULT_VERSIONS
hook in the future)

    3333371

19:22 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Use long options for easier reading (part of
de6965254c3a007efcf697c3d455b54d2aeb2383)

    bbd8f02

19:22 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Add support for post-release version (.postX)

The post-release version is normalized to .postX in PEP440. However, it will be
converted to .pX in FreeBSD which means an older version.

% pkg ver -t 1.2.3 1.2.3.p4
>

If the original release is already in the tree, rather than bumping PORTEPOCH,
you could bump PORTREVISION and add .postX to DISTVERSIONSUFFIX.

This fix allows the port to build in this situation.

    fb46fe4

14:20 Matthew Seaman (matthew) 

Mk/Uses/python.mk:  Support PEP440 versioning

The python PEP440 version numbering standard is _mostly_ compatible
with FreeBSD port versioning rules.  Exceptions exist, where the
PORTVERSION can be derived from the upstream DISTVERSION
automatically. For example:

PEP440 DISTVERSION:      FreeBSD PORTVERSION:
2.3.post1                2.3.p1

Now, this interacts badly with PEP517 build setups.  hatchling will
enforce PEP440 complicance, so it isn't practical to modify the ported
code to use exactly the FreeBSD version.

Instead, simply referring to DISTVERSION rather than PORTVERSION will
allow the build process to complete smoothly.

See https://reviews.freebsd.org/D39123 for an example port update
which depends on this change

Approved by:	python (maintainer, vishwin)
Differential Revision:	https://reviews.freebsd.org/D39124

    2b7d76a

17:35 Charlie Li (vishwin) 

python.mk: introduce PY_SETUPTOOLS

Selects the correct setuptools port based on USE_PYTHON=distutils
or not. devel/py-setuptools58 case currently commented out.

    46a71ea

11:18 Charlie Li (vishwin) 

strip_RECORD.py: move to Mk/Scripts

Requested by: mat

    67de7ad

04:34 Charlie Li (vishwin) 

python.mk: add PEP517_BUILD_CONFIG_SETTING

Reference:
https://pypa-build.readthedocs.io/en/latest/#python--m-build---config-setting

    a1039fe

04:24 Charlie Li (vishwin) 

python.mk: add USE_PYTHON=cython_test

    8731e33

04:17 Charlie Li (vishwin) 

python.mk: use PYTHON_MAJOR_VER for Python 2/3 conditionals

    43ae358

04:11 Charlie Li (vishwin) 

python.mk: document individual module variables

...except PY_PILLOW, which has been redundant since Python 3.5 removal
and is slowly being removed.

    97741a0

03:58 Charlie Li (vishwin) 

python.mk: move PEP-517 docs above distutils

    b0a6205

03:33 Charlie Li (vishwin) 

python.mk: use script to process RECORD for the first pass

RECORD is a CSV file [0] containing more data than our plist format
accepts. The original processing method used sed(1) exclusively,
but paths containing quotes, spaces and commas throw it off. Process
the CSV properly instead for the first pass.

References:
https://packaging.python.org/en/latest/specifications/recording-installed-packages/#the-record-file
[0]

    16a6fec

03:07 Charlie Li (vishwin) 

python.mk: add man/ to PEP-517 autoplist

    588237f

23:59 Charlie Li (vishwin) 

lang/python: restore USES=python variables and SUB_LIST (no-op)

Has been a to do item for time. These are independent from but used
by the bytecode trigger.

    922e7f4

21:04 Matthias Andree (mandree) 

lang/python: Revert "add bytecode trigger"

This reverts commit c17ddfbf66e2801ec620d49979aca3d7077d7002.

This causes breakage on several ports, and the next iteration
requires a full exp-run. See:

Differential Revision: https://reviews.freebsd.org/D34739

    a9d9d3a

18:48 Charlie Li (vishwin) 

python.mk: add etc/ to PEP-517 autoplist

This was mistakenly missed in 18982c467f6ce3109f1e71198274eeac45f35297.

Requested by: yasu

    853d0bf

03:14 Charlie Li (vishwin) 

python.mk: PEP-517 data_files support

data_files was not initially supported in the framework under the
guise that PyPA through setuptools deprecated the practice. However,
other build backends like flit still support (and advertise as a
"newer" feature) data_files, and certain packages continue to install
operating system-specific files like man pages using Python's
packaging system.

This expands RECORD parsing to account for any data_files beyond
entry_points installed to bin/. It is limited to certain directories
in hier(7) listed under /usr/local to prevent wheels from installing
files to arbitrary locations.

Tested by: yasu (first pass)
Differential Revision: https://reviews.freebsd.org/D38050

    18982c4

17:35 Charlie Li (vishwin) 

python.mk: explicitly pass ${PREFIX} to ${PEP517_INSTALL_CMD}

Otherwise the stage prefix is ${PYTHONBASE} by default.

Reported by: John Hein <jcfyecrayz[at]liamekaens[point]com>
PR: 269472

    9fbe5f4

21:35 Charlie Li (vishwin) 

lang/python: add bytecode trigger

Facilitates compiling, writing and removing bytecode files (.pyc)
in site-packages after all pkg transactions have been completed.

Technical details: https://wiki.freebsd.org/Python/CompiledPackages

Fixes reports of Python port builds as root failing on filesystem
violations due to bytecode file writes where the port did not include
them in the package.

For those ports/packages that currently package bytecode, some
checksum mismatches on those files may occur. This is harmless and
will be rectified, in large as part of a USE_PYTHON=distutils
overhaul to reduce churn.

While here, implement a long-standing todo item of letting lang/python
ports use python.mk bits. Not only does this obviate duplicate
variables in each Makefile, but SUB_LIST (also added) is used for
these triggers.

Co-authored by: tcberner
Approved by: tcberner (mentor)
Differential Revision: https://reviews.freebsd.org/D34739

    c17ddfb

01:14 Wen Heping (wen) 

math/py-numpy: Update to 1.24.1

PR:		268594
Reported by:	wen@
Exp-run by:	antoine@

    b217a15

19:05 Charlie Li (vishwin) 

Revert "Mk/Uses/python.mk: Fix USE_PYTHON=pep517: always compile and install
bytecode"

Despite installer's default behaviour to compile and install bytecode,
we are not doing so going forward at stage/package time. [0] During
initial development and qualification of PEP-517 framework support,
compiling and installing bytecode at stage/package time was considered,
but was found problematic, fragile and ultimately unreliable, both
currently and historically (with USE_PYTHON=distutils), due to our
fixed plist requirement. While the living binary distribution format
(wheel) specification [1] says to compile bytecode, that is in the
pure Python package management context (pip, etc); nuance always
exists when interacting with "system" package management.

Additionally, "bytecode is an implementation detail of the CPython
interpreter. No guarantees are made that bytecode will not be added,
removed, or changed between versions of Python," thus "should not
be considered to work across Python VMs or Python releases." [2]
This is important to ensuring correctness for those ports specifying
NO_ARCH.

Instead of compiling and installing bytecode at stage/package time,
there is a WIP, review D34739, that compiles and installs bytecode
at install time instead, using triggers.

The aforementioned build_fs_violations will be investigated.

This reverts commit de6965254c3a007efcf697c3d455b54d2aeb2383.

With hat:	python
Approved by:	tcberner (mentor, portmgr)
Reference:	https://wiki.freebsd.org/Python/PEP-517 [0]
		https://packaging.python.org/en/latest/specifications/binary-distribution-format/
[1]
		https://docs.python.org/3/library/dis.html [2]

    f5890bd

18:16 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Fix USE_PYTHON=pep517: always compile and install bytecode

- While I'm here, use long options for easier reading [1][2]
- Bump PORTREVISION of dependent ports (USE_PYTHON=pep517) for package change

It fixes build_fs_violation of dependent ports in poudriere (with -t flag).
It is also the default behavior of installer [2].

from py-sphinx log:
=>> Checking for staging violations... done
=>> Error: Filesystem touched during stage (files must install to ${STAGEDIR}):
extra: usr/local/lib/python3.9/site-packages/importlib_metadata/__pycache__
=>> Cleaning up wrkdir

from installer documentation:
--compile-bytecode
    Possible choices: 0, 1, 2
    generate bytecode for the specified optimization level(s) (default=0, 1)
--no-compile-bytecode
    don’t generate bytecode for installed modules
    Default: False

With hat:	python
Reference:	https://pypa-build.readthedocs.io/en/stable/ [1]
		https://installer.pypa.io/en/stable/cli/installer/ [2]

    de69652

19:55 Charlie Li (vishwin) 

devel/py-setuptools58: add

This port will eventually serve as the one used in USE_PYTHON=distutils,
namely for executing ${PYSETUP}. See
https://wiki.freebsd.org/Python/setuptools for details.

Approved by: fluffy (mentor)
Differential Revision: https://reviews.freebsd.org/D38069

    fd932c2

01:31 Charlie Li (vishwin) 

python.mk: normalise wheel filename arguments in PEP517_INSTALL_CMD

The living binary distribution format specification derived from
PEP-427 [0] prescribes that:

  In distribution names, any run of -_. characters (HYPHEN-MINUS,
  LOW LINE and FULL STOP) should be replaced with _ (LOW LINE), and
  uppercase characters should be replaced with corresponding lowercase
  ones. This is equivalent to PEP 503 normalisation followed by
  replacing - with _. Tools consuming wheels must be prepared to
  accept . (FULL STOP) and uppercase letters, however, as these
  were allowed by an earlier version of this specification.

This fixes staging for packages built under PEP-517 with dashes
(HYPHEN-MINUS) in their names.

[0]
https://packaging.python.org/en/latest/specifications/binary-distribution-format/

Reported by: amdmi3
Tested by: yasu, rhurlin
PR: 268893
With hat: python
Approved by: mentors (implicit)

    952e0db

05:22 Charlie Li (vishwin) 

python.mk: introduce USE_PYTHON=pep517 for PEP-517 support

USE_PYTHON=pep517 takes no arguments. Operation is similar to
USE_PYTHON=distutils, although the build backend specified in
pyproject.toml is to be specified in BUILD_DEPENDS explicitly. A
usage guide and implementation primer is available at:
	https://wiki.freebsd.org/Python/PEP-517

With hat: python
Approved by: fluffy (mentor)
Co-authored by: yuri
PR: 255722
Differential Revision: https://reviews.freebsd.org/D36290

    cc8a187

01:39 Charlie Li (vishwin) 

Uses/python.mk: revert unapproved feature addition (and consumers)

Change proposal was in discussion with open questions and additional
documented design requirement [0] for submitter to review and provide
feedback on, which was not provided.

Submitter (and anyone else) is welcome to work with python@ to
produce an appropriately reviewed feature.

[0] https://wiki.freebsd.org/Python/PEP-517

With hat: python (vishwin, koobs)
PR: 255722, 265660, 265692, 265693
Approved by: fluffy (mentor)

    7d48381c

20:16 Yuri Victorovich (yuri) 

Mk/Uses/python.mk: Add USE_PYTHON=build to support pyproject.toml based projects

USE_PYTHON=build supports PEP-517 at the level of individual ports.
Global support (making PEP-517 be used for all ports) is outside of the
scope of this patch.

PR:		255722
Approved by:	python (maintainer's timeout; 14 days)
Differential Revision:	https://reviews.freebsd.org/D36061

    600312a

00:19 Po-Chuan Hsieh (sunpoet) 

devel/py-setuptools: Update to 63.1.0

Changes:	https://github.com/pypa/setuptools/blob/main/CHANGES.rst
PR:		265081
Exp-run by:	antoine

    94c675d

02:42 Wen Heping (wen) 

math/py-numpy: Update to 1.23.0

PR:		264837
Reported by:	wen@
Exp-run by:	antoine@

    d68b12c

20:31 Thierry Thomas (thierry)  Author: VVD

Mk/bsd.default-versions.mk: Switch default Python version to 3.9

PR:		261703
Reported by:	VVD
Tested by:	exp-run by antoin@
Approved by:	maintainer’s time-out

    f117f2c

23:36 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Update *_DEPENDS for py-setuptools

Always use the latest version in order to avoid inconsistent behavior.

    c07d12c

16:56 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Add preliminary support for "make test" for nose, nose2,
pytest, unittest and unittest2

This patch adds preliminary support for "make test". It supports nose, nose2,
pytest, unittest and unittest2. Enable this by adding one of the following:
    USE_PYTHON=nose
    USE_PYTHON=nose2
    USE_PYTHON=pytest
    USE_PYTHON=unittest
    USE_PYTHON=unittest2

The pytest support was derived from USES=pytest. All user-facing variables are
kept unchanged except PYTEST_ARGS which has been changed to generic TEST_ARGS.
USES=pytest can be changed to USE_PYTHON=pytest as follows:

    USES=pytest   -> USE_PYTHON=pytest
    USES=pytest:4 -> USE_PYTHON=pytest4
    PYTEST_ARGS   -> TEST_ARGS

    535f310

07:22 Wen Heping (wen) 

math/py-numpy: Update to 1.22.4

PR:		264153
Reported by:	wen@
Exp-run by:	antoine@

    ff9098f

10:00 Tobias C. Berner (tcberner) 

framework: cleanup conditional-indentations in Mk/

Run Tools/scripts/indent_make_if.pl on all of Mk.

These white space changes contribute greatly to the readability of those files.
As we have a version control system, finding out the reasons for the changes
prior to these white space changes is still easily possible

Differential Revision:	https://reviews.freebsd.org/D35024
Reviewed by:		portmgr (rene, bapt)

    aa25396

13:37 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Use lang/cython for all Python versions

lang/cython has been updated to support lang/python311 (3.11.0a6) while
lang/cython-devel does not support it yet (broken since 3.11.0a4).

    792ff60

20:55 Rene Ladan (rene) 

Mk/Uses: remove the default deprecation date.

Obviously the world did not manage to get rid of Python 2.7
by 2020-12-31, so remove that target and just advise users
to move on to Python 3.

This is the commit 1/9 of review D33922

Differential Revision:	https://reviews.freebsd.org/D33922

    fcb5bf8

12:57 Rene Ladan (rene) 

Mk: unregister expired lang/python36

While here update some examples.

    d85222d

17:00 Dmitry Marakasov (amdmi3) 

lang/cython-devel: add port

Add devel version of cython. Apart from that 3.x cython branch is
where all the development goes on, 0.29.x only getting backported
bugfixes, this is currently the only version which supports python
3.11. Because of that, wire USE_PYTHON=cython to cython-devel for
python >= 3.11 in Uses/python.mk as well and limit supported python
versions with <= 3.10 for cython.

PR:		259898
Approved by:	python (lwhsu)

    ab67421

17:00 Dmitry Marakasov (amdmi3) 

lang/python311: add port (at 3.11.0.alpha2)

Python is an interpreted object-oriented programming language, and is
often compared to Tcl, Perl or Scheme.

WWW: https://www.python.org/

PR:		259745
Approved by:	python

    d6f568c

00:50 Wen Heping (wen) 

math/py-numpy: Update to 1.20.3

PR:		259063
Reported by:	wen@
Exp-run by:	antoine@

    7e9bec8

02:16 Sergey A. Osokin (osa) 

devel/mercurial: update to 5.9.1.

Bump PORTREVISIONs for dependant ports.
While I'm here update devel/tortoisehg to 5.9.1. (*)

Approved by:	arrowd (*)
PR:		ports/258352

    06a8050

20:14 Dmitry Marakasov (amdmi3) 

lang/python310: add python 3.10.0.beta4

PR:		256150
Approved by:	maintainer timeout (python@, 1 month)
Differential Revision:	https://reviews.freebsd.org/D30475

    930c931

16:16 Po-Chuan Hsieh (sunpoet) 

Mk/Uses/python.mk: Remove PY_PYGMENTS

    33b4388

11:36 Dmitry Marakasov (amdmi3) 

devel/py-setuptools: update to 57.0.0 preserving old version

- Copy devel/py-setuptools to devel/py-setuptools44 (for Python 2.7 support)
- Update devel/py-setuptool to 57.0.0 (adding support for Python 3.10)
- Update Mk/Uses/python.mk to chose between py-setuptools and
  py-setuptools44 based on Python version

This allows us to have latest setuptools and working Python 3.10
without breaking packages requiring Python 2 support for remaining
reports that require it.

Exp-run showed 3 ports failing to build with latest setuptools and
they were fixed.

PR:			256173
Exp-run by:		antoine
Reviewed by:		koobs (python)
Approved by:		koobs (python)
Differential_Revision:	https://reviews.freebsd.org/D30473

    7a4ce8f

13:55 Dmitry Marakasov (amdmi3) 

Mk: add framework support for two digit python minor version

PR:		255013
Differential Revision:	https://reviews.freebsd.org/D29418
Exp-run by:	antoine
Approved by:	wen@, no objection from python@ or portmgr@

    40d7b48

13:55 Dmitry Marakasov (amdmi3) 

Mk: switch from PYTHON_PORTVERSION to PYTHON_DISTVERSION

This brings python framework in consistense with handbook recommendations
to prefer DISTVERSION and simplifies adding prerelease versions of
python

PR:		255013
Differential Revision:	https://reviews.freebsd.org/D29418
Exp-run by:	antoine
Approved by:	wen@, no objection from python@ or portmgr@

    5f69415

13:55 Dmitry Marakasov (amdmi3) 

Mk: switch PYTHON_REL to 5 digits to support python 3.10.x

PR:		255013
Differential Revision:	https://reviews.freebsd.org/D29418
Exp-run by:	antoine
Approved by:	wen@, no objection from python@ or portmgr@

    0729af4