| Port details |
- sentencepiece Unsupervised text tokenizer for Neural Network-based text generation
- 0.2.2 textproc
 =0      0.2.1Version of this port present on the latest quarterly branch. - Maintainer: yuri@FreeBSD.org
- Port Added: 2023-01-16 09:42:22
- Last Update: 2026-07-13 15:45:48
- Commit Hash: f3f511d
- License: APACHE20
- WWW:
- https://github.com/google/sentencepiece
- Description:
- SentencePiece is an unsupervised text tokenizer and detokenizer mainly for
Neural Network-based text generation systems where the vocabulary size is
predetermined prior to the neural model training. SentencePiece implements
subword units (e.g., byte-pair-encoding (BPE)) and unigram language model
with the extension of direct training from raw sentences. SentencePiece
allows us to make a purely end-to-end system that does not depend on
language-specific pre/postprocessing.
  ¦  ¦  ¦  ¦ 
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - USE_RC_SUBR (Service Scripts)
- no SUBR information found for this port
- Dependency lines:
-
- sentencepiece>0:textproc/sentencepiece
- To install the port:
- cd /usr/ports/textproc/sentencepiece/ && make install clean
- To add the package, run one of these commands:
- pkg install textproc/sentencepiece
- pkg install sentencepiece
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.- PKGNAME: sentencepiece
- Flavors: there is no flavor information for this port.
- distinfo:
- TIMESTAMP = 1783926736
SHA256 (google-sentencepiece-v0.2.2_GH0.tar.gz) = 92381f713e094a15a1ccff1ac4a5315a4c4b82a99ac1332d6ac53c9dc8e1bcf1
SIZE (google-sentencepiece-v0.2.2_GH0.tar.gz) = 14160863
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- cmake : devel/cmake-core
- ninja : devel/ninja
- Library dependencies:
-
- libabsl_strings.so : devel/abseil
- libprotobuf-lite.so : devel/protobuf
- This port is required by:
- for Libraries
-
- textproc/py-sentencepiece
Configuration Options:- ===> The following configuration options are available for sentencepiece-0.2.2:
GPERFTOOLS=off: Google gperftools support
===> Use 'make config' to modify these settings
- Options name:
- textproc_sentencepiece
- USES:
- cmake:testing compiler:c++17-lang
- FreshPorts was unable to extract/find any pkg message
- Master Sites:
|
Number of commits found: 7
| Commit History - (may be incomplete: for full details, see links to repositories near top of page) |
| Commit | Credits | Log message |
|---|
0.2.2
13 Jul 2026 15:45:48
 |
Yuri Victorovich (yuri) |
textproc/{,py-}sentencepiece: update 0.2.1 → 0.2.2 |
0.2.1
12 Nov 2025 04:06:20
|
Yuri Victorovich (yuri) |
textproc/sentencepiece: update 0.2.0 → 0.2.1 |
0.2.0_1
10 Apr 2025 16:45:57
|
Yuri Victorovich (yuri) |
textproc/sentencepiece: Add GPERFTOOLS option |
0.2.0
20 Feb 2024 07:09:21
|
Yuri Victorovich (yuri) |
textproc/{,py-}sentencepiece: update 0.1.99 → 0.2.0
Reported by: portscout |
0.1.99
03 Jun 2023 07:43:33
|
Yuri Victorovich (yuri) |
textproc/sentencepiece: Update 0.1.98 → 0.1.99
Reported by: portscout |
0.1.98
18 Apr 2023 04:38:14
|
Yuri Victorovich (yuri) |
textproc/{,py-}sentencepiece: Update 0.1.97 → 0.1.98
Reported by: portscout |
0.1.97
16 Jan 2023 09:41:00
|
Yuri Victorovich (yuri) |
textproc/sentencepiece: New port: Unsupervised text tokenizer for Neural
Network-based text generation |
Number of commits found: 7
|
As an Amazon Associate I earn from qualifying purchases.