FreshPorts -- The Place For Ports If you buy from Amazon USA, please support us by using this link.
Follow us
Blog
Twitter

Please give me your LTO-4 or better tape library and I'll put it to good use.
Port details
p5-String-Tokenizer Simple string tokenizer
0.05_1 textproc on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port
Maintainer: bofh@FreeBSD.org search for ports maintained by this maintainer
Port Added: 19 Feb 2006 23:06:39
Also Listed In: perl5
License: ART10 GPLv1
A simple string tokenizer which takes a string and splits it on 
whitespace. It also optionally takes a string of characters to use as 
delimiters, and returns them with the token set as well. This allows for 
splitting the string in many different ways.

This is a very basic tokenizer, so more complex needs should be either 
addressed with a custom written tokenizer or post-processing of the output 
generated by this module. Basically, this will not fill everyones needs, 
but it spans a gap between simple split / /, $string and the other options 
that involve much larger and complex modules.

Also note that this is not a lexical analyser. Many people confuse 
tokenization with lexical analysis. A tokenizer mearly splits its input 
into specific chunks, a lexical analyzer classifies those chunks. 
Sometimes these two steps are combined, but not here.

WWW: http://search.cpan.org/dist/String-Tokenizer/
SVNWeb : Homepage : Distfiles Availability : PortsMon

NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.

Build dependencies:
  1. perl5.18.4 : lang/perl5.18
Runtime dependencies:
  1. perl5.18.4 : lang/perl5.18

This port is required by:

for Build for Run * - deleted ports are only shown under the This port is required by section. It was harder to do for the Required section. Perhaps later...

To install the port: cd /usr/ports/textproc/p5-String-Tokenizer/ && make install clean
To add the package: pkg install textproc/p5-String-Tokenizer


Configuration Options
     No options to configure

USES:
perl5

Master Sites:
  1. ftp://ftp.auckland.ac.nz/pub/perl/CPAN/modules/by-module/String/
  2. ftp://ftp.cpan.org/pub/CPAN/modules/by-module/String/
  3. ftp://ftp.cpan.org/pub/CPAN/modules/by-module/String/
  4. ftp://ftp.funet.fi/pub/languages/perl/CPAN/modules/by-module/String/
  5. ftp://ftp.kddlabs.co.jp/lang/perl/CPAN/modules/by-module/String/
  6. ftp://ftp.mirrorservice.org/sites/cpan.perl.org/CPAN/modules/by-module/String/
  7. ftp://ftp.sunet.se/pub/lang/perl/CPAN/modules/by-module/String/
  8. http://backpan.perl.org/modules/by-module/String/
  9. http://cpan.metacpan.org/modules/by-module/String/
  10. http://distcache.FreeBSD.org/ports-distfiles/
  11. http://ftp.jaist.ac.jp/pub/CPAN/modules/by-module/String/
  12. http://ftp.twaren.net/Unix/Lang/CPAN/modules/by-module/String/
  13. http://www.cpan.dk/modules/by-module/String/
  14. http://www.cpan.dk/modules/by-module/String/
  15. http://www.cpan.org/modules/by-module/String/

Number of commits found: 13

Commit History - (may be incomplete: see SVNWeb link above for full details)
DateByDescription
24 Dec 2014 00:14:13
Original commit files touched by this commit  0.05_1
Revision:375378
bofh search for other commits by this committer
Change my non-FreeBSD MAINTAINER mail to bofh@

Approved by:	bapt
26 Nov 2014 13:08:38
Original commit files touched by this commit  0.05_1
Revision:373448
mat search for other commits by this committer
Change the way Perl modules are installed, update the default Perl to 5.18.

Before, we had:

  site_perl :           lib/perl5/site_perl/5.18
  site_perl/perl_arch : lib/perl5/site_perl/5.18/mach
  perl_man3 :           lib/perl5/5.18/man/man3

Now we have:

  site_perl : lib/perl5/site_perl
  site_arch : lib/perl5/site_perl/mach/5.18
  perl_man3 : lib/perl5/site_perl/man/man3

Modules without any .so will be installed at the same place regardless of the
(Only the first 15 lines of the commit message are shown above View all of this commit message)
01 May 2014 05:26:27
Original commit files touched by this commit  0.05
Revision:352729
sunpoet search for other commits by this committer
- Add LICENSE
- Pass maintainership to submitter
- While I'm here
  - Remove leading indefinite article from COMMENT
  - Remove Author line

PR:		ports/189149
Submitted by:	Muhammad Moinur Rahman <5u623l20@gmail.com>
07 Nov 2013 03:52:42
Original commit files touched by this commit  0.05
Revision:333056
vanilla search for other commits by this committer
Support STAGEDIR.
20 Sep 2013 23:17:32
Original commit files touched by this commit  0.05
Revision:327773
bapt search for other commits by this committer
Add NO_STAGE all over the place in preparation for the staging support (cat:
textproc)
02 Aug 2013 18:21:06
Refresh Original commit files touched by this commit
Revision:324171  Sanity Test Failure
az search for other commits by this committer
- Convert to new perl framework
24 Oct 2011 09:11:38
Original commit files touched by this commit  0.05
dougb search for other commits by this committer
The vast majority of pkg-descr files had the following format when they
had both lines:

Author: ...
WWW: ....

So standardize on that, and move them to the end of the file when necessary.

Also fix some more whitespace, and remove more "signature tags" of varying
forms, like -- name, etc.

s/AUTHOR/Author/

A few other various formatting issues
03 Jul 2011 14:40:25
Original commit files touched by this commit  0.05
ohauer search for other commits by this committer
-remove MD5
29 Apr 2008 05:27:10
Original commit files touched by this commit  0.05
linimon search for other commits by this committer
Reset aaron's port maintainerships due to many maintainer-timeouts.
17 Apr 2008 14:30:31
Original commit files touched by this commit  0.05
araujo search for other commits by this committer
- Take advantage of CPAN macro from bsd.sites.mk, change
${MASTER_SITE_PERL_CPAN} to CPAN.

PR:             ports/122674
Submitted by:   Philip M. Gollucci <pgollucci@p6m7g8.com>
Reworked by:    araujo (myself)
Approved by:    portmgr (pav)
08 Sep 2007 01:06:22
Original commit files touched by this commit  0.05
linimon search for other commits by this committer
Welcome bsd.perl.mk.  Add support for constructs such as USE_PERL5=5.8.0+.
Drop support for antique perl.

Work done by:   gabor
Sponsored by:   Google Summer of Code 2007
Hat:            portmgr
20 Feb 2006 20:50:22
Original commit files touched by this commit  0.05
fenner search for other commits by this committer
Update search.cpan.org WWW: entries to have a trailing slash.
Change some URLs from author dirs to dist dirs.

The example in the porter's handbook didn't have the trailing slash;
mea culpa for not having caught that when it went in.
19 Feb 2006 23:05:28
Original commit files touched by this commit  0.05
aaron search for other commits by this committer
Adding port textproc/p5-String-Tokenizer, A simple string tokenizer.

Approved by:    tobez (implicit)

Number of commits found: 13

Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD

This site
What is FreshPorts?
About the authors
FAQ
How big is it?
The latest upgrade!
Privacy
Forums
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
bind910Jul 28
bind99Jul 28
logstashJul 27
openssh-portableJul 27
chromiumJul 25
wordpress*Jul 24
wordpress*Jul 24
wordpress*Jul 24
wordpress*Jul 24
wordpress-zh_TW*Jul 24
libidnJul 23
opensaml2Jul 23
shibboleth2-spJul 23
soxJul 23
soxJul 23

32 vulnerabilities affecting 83 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)
Traffic

Calculated hourly:
Port count 25088
Broken 201
Deprecated 107
Ignore 500
Forbidden 1
Restricted 204
No CDROM 94
Vulnerable 44
Expired 0
Set to expire 95
Interactive 0
new 24 hours 6
new 48 hours13
new 7 days38
new fortnight76
new month197

Servers and bandwidth provided by
New York Internet, SuperNews, and RootBSD
Valid HTML, CSS, and RSS.
Copyright © 2000-2014 Dan Langille. All rights reserved.