Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon.

Pages: 1-

Tokenizers...

Name: JLxz 2007-07-14 21:48 ID:m+B0wSkX

My question is, should I write my own, or use a ready made one.
I'd like to meddle with my own programming language.
I'm just wondering whether or not I should write my own tokenizer from scratch or not.

I use C++ by the way...

Thanks for any help!

Name: Anonymous 2007-07-14 21:54 ID:9VBEYRBB

man strtok

Name: Anonymous 2007-07-14 22:02 ID:bgiDNr/R

>>2
thread over.

Name: Anonymous 2007-07-14 22:18 ID:21vonDlc

Tolkienisers

Name: Anonymous 2007-07-14 22:25 ID:gjCXlGee

>>2
strtok mangles your original string. try strsep.

Name: Anonymous 2007-07-14 22:31 ID:bgiDNr/R

>>5
So strdup the string, then pass to strtok
thread over

Name: Anonymous 2007-07-15 1:53 ID:+fMgWHRQ

>>5
strsep()

CONFORMING TO
4.4BSD
strtok()

CONFORMING TO
    SVr4, POSIX.1-2001, 4.3BSD, C89, C99.

Another reason to use strtok instead of strsep.

Name: Anonymous 2007-07-15 4:23 ID:0yMRM2Sc

>>7
4.4BSD > SVr4.

Name: Anonymous 2007-07-15 6:55 ID:asjICj82

boost::tokenizer

Name: Anonymous 2007-07-15 9:46 ID:rAeQUGvM

expertlib::LCPSTRTOKTOOL

Name: Anonymous 2009-01-14 12:27

LISP

Name: Anonymous 2009-03-06 7:10

If I download anything   besides a torrent   of the vomit   rising until my   throat Incapable to   upset to let   the unclean in.

Name: Anonymous 2011-02-04 11:34

Name: Anonymous 2011-02-04 18:00

Don't change these.
Name: Email:
Entire Thread Thread List
All trademarks and copyrights on this site are owned by their respective parties. All comments and posts are the responsibility of their own posters.
- Tinychan + 2ch Mode -