strtok() analogue in C++

Question

I just can't find an algorithm to split the string into words by numerous delimiters. I know how to split a string by whitespace with istringtream and by single delimiter with getline. How can I connect them all.

For instance:

input: This -is-a!,string;
output:

This  
is  
a  
string

You'll probably find one in here: http://stackoverflow.com/questions/236129/splitting-a-string-in-c — chris, May 29 '13 at 06:46
You can use regex with the std library: http://www.cplusplus.com/reference/regex/ — huysentruitw, May 29 '13 at 06:47
There's also [Boost.tokenizer](http://www.boost.org/doc/libs/1_53_0/libs/tokenizer/index.html). — Angew is no longer proud of SO, May 29 '13 at 06:53

score 2 · Answer 1 · answered May 29 '13 at 07:59

2

Why not just #include <cstring> and use std::strtok() in your C++ program?

answered May 29 '13 at 07:59

Naruil

2,300
11
15

I'd like to use only C++ libraries. – vladfau May 31 '13 at 18:55

score 1 · Accepted Answer · answered May 29 '13 at 08:20

#include <iostream>
#include <string>
#include <vector>

using namespace std;

void SplitToVector(vector<string> &v, string dlm, string src){
    string::size_type p, start=0, len=src.length(); 

    v.clear();
    start = src.find_first_not_of(dlm);
    p = src.find_first_of(dlm, start);
    while(p != string::npos){
        v.push_back(src.substr(start, p-start));
        start = src.find_first_not_of(dlm, p);
        p = src.find_first_of(dlm, start);
    }
    if(len>start)//rest
        v.push_back(src.substr(start, len - start));
}

int main(void){
    char input[256] = "This -is-a!,string;";
    vector<string> v;
    int i, size;

    SplitToVector(v, "-!,;", input);
    //cout << input << endl;
    size = v.size();
    for(i=0; i<size; i++)
        cout << v.at(i) << endl;
    return 0;
}

score 0 · Answer 3 · answered May 29 '13 at 07:05

0

I would recommend split in boost (string algorithm), see http://www.boost.org/doc/libs/1_53_0/doc/html/string_algo/usage.html#idp163440592.

answered May 29 '13 at 07:05

Fredrik Jansson

3,764
3
30
33

You see, I'm using it for my exams, so it's not recommended to use external libraries. – vladfau May 29 '13 at 07:30

strtok() analogue in C++

3 Answers3

Linked