c++ Tokenizer issues

[DrewRockon]

Hey guys, I'm doing a project for my C++ in a Unix environment class and I'm having a bit of trouble tokenizing the input give to me.

The input is given in a .txt file which i will attach.    config.txt

 

The Tokenizer class was given to us by the professor. Tokenizer.cpp.txt    Tokenizer.h.txt

 

Here is the code I am using in my main to read from the file (just the Tables part atm, and by this point i have already skipped the first line that lets you know you are reading the table info)

 

 //Build new Tokenizer

Tokenizer tblTokenizer(line, " "); //line is being pulled from the file and " " is the delimiter 

string tblToken;

//Set token to next string

tblToken = tblTokenizer.next();

                

 cout << tblToken << endl;

 

While I expect the output to look like:

1 //Tablenum

2 //Num of people at table

2 //Tablenum

4 //Num of people at table

3 //Tablenum

2 //Num of people at table

4 //Tablenum

2 //Num of people at table

5 //Tablenum

2 //Num of people at table

6 //Tablenum

4 //Num of people at table

7 //Tablenum

6 //Num of people at table

8 //Tablenum

10//Num of people at table

 

and so on what i end up with is:

1

2

3

4

5

6

7

8

 

and so on, mean it is missing the last value in the line.

 

Any idea how to retain that value without typing a space at the end of each line in the config file?

 

I appreciate the help in advance. Thank you =]

 

[WanderingFool]

Ok, so you are reading line by line, and using the tokenizer (which btw, don't know if you did this for any particular reason but this line of code Tokenizer tblTokenizer(line, " ") might be better if written like Tokenizer tblTokenizer(line)...the default setting contains more delimiters).

 

The issue that I see is you are only calling .next once.  After tblTokenizer, you do

tblToken = tblTokenizer.next();

This will mean tblToken will only contain the first token.  Here is a quick demo of printing it.

 

Tokenizer tblTokenizer(line); //line is being pulled from the file and " " is the delimiter string tblToken;//Set token to next stringtblToken = tblTokenizer.next();while(tblToken != "") {    cout << tblToken << endl;    tblToken = tblTokenizer.next();}

[DrewRockon]

Thank you! I made it call more than once and it worked perfectly.

 

I'll have to try the default for the delimiter value. The way I had it is just how the professor told us to do it.

[WanderingFool]

Ah, okay.  If you professor told you to do it that way, then don't do the default way

 

(as an fyi, the default accepted things like \t...so maybe the processor is going to use a tab and doesn't want it tokenized)