/**
1. StringTokenizer

The class StringTokenizer extends from  java.util that extends from java.lang.Object. 
It emplements from Enumeration class. The main purpose of the StringTokenizer is to parse 
a set of string (as a sentence) into separated strings (tokens).

The related main code is the following:
    
		StringTokenizer st = new StringTokenizer("All the best of luck");
		while (st.hasMoreTokens()) {
		System.out.println(st.nextToken());
		}

The constructors of the class StringTokenizer are:
public StringTokenizer(String str) or
public StringTokenizer(String str, String delimiter) or
public StringTokenizer(String str, String delimiter, boolean returnDelimiters)	

The delimiter arguments are used to separate tokens.
The delimiters characters are also returned as tokens if the returnDelims flag is 
true. Each delimiter is returned as a string of length one. If the flag is false, 
the delimiter characters are skipped and only serve as separators between tokens.

A token consists of one or more characters of which none are blanks, control 
characters, or characters within a string constant or delimited identifier. Tokens 
are ordinary (like letters and numbers) or delimiter tokens (like operators and marks)

2. Example:		  
*/	
	  
import java.util.StringTokenizer;
public class TheStringTokenizer {

public static void main(String[] args) {
//Create StringTokenizer fresh object
    StringTokenizer str = new StringTokenizer("Regards! and - All, The % best & of ? luck", "%", true);
 //Moving on through tokens by iteration
    while(str.hasMoreTokens())
      System.out.println("\n\t" + str.nextToken("%"));

  }
}

/*
Execution:
----------
C:\Java>javac TheStringTokenizer.java
C:\Java>java TheStringTokenizer

   Regards! and - All, The
   %   
   best & of ? luck

*/