CartoType::TStringTokenizer Class Reference

#include <cartotype_string_tokenizer.h>

List of all members.

Public Member Functions
CT_IMPORT	TStringTokenizer (const MString &aString, const MString *aSeparators=0, const MString *aSingleCharacterTokens=0)
CT_IMPORT int32	TokensLeft () const
CT_IMPORT bool	HasMoreTokens () const
CT_IMPORT TResult	NextToken (TText &aToken)

---

Detailed Description

A class to find all the tokens in a string. A token is a sequence of characters that contains no separators, or a single character from a specified list.

Tokens are separated by optional separators, which also may precede the first token and follow the last. If no separators are specified, only word spaces (U+0020) are allowed as separators.

Only separator characters from the basic multilingual plane (U+0000...U+FFFF) are at present supported.

---

Constructor & Destructor Documentation

CT_EXPORT TStringTokenizer::TStringTokenizer	(	const MString &	aString,
		const MString *	aSeparators = 0,
		const MString *	aSingleCharacterTokens = 0
	)

Construct a string tokenizer, optionally specifying separators and single-character tokens.

---

Member Function Documentation

CT_EXPORT bool TStringTokenizer::HasMoreTokens

(

)

const

Test if there are more tokens available from this tokenizer's string.

TResult TStringTokenizer::NextToken

(

TText &

aToken

)

Get the next token from the string. If there is no token return KErrorEndOfData.

CT_EXPORT int32 TStringTokenizer::TokensLeft

(

)

const

Return the number of tokens remaining in the string but do not advance the current position.

---

The documentation for this class was generated from the following files:

• cartotype_string_tokenizer.h
• cartotype_string_tokenizer.cpp