Has anybody managed to get tokenizer working for wide characters with
VC7.1 (boost version 1.31.0)? The following example works fine...
typedef tokenizerstd::string::value_type,
std::string::const_iterator, std::string> MyTokenizer;
const char_separatorstd::string::value_type sep("a");
MyTokenizer token(std::string("abacadaeafag"), sep);
for (MyTokenizer::const_iterator it = token.begin(); it != token.end();
++it)
{
std::cout << *it;
}
...while the following example produces no output...
typedef tokenizerstd::wstring::value_type,
std::wstring::const_iterator, std::wstring> MyTokenizer;
const char_separatorstd::wstring::value_type sep(L"a");
MyTokenizer token(std::wstring(L"abacadaeafag"), sep);
for (MyTokenizer::const_iterator it = token.begin(); it != token.end();
++it)
{
std::wcout << *it;
}
Cheers,
Douglas.