com.metaweb.lessen.tokenizers
Class CondensingTokenizer

java.lang.Object
  com.metaweb.lessen.tokenizers.CondensingTokenizer

All Implemented Interfaces:

Tokenizer

public class CondensingTokenizer
extends Object
implements Tokenizer

Field Summary

protected boolean	_removeComments
protected Token	_token
protected BufferedTokenizer	_tokenizer

Constructor Summary

CondensingTokenizer(Tokenizer tokenizer)

CondensingTokenizer(Tokenizer tokenizer, boolean removeComments)

Method Summary

Token	getToken()
void	next()
protected void	resolve()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_tokenizer

protected final BufferedTokenizer _tokenizer

_removeComments

protected final boolean _removeComments

_token

protected Token _token

Constructor Detail

CondensingTokenizer

public CondensingTokenizer(Tokenizer tokenizer)

CondensingTokenizer

public CondensingTokenizer(Tokenizer tokenizer,
                           boolean removeComments)

Method Detail

getToken

public Token getToken()

Specified by:

getToken in interface Tokenizer

next

public void next()

Specified by:

next in interface Tokenizer

resolve

protected void resolve()