cz.vutbr.web.csskit.antlr4

Class CSSToken

java.lang.Object

org.antlr.v4.runtime.CommonToken

cz.vutbr.web.csskit.antlr4.CSSToken

All Implemented Interfaces:

Serializable, org.antlr.v4.runtime.Token, org.antlr.v4.runtime.WritableToken

public class CSSToken
extends org.antlr.v4.runtime.CommonToken

Token with encapsulation of LexerState during parse. Models view at token text by removing syntactic sugar from tokens with contains it, e.g. STRING, URI, FUNCTION

Author:

kapy

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CSSToken.TypeMapper Convert between type values defined in two classes.

Field Summary

Fields

Modifier and Type	Field and Description
protected URL	base Base URL for URIs
static int	CLASSKEYWORD
static int	FUNCTION
static int	HASH
protected CSSLexerState	ls Current lexer state
static int	STRING
static int	UNCLOSED_STRING
static int	UNCLOSED_URI
static int	URI
protected boolean	valid

Fields inherited from class org.antlr.v4.runtime.CommonToken

EMPTY_SOURCE, channel, charPositionInLine, index, line, source, start, stop, text, type

Fields inherited from interface org.antlr.v4.runtime.Token

DEFAULT_CHANNEL, EOF, EPSILON, HIDDEN_CHANNEL, INVALID_TYPE, MIN_USER_CHANNEL_VALUE, MIN_USER_TOKEN_TYPE

Constructor Summary

Constructors

Constructor and Description
CSSToken(int type, CSSLexerState state, CSSToken.TypeMapper typeMapper) Creates CSSToken of given type with cloning lexer state automatically
CSSToken(int type, CSSLexerState state, int start, int stop, CSSToken.TypeMapper typeMapper) Creates CSSToken of given type with cloning lexer state automatically, allows to set text boundaries in input stream
CSSToken(org.antlr.v4.runtime.misc.Pair<org.antlr.v4.runtime.TokenSource,org.antlr.v4.runtime.CharStream> input, int type, int channel, int start, int stop, CSSToken.TypeMapper typeMapper) Creates CSSToken, this is base emit() constructor

Method Summary

Modifier and Type	Method and Description
static CSSToken.TypeMapper	createDefaultTypeMapper(Class<? extends org.antlr.v4.runtime.Lexer> lexerClass)
static String	extractCLASSKEYWORD(String className) Considers text as content of CLASSKEYWORD token, and models view at this text as an common string, that is removed '.' from the beginning of string
static String	extractFUNCTION(String function) Considers text as content of FUNCTION token, and models view at this text as an common string, that is removed '(' from the end of string
static String	extractHASH(String hash) Considers text as content of HASH token, and models view at this text as an common string, that is removed '#' from the beginning of string
static String	extractCHARSET(String charset) extract charset value from CHARSET token
static String	extractSTRING(String string) Considers text as content of STRING token, and models view at this text as an common string, that is one character removed from the both beginning and the end.
static String	extractUNCLOSEDSTRING(String string)
static String	extractUNCLOSEDURI(String uri)
static String	extractURI(String uri) Considers text as content of URI token, and models view at this text as an common string, that is removed 'url(' from the beginning and ')' from the and.
URL	getBase() Obtains the base URL used for the relative URIs
CSSLexerState	getLexerState() Gets lexer state at creation of token
String	getText() Returns common text stored in token.
boolean	isValid()
void	setBase(URL base) Sets the base URL used for the relative URIs
CSSToken	setLexerState(CSSLexerState state) Sets lexer state for current token
void	setValid(boolean valid)
String	toString()

Methods inherited from class org.antlr.v4.runtime.CommonToken

getChannel, getCharPositionInLine, getInputStream, getLine, getStartIndex, getStopIndex, getTokenIndex, getTokenSource, getType, setChannel, setCharPositionInLine, setLine, setStartIndex, setStopIndex, setText, setTokenIndex, setType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

ls

protected CSSLexerState ls

Current lexer state

base

protected URL base

Base URL for URIs

valid

protected boolean valid

FUNCTION

public static final int FUNCTION

See Also:

Constant Field Values

URI

public static final int URI

See Also:

Constant Field Values

STRING

public static final int STRING

See Also:

Constant Field Values

CLASSKEYWORD

public static final int CLASSKEYWORD

See Also:

Constant Field Values

HASH

public static final int HASH

See Also:

Constant Field Values

UNCLOSED_STRING

public static final int UNCLOSED_STRING

See Also:

Constant Field Values

UNCLOSED_URI

public static final int UNCLOSED_URI

See Also:

Constant Field Values

Constructor Detail

CSSToken

public CSSToken(org.antlr.v4.runtime.misc.Pair<org.antlr.v4.runtime.TokenSource,org.antlr.v4.runtime.CharStream> input,
                int type,
                int channel,
                int start,
                int stop,
                CSSToken.TypeMapper typeMapper)

Creates CSSToken, this is base emit() constructor

Parameters:

input - Input stream

type - Type of token

channel - Channel of token

start - Start position in stream

stop - End position in stream

CSSToken

public CSSToken(int type,
                CSSLexerState state,
                CSSToken.TypeMapper typeMapper)

Creates CSSToken of given type with cloning lexer state automatically

Parameters:

type - Type of token

state - State of lexer, which will be copied

CSSToken

public CSSToken(int type,
                CSSLexerState state,
                int start,
                int stop,
                CSSToken.TypeMapper typeMapper)

Creates CSSToken of given type with cloning lexer state automatically, allows to set text boundaries in input stream

Parameters:

type - Type of token

state - State of lexer, which will be copied

start - Start position in stream

stop - End position in stream

Method Detail

setLexerState

public CSSToken setLexerState(CSSLexerState state)

Sets lexer state for current token

Parameters:

state - Current lexer state

Returns:

Modified CSSToken

getLexerState

public CSSLexerState getLexerState()

Gets lexer state at creation of token

Returns:

the lexer state

getBase

public URL getBase()

Obtains the base URL used for the relative URIs

Returns:

the URL or null if not set

setBase

public void setBase(URL base)

Sets the base URL used for the relative URIs

Parameters:

base - the base URL to set

isValid

public boolean isValid()

setValid

public void setValid(boolean valid)

extractSTRING

public static String extractSTRING(String string)

Considers text as content of STRING token, and models view at this text as an common string, that is one character removed from the both beginning and the end.

Parameters:

string - Content of STRING token

Returns:

String with trimmed quotation marks

extractUNCLOSEDSTRING

public static String extractUNCLOSEDSTRING(String string)

extractURI

public static String extractURI(String uri)

Considers text as content of URI token, and models view at this text as an common string, that is removed 'url(' from the beginning and ')' from the and. If result of this operation is STRING, remove even quotation marks

Parameters:

uri - Content of URI token

Returns:

String with trimmed URI syntax sugar and optionally quotation marks

extractUNCLOSEDURI

public static String extractUNCLOSEDURI(String uri)

extractFUNCTION

public static String extractFUNCTION(String function)

Considers text as content of FUNCTION token, and models view at this text as an common string, that is removed '(' from the end of string

Parameters:

function - Content of FUNCTION token

Returns:

String with trimmed FUNCTION open parenthesis

extractHASH

public static String extractHASH(String hash)

Considers text as content of HASH token, and models view at this text as an common string, that is removed '#' from the beginning of string

Parameters:

hash - Content of HASH token

Returns:

String with trimmed HASH # character

extractCLASSKEYWORD

public static String extractCLASSKEYWORD(String className)

Considers text as content of CLASSKEYWORD token, and models view at this text as an common string, that is removed '.' from the beginning of string

Parameters:

className - Content of CLASSKEYWORD token

Returns:

String with trimmed CLASSKEYWORD dot

getText

public String getText()

Returns common text stored in token. Content is not modified.

Specified by:

getText in interface org.antlr.v4.runtime.Token

Overrides:

getText in class org.antlr.v4.runtime.CommonToken

Returns:

Model view of text in token

toString

public String toString()

Overrides:

toString in class org.antlr.v4.runtime.CommonToken

createDefaultTypeMapper

public static CSSToken.TypeMapper createDefaultTypeMapper(Class<? extends org.antlr.v4.runtime.Lexer> lexerClass)

extractCHARSET

public static String extractCHARSET(String charset)

extract charset value from CHARSET token