ai.djl.modality.nlp

Class SimpleVocabulary

java.lang.Object

ai.djl.modality.nlp.SimpleVocabulary

All Implemented Interfaces:

Vocabulary

public class SimpleVocabulary
extends java.lang.Object
implements Vocabulary

The simple implementation of Vocabulary.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SimpleVocabulary.VocabularyBuilder Builder class that is used to build the SimpleVocabulary.

Constructor Summary

Constructors

Constructor and Description
SimpleVocabulary(java.util.List<java.lang.String> tokens) Create a SimpleVocabulary object with the given list of tokens.
SimpleVocabulary(SimpleVocabulary.VocabularyBuilder builder) Create a SimpleVocabulary object with a SimpleVocabulary.VocabularyBuilder.

Method Summary

Modifier and Type	Method and Description
long	getIndex(java.lang.String token) Returns the index of the given token.
java.lang.String	getToken(long index) Returns the token corresponding to the given index.
long	size() Returns the size of the Vocabulary.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleVocabulary

public SimpleVocabulary(SimpleVocabulary.VocabularyBuilder builder)

Create a SimpleVocabulary object with a SimpleVocabulary.VocabularyBuilder.

Parameters:

builder - the SimpleVocabulary.VocabularyBuilder to build the vocabulary with

SimpleVocabulary

public SimpleVocabulary(java.util.List<java.lang.String> tokens)

Create a SimpleVocabulary object with the given list of tokens.

Parameters:

tokens - the List of tokens to build the vocabulary with

Method Detail

getToken

public java.lang.String getToken(long index)

Returns the token corresponding to the given index.

Specified by:

getToken in interface Vocabulary

Parameters:

index - the index

Returns:

the token corresponding to the given index

getIndex

public long getIndex(java.lang.String token)

Returns the index of the given token.

Specified by:

getIndex in interface Vocabulary

Parameters:

token - the token

Returns:

the index of the given token.

size

public long size()

Returns the size of the Vocabulary.

Specified by:

size in interface Vocabulary

Returns:

the size of the Vocabulary