Class PtGptTranslator
- java.lang.Object
-
- ai.djl.pytorch.zoo.nlp.textgeneration.PtGptTranslator
-
- All Implemented Interfaces:
ai.djl.translate.NoBatchifyTranslator<ai.djl.ndarray.NDList,ai.djl.modality.nlp.generate.CausalLMOutput>,ai.djl.translate.PostProcessor<ai.djl.modality.nlp.generate.CausalLMOutput>,ai.djl.translate.PreProcessor<ai.djl.ndarray.NDList>,ai.djl.translate.Translator<ai.djl.ndarray.NDList,ai.djl.modality.nlp.generate.CausalLMOutput>
public class PtGptTranslator extends java.lang.Object implements ai.djl.translate.NoBatchifyTranslator<ai.djl.ndarray.NDList,ai.djl.modality.nlp.generate.CausalLMOutput>TheTranslatorfor PyTorch GPT2 model.
-
-
Constructor Summary
Constructors Constructor Description PtGptTranslator(long kvDim, int numAttentionHeads, int numLayers)Constructs a new instance ofPtGptTranslator.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description ai.djl.ndarray.NDListprocessInput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList input)ai.djl.modality.nlp.generate.CausalLMOutputprocessOutput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList output)
-
-
-
Method Detail
-
processInput
public ai.djl.ndarray.NDList processInput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList input) throws java.lang.Exception- Specified by:
processInputin interfaceai.djl.translate.PreProcessor<ai.djl.ndarray.NDList>- Throws:
java.lang.Exception
-
processOutput
public ai.djl.modality.nlp.generate.CausalLMOutput processOutput(ai.djl.translate.TranslatorContext ctx, ai.djl.ndarray.NDList output) throws java.lang.Exception- Specified by:
processOutputin interfaceai.djl.translate.PostProcessor<ai.djl.modality.nlp.generate.CausalLMOutput>- Throws:
java.lang.Exception
-
-