Package ai.djl.modality.cv.translator

Class YoloWorldTranslator

java.lang.Object

ai.djl.modality.cv.translator.YoloWorldTranslator

All Implemented Interfaces:

NoBatchifyTranslator<VisionLanguageInput,DetectedObjects>, PostProcessor<DetectedObjects>, PreProcessor<VisionLanguageInput>, Translator<VisionLanguageInput,DetectedObjects>

public class YoloWorldTranslator
extends Object
implements NoBatchifyTranslator<VisionLanguageInput,DetectedObjects>

A translator for Yolo-world models.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	YoloWorldTranslator.Builder	The builder for YoloWorldTranslator.

Method Summary

Modifier and Type	Method	Description
static YoloWorldTranslator.Builder	builder()	Creates a builder to build a YoloWorldTranslator.
static YoloWorldTranslator.Builder	builder(Map<String,?> arguments)	Creates a builder to build a YoloWorldTranslator with specified arguments.
void	prepare(TranslatorContext ctx)	Prepares the translator with the manager and model to use.
NDList	processInput(TranslatorContext ctx, VisionLanguageInput input)	Processes the input and converts it to NDList.
DetectedObjects	processOutput(TranslatorContext ctx, NDList list)	Processes the output NDList to the corresponding output object.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.djl.translate.NoBatchifyTranslator

getBatchifier

Methods inherited from interface ai.djl.translate.Translator

batchProcessInput, batchProcessOutput, getExpansions

Method Details

prepare

public void prepare(TranslatorContext ctx)
             throws Exception

Prepares the translator with the manager and model to use.

Specified by:

prepare in interface Translator<VisionLanguageInput,DetectedObjects>

Parameters:

ctx - the context for the Predictor.

Throws:

Exception - if there is an error for preparing the translator

processInput

public NDList processInput(TranslatorContext ctx,
 VisionLanguageInput input)
                    throws TranslateException

Processes the input and converts it to NDList.

Specified by:

processInput in interface PreProcessor<VisionLanguageInput>

Parameters:

ctx - the toolkit for creating the input NDArray

input - the input object

Returns:

the NDList after pre-processing

Throws:

TranslateException

processOutput

public DetectedObjects processOutput(TranslatorContext ctx,
 NDList list)

Processes the output NDList to the corresponding output object.

Specified by:

processOutput in interface PostProcessor<DetectedObjects>

Parameters:

ctx - the toolkit used for post-processing

list - the output NDList after inference, usually immutable in engines like PyTorch. @see Issue 1774

Returns:

the output object of expected type

builder

public static YoloWorldTranslator.Builder builder()

Creates a builder to build a YoloWorldTranslator.

Returns:

a new builder

builder

public static YoloWorldTranslator.Builder builder(Map<String,?> arguments)

Creates a builder to build a YoloWorldTranslator with specified arguments.

Parameters:

arguments - arguments to specify builder options

Returns:

a new builder