io.spokestack.spokestack.profile

Class TFWakewordAndroidASR

java.lang.Object

io.spokestack.spokestack.profile.TFWakewordAndroidASR

All Implemented Interfaces:

PipelineProfile

public class TFWakewordAndroidASR
extends Object
implements PipelineProfile

A speech pipeline profile that uses TensorFlow Lite for wakeword detection and Android's SpeechRecognizer API for ASR. Properties related to signal processing are tuned for the "Spokestack" wakeword.

Wakeword detection requires configuration to locate the models used for classification; these properties must be set elsewhere:

• wake-filter-path (string, required): file system path to the "filter" Tensorflow-Lite model, which is used to calculate a mel spectrogram frame from the linear STFT; its inputs should be shaped [fft-width], and its outputs [mel-width]
• wake-encode-path (string, required): file system path to the "encode" Tensorflow-Lite model, which is used to perform each autoregressive step over the mel frames; its inputs should be shaped [mel-length, mel-width], and its outputs [encode-width], with an additional state input/output shaped [state-width]
• wake-detect-path (string, required): file system path to the "detect" Tensorflow-Lite model; its inputs shoudld be shaped [encode-length, encode-width], and its outputs [1]

Using Android's built-in ASR requires that an Android Context object be attached to the speech pipeline using it. This must be done separately from profile application, using SpeechPipeline.Builder#setAndroidContext(android.content.Context).

See Also:

AndroidSpeechRecognizer, WakewordTrigger

Constructor Summary

Constructors

Constructor and Description
TFWakewordAndroidASR()

Method Summary

Modifier and Type	Method and Description
SpeechPipeline.Builder	apply(SpeechPipeline.Builder builder) Apply this profile to the pipeline builder.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TFWakewordAndroidASR

public TFWakewordAndroidASR()

Method Detail

apply

public SpeechPipeline.Builder apply(SpeechPipeline.Builder builder)

Description copied from interface: PipelineProfile

Apply this profile to the pipeline builder.

Specified by:

apply in interface PipelineProfile

Parameters:

builder - The builder to which the profile should be applied.

Returns:

The modified pipeline builder.