io.spokestack.spokestack.profile

Class TFWakewordGoogleASR

java.lang.Object

io.spokestack.spokestack.profile.TFWakewordGoogleASR

All Implemented Interfaces:

PipelineProfile

public class TFWakewordGoogleASR
extends Object
implements PipelineProfile

A speech pipeline profile that uses TensorFlow Lite for wakeword detection and Google Speech for ASR. Properties related to signal processing are tuned for the "Spokestack" wakeword.

Wakeword detection requires configuration to locate the models used for classification; these properties must be set separately from this profile:

• wake-filter-path (string, required): file system path to the "filter" Tensorflow-Lite model, which is used to calculate a mel spectrogram frame from the linear STFT; its inputs should be shaped [fft-width], and its outputs [mel-width]
• wake-encode-path (string, required): file system path to the "encode" Tensorflow-Lite model, which is used to perform each autoregressive step over the mel frames; its inputs should be shaped [mel-length, mel-width], and its outputs [encode-width], with an additional state input/output shaped [state-width]
• wake-detect-path (string, required): file system path to the "detect" Tensorflow-Lite model; its inputs shoudld be shaped [encode-length, encode-width], and its outputs [1]

Google Speech also requires configuration:

• google-credentials (string): json-stringified google service account credentials, used to authenticate with the speech API
• locale (string): language code for speech recognition

See Also:

WakewordTrigger, GoogleSpeechRecognizer

Constructor Summary

Constructors

Constructor and Description
TFWakewordGoogleASR()

Method Summary

Modifier and Type	Method and Description
SpeechPipeline.Builder	apply(SpeechPipeline.Builder builder) Apply this profile to the pipeline builder.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TFWakewordGoogleASR

public TFWakewordGoogleASR()

Method Detail

apply

public SpeechPipeline.Builder apply(SpeechPipeline.Builder builder)

Description copied from interface: PipelineProfile

Apply this profile to the pipeline builder.

Specified by:

apply in interface PipelineProfile

Parameters:

builder - The builder to which the profile should be applied.

Returns:

The modified pipeline builder.