org.tensorflow.op.core

Class Skipgram

java.lang.Object

org.tensorflow.op.PrimitiveOp

org.tensorflow.op.core.Skipgram

All Implemented Interfaces:

Op

@Operator
public final class Skipgram
extends PrimitiveOp

Parses a text file and creates a batch of examples.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Skipgram.Options Optional attributes for Skipgram

Field Summary

Fields inherited from class org.tensorflow.op.PrimitiveOp

operation

Method Summary

Modifier and Type	Method and Description
static Skipgram	create(Scope scope, String filename, Long batchSize, Skipgram.Options... options) Factory method to create a class to wrap a new Skipgram operation to the graph.
Output<Integer>	currentEpoch() The current epoch number.
Output<Integer>	examples() A vector of word ids.
Output<Integer>	labels() A vector of word ids.
static Skipgram.Options	minCount(Long minCount)
static Skipgram.Options	subsample(Float subsample)
Output<Long>	totalWordsProcessed() The total number of words processed so far.
Output<Integer>	vocabFreq() Frequencies of words.
Output<String>	vocabWord() A vector of words in the corpus.
static Skipgram.Options	windowSize(Long windowSize)
Output<Long>	wordsPerEpoch() Number of words per epoch in the data file.

Methods inherited from class org.tensorflow.op.PrimitiveOp

equals, hashCode, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Method Detail

create

public static Skipgram create(Scope scope,
                              String filename,
                              Long batchSize,
                              Skipgram.Options... options)

Factory method to create a class to wrap a new Skipgram operation to the graph.

Parameters:

scope - current graph scope

filename - The corpus's text file name.

batchSize - The size of produced batch.

options - carries optional attributes values

Returns:

a new instance of Skipgram

windowSize

public static Skipgram.Options windowSize(Long windowSize)

Parameters:

windowSize - The number of words to predict to the left and right of the target.

minCount

public static Skipgram.Options minCount(Long minCount)

Parameters:

minCount - The minimum number of word occurrences for it to be included in the vocabulary.

subsample

public static Skipgram.Options subsample(Float subsample)

Parameters:

subsample - Threshold for word occurrence. Words that appear with higher frequency will be randomly down-sampled. Set to 0 to disable.

vocabWord

public Output<String> vocabWord()

A vector of words in the corpus.

vocabFreq

public Output<Integer> vocabFreq()

Frequencies of words. Sorted in the non-ascending order.

wordsPerEpoch

public Output<Long> wordsPerEpoch()

Number of words per epoch in the data file.

currentEpoch

public Output<Integer> currentEpoch()

The current epoch number.

totalWordsProcessed

public Output<Long> totalWordsProcessed()

The total number of words processed so far.

examples

public Output<Integer> examples()

A vector of word ids.

labels

public Output<Integer> labels()

A vector of word ids.