org.deeplearning4j.datasets.fetchers

Class CacheableExtractableDataSetFetcher

java.lang.Object

org.deeplearning4j.datasets.fetchers.CacheableExtractableDataSetFetcher

Direct Known Subclasses:

SvhnDataFetcher, TinyImageNetFetcher, UciSequenceDataFetcher

public abstract class CacheableExtractableDataSetFetcher
extends Object

Abstract class for enabling dataset downloading and local caching.

Author:

Justin Long (crockpotveggies)

Field Summary

Fields

Modifier and Type	Field and Description
static String	DL4J_DIR
File	LOCAL_CACHE
static File	ROOT_CACHE_DIR

Constructor Summary

Constructors

Constructor and Description
CacheableExtractableDataSetFetcher()

Method Summary

Modifier and Type	Method and Description
String	dataSetName(DataSetType set)
void	downloadAndExtract()
void	downloadAndExtract(DataSetType set) Downloads and extracts the local dataset.
long	expectedChecksum()
long	expectedChecksum(DataSetType set)
org.datavec.api.records.reader.RecordReader	getRecordReader(long rngSeed, int[] imgDim, DataSetType set, org.datavec.image.transform.ImageTransform imageTransform)
boolean	isCached() Returns a boolean indicating if the dataset is already cached locally.
String	localCacheName()
String	remoteDataUrl()
String	remoteDataUrl(DataSetType set)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DL4J_DIR

public static final String DL4J_DIR

See Also:

Constant Field Values

ROOT_CACHE_DIR

public static final File ROOT_CACHE_DIR

LOCAL_CACHE

public File LOCAL_CACHE

Constructor Detail

CacheableExtractableDataSetFetcher

public CacheableExtractableDataSetFetcher()

Method Detail

dataSetName

public String dataSetName(DataSetType set)

remoteDataUrl

public String remoteDataUrl()

expectedChecksum

public long expectedChecksum()

downloadAndExtract

public void downloadAndExtract()
                        throws IOException

Throws:

IOException

downloadAndExtract

public void downloadAndExtract(DataSetType set)
                        throws IOException

Downloads and extracts the local dataset.

Throws:

IOException

isCached

public boolean isCached()

Returns a boolean indicating if the dataset is already cached locally.

Returns:

boolean

remoteDataUrl

public String remoteDataUrl(DataSetType set)

localCacheName

public String localCacheName()

expectedChecksum

public long expectedChecksum(DataSetType set)

getRecordReader

public org.datavec.api.records.reader.RecordReader getRecordReader(long rngSeed,
                                                                   int[] imgDim,
                                                                   DataSetType set,
                                                                   org.datavec.image.transform.ImageTransform imageTransform)