Uses of Interface
org.apache.arrow.vector.dictionary.DictionaryProvider
Packages that use DictionaryProvider
Package
Description
-
Uses of DictionaryProvider in org.apache.arrow.vector.dictionary
Classes in org.apache.arrow.vector.dictionary that implement DictionaryProviderModifier and TypeClassDescriptionstatic classImplementation ofDictionaryProviderthat is backed by a hash-map.Methods in org.apache.arrow.vector.dictionary with parameters of type DictionaryProviderModifier and TypeMethodDescriptionvoidDictionaryProvider.MapDictionaryProvider.copyStructureFrom(DictionaryProvider other, BufferAllocator allocator) Initialize the map structure from another provider, but with empty vectors. -
Uses of DictionaryProvider in org.apache.arrow.vector.ipc
Classes in org.apache.arrow.vector.ipc that implement DictionaryProviderModifier and TypeClassDescriptionclassAn implementation ofArrowReaderthat reads the standard arrow binary file format.classAbstract class to read Schema and ArrowRecordBatches.classThis class reads from an input stream and produces ArrowRecordBatches.classA reader for JSON files that translates them into vectors.Methods in org.apache.arrow.vector.ipc with parameters of type DictionaryProviderModifier and TypeMethodDescriptionprotected voidArrowFileWriter.ensureDictionariesWritten(DictionaryProvider provider, Set<Long> dictionaryIdsUsed) protected voidArrowStreamWriter.ensureDictionariesWritten(DictionaryProvider provider, Set<Long> dictionaryIdsUsed) protected abstract voidArrowWriter.ensureDictionariesWritten(DictionaryProvider provider, Set<Long> dictionaryIdsUsed) Write dictionaries after schema and before recordBatches, dictionaries won't be written if empty stream (only has schema data in IPC).voidJsonFileWriter.start(Schema schema, DictionaryProvider provider) Writes out the "header" of the file including the schema and any dictionaries required.Constructors in org.apache.arrow.vector.ipc with parameters of type DictionaryProviderModifierConstructorDescriptionArrowFileWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out) ArrowFileWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, Map<String, String> metaData) ArrowFileWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, Map<String, String> metaData, IpcOption option) ArrowFileWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, Map<String, String> metaData, IpcOption option, CompressionCodec.Factory compressionFactory, CompressionUtil.CodecType codecType) ArrowFileWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, Map<String, String> metaData, IpcOption option, CompressionCodec.Factory compressionFactory, CompressionUtil.CodecType codecType, Optional<Integer> compressionLevel) ArrowFileWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, IpcOption option) ArrowStreamWriter(VectorSchemaRoot root, DictionaryProvider provider, OutputStream out) Construct an ArrowStreamWriter with an optional DictionaryProvider for the OutputStream.ArrowStreamWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out) Construct an ArrowStreamWriter with an optional DictionaryProvider for the WritableByteChannel.ArrowStreamWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, IpcOption option) Construct an ArrowStreamWriter with an optional DictionaryProvider for the WritableByteChannel.ArrowStreamWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, IpcOption option, CompressionCodec.Factory compressionFactory, CompressionUtil.CodecType codecType) Construct an ArrowStreamWriter with compression enabled.ArrowStreamWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, IpcOption option, CompressionCodec.Factory compressionFactory, CompressionUtil.CodecType codecType, Optional<Integer> compressionLevel) Construct an ArrowStreamWriter with compression enabled.protectedArrowWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out) protectedArrowWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, IpcOption option) protectedArrowWriter(VectorSchemaRoot root, DictionaryProvider provider, WritableByteChannel out, IpcOption option, CompressionCodec.Factory compressionFactory, CompressionUtil.CodecType codecType, Optional<Integer> compressionLevel) Note: fields are not closed when the writer is closed. -
Uses of DictionaryProvider in org.apache.arrow.vector.table
Fields in org.apache.arrow.vector.table declared as DictionaryProviderModifier and TypeFieldDescriptionprotected DictionaryProviderBaseTable.dictionaryProviderAn optional DictionaryProvider.Methods in org.apache.arrow.vector.table that return DictionaryProviderModifier and TypeMethodDescriptionBaseTable.getDictionaryProvider()Returns the DictionaryProvider for this table.Constructors in org.apache.arrow.vector.table with parameters of type DictionaryProviderModifierConstructorDescriptionBaseTable(List<FieldVector> fieldVectors, int rowCount, DictionaryProvider provider) Constructs new instance with the given rowCount, and containing the schema and each of the given vectors.Table(List<FieldVector> fieldVectors, int rowCount, DictionaryProvider provider) Constructs a new instance. -
Uses of DictionaryProvider in org.apache.arrow.vector.util
Methods in org.apache.arrow.vector.util with parameters of type DictionaryProviderModifier and TypeMethodDescriptionstatic voidValidator.compareDictionaries(List<DictionaryEncoding> encodings1, List<DictionaryEncoding> encodings2, DictionaryProvider provider1, DictionaryProvider provider2) Validate two Dictionary encodings and dictionaries with id's from the encodings.static voidValidator.compareDictionaryProviders(DictionaryProvider provider1, DictionaryProvider provider2) Validate two dictionary providers are equal in structure and contents.static FieldDictionaryUtility.toMessageFormat(Field field, DictionaryProvider provider, Set<Long> dictionaryIdsUsed) Convert field and child fields that have a dictionary encoding to message format, so fields have the dictionary type.