Package

org.apache.spark

whylogs

Permalink

package whylogs

Visibility
  1. Public
  2. All

Type Members

  1. case class DatasetProfileAggregator(datasetName: String, sessionTimeInMillis: Long, timeColumn: String = null, groupByColumns: Seq[String] = Seq(), sessionId: String = UUID.randomUUID().toString) extends sql.expressions.Aggregator[Row, DatasetProfile, ScalaDatasetProfile] with Serializable with Product

    Permalink

    A dataset aggregator.

    A dataset aggregator. It aggregates Row into DatasetProfile objects underneath the hood.

  2. case class ScalaDatasetProfile(value: DatasetProfile) extends Serializable with Product

    Permalink

    Dataset API requires a case class for automatic encoders.

    Dataset API requires a case class for automatic encoders. I couldn't figure out how to manually create an encoder for a Java class and thus a wrapper

    value

    the actual DatasetProfile object

    Annotations
    @SerialVersionUID() @SQLUserDefinedType()
  3. class ScalaDatasetProfileUDT extends UserDefinedType[ScalaDatasetProfile]

    Permalink

    The user defined type for the ScalaDatasetProfile class.

    The user defined type for the ScalaDatasetProfile class. This is a developer API so it might break in the future.

Value Members

  1. object InstantDateTimeFormatter

    Permalink
  2. object ScalaDatasetProfileUDT extends Serializable

    Permalink

Ungrouped