boofcv.android.camera

Class VideoRenderProcessing<T extends boofcv.struct.image.ImageBase<T>>

java.lang.Object

java.lang.Thread

boofcv.android.camera.VideoRenderProcessing<T>

All Implemented Interfaces:

VideoProcessing, java.lang.Runnable

Direct Known Subclasses:

VideoImageProcessing

public abstract class VideoRenderProcessing<T extends boofcv.struct.image.ImageBase<T>>
extends java.lang.Thread
implements VideoProcessing

Processing class for displaying more complex visualizations data. Children of this class must properly lock down the GUI when processing data that can be read/written to when updating GUI. This is done by synchronizing around the class variable lockGui.

The canvas is resized and centered for display purposes. The scale and translation factors applied to the canvas prior to it being passed in to the child of this class can be access through the class parameters or getter functions. The size of the output image can be accessed in a similar manor, see outputWidth and outputHeight. The just mentioned output size is used to compute the scale and translation and can be overridden inside init(android.view.View, android.hardware.Camera, android.hardware.Camera.CameraInfo, int) or declareImages(int, int).

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field and Description
protected java.lang.Object	lockConvert Lock used when converting the video stream.
protected java.lang.Object	lockGui Lock used ever reading or writing to display related data.
protected int	outputHeight
protected int	outputWidth
protected double	scale
protected double	tranX
protected double	tranY
protected android.view.View	view

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	VideoRenderProcessing(boofcv.struct.image.ImageType<T> imageType)

Method Summary

Modifier and Type	Method and Description
void	convertPreview(byte[] bytes, android.hardware.Camera camera) Called inside the camera preview thread after new data has arrived.
protected void	declareImages(int width, int height)
double	getScale() Scaling applied to the drawing canvas
double	getTranX() Translation x applied to the drawing canvas
double	getTranY() Translation y applied to the drawing canvas
protected void	imageToOutput(double x, double y, georegression.struct.point.Point2D_F64 pt) Converts a coordinate from pixel to the output image coordinates
void	init(android.view.View view, android.hardware.Camera camera, android.hardware.Camera.CameraInfo info, int previewRotation)
void	onDraw(android.graphics.Canvas canvas) Invoked by Android GUI thread.
protected void	outputToImage(double x, double y, georegression.struct.point.Point2D_F64 pt) Converts a coordinate from output image coordinates to input image
protected abstract void	process(T gray) Image processing is done here and is invoked in its own thread, removing any hard time constraints.
protected abstract void	render(android.graphics.Canvas canvas, double imageToOutput) Results computed by process(T) are visualized here.
void	run()
void	stopProcessing() Blocks until all processing has stopped

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

outputWidth

protected int outputWidth

outputHeight

protected int outputHeight

view

protected android.view.View view

lockGui

protected final java.lang.Object lockGui

Lock used ever reading or writing to display related data. User should use this to ensure that the processing() function and render() function's don't stead on each other's feet.

lockConvert

protected final java.lang.Object lockConvert

Lock used when converting the video stream. Should not need to be used by the user.

scale

protected double scale

tranX

protected double tranX

tranY

protected double tranY

Constructor Detail

VideoRenderProcessing

protected VideoRenderProcessing(boofcv.struct.image.ImageType<T> imageType)

Method Detail

init

public void init(android.view.View view,
                 android.hardware.Camera camera,
                 android.hardware.Camera.CameraInfo info,
                 int previewRotation)

Specified by:

init in interface VideoProcessing

onDraw

public void onDraw(android.graphics.Canvas canvas)

Description copied from interface: VideoProcessing

Invoked by Android GUI thread. Should be run as fast as possible to avoid making the GUI feel sluggish.

Specified by:

onDraw in interface VideoProcessing

Parameters:

canvas - Use this canvas to draw results onto. Already be adjusted for the display and camera preview size. .

imageToOutput

protected void imageToOutput(double x,
                             double y,
                             georegression.struct.point.Point2D_F64 pt)

Converts a coordinate from pixel to the output image coordinates

outputToImage

protected void outputToImage(double x,
                             double y,
                             georegression.struct.point.Point2D_F64 pt)

Converts a coordinate from output image coordinates to input image

convertPreview

public void convertPreview(byte[] bytes,
                           android.hardware.Camera camera)

Description copied from interface: VideoProcessing

Called inside the camera preview thread after new data has arrived. Must be as fast as possible to avoid crashing the application. Just convert the NV21 data into a more useful format

Specified by:

convertPreview in interface VideoProcessing

Parameters:

bytes - Data from preview image in NV21 format.

camera - Reference to camera

stopProcessing

public void stopProcessing()

Description copied from interface: VideoProcessing

Blocks until all processing has stopped

Specified by:

stopProcessing in interface VideoProcessing

run

public void run()

Specified by:

run in interface java.lang.Runnable

Overrides:

run in class java.lang.Thread

getScale

public double getScale()

Scaling applied to the drawing canvas

getTranX

public double getTranX()

Translation x applied to the drawing canvas

getTranY

public double getTranY()

Translation y applied to the drawing canvas

process

protected abstract void process(T gray)

Image processing is done here and is invoked in its own thread, removing any hard time constraints. When modifying data structures that are read inside of render(android.graphics.Canvas, double) be sure to use synchronize with lockGui to avoid crashes or weird visual artifacts. Use of lockGui should be minimized to ensure a fast and responsive GUI

render

protected abstract void render(android.graphics.Canvas canvas,
                               double imageToOutput)

Results computed by process(T) are visualized here. This function is called inside a synchronize(lockGui) block. The provided canvas has been adjusted to be centered in the view and to account for the resolution difference of the preview image and the display.

Parameters:

canvas - Canvas which is to be displayed.

imageToOutput - Scale factor from input image to output display. Can also be accessed via getScale()

declareImages

protected void declareImages(int width,
                             int height)