com.github.hackerwin7.jlib.utils.drivers.kafka.consumer

Class KafkaSimpleConsumer

java.lang.Object

com.github.hackerwin7.jlib.utils.drivers.kafka.consumer.KafkaSimpleConsumer

public class KafkaSimpleConsumer
extends Object

Created by IntelliJ IDEA. User: hackerwin7 Date: 2015/12/10 Time: 10:57 AM Desc: kafka api for simple consumer to control offset add execute pool service for single topic and multiple partition and multiple consumer thread add consumer threads monitor with these consumer running

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	KafkaSimpleConsumer.ConsumeThread start the thread to run the consumer

Field Summary

Fields

Modifier and Type	Field and Description
static String	CONF_SPLIT
static int	CONSUME_BUFFER_SIZE
static int	CONSUME_TIME_OUT
static int	ERR_COUNT_RECONN
static int	FETCH_SIZE
static String	PORT_SPLIT
static int	QUEUE_SIZE
static long	SLEEPING_TIME
static int	THREAD_POOL_SIZE

Constructor Summary

Constructors

Constructor and Description
KafkaSimpleConsumer(KafkaConf conf) constructor by kafka config

Method Summary

Modifier and Type	Method and Description
void	close() close thread pool
KafkaMsg	consume() consume message
long	findMaxOffset(int partition) find max offset
long	findMinOffset(int partition) find min offset
int	getQueueSize() getOrigin queue size
String	getTopic() getOrigin topic in this consumer
boolean	isConsumeEmpty() is queue empty

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

QUEUE_SIZE

public static final int QUEUE_SIZE

See Also:

Constant Field Values

CONF_SPLIT

public static final String CONF_SPLIT

See Also:

Constant Field Values

PORT_SPLIT

public static final String PORT_SPLIT

See Also:

Constant Field Values

CONSUME_TIME_OUT

public static final int CONSUME_TIME_OUT

See Also:

Constant Field Values

CONSUME_BUFFER_SIZE

public static final int CONSUME_BUFFER_SIZE

See Also:

Constant Field Values

FETCH_SIZE

public static final int FETCH_SIZE

See Also:

Constant Field Values

ERR_COUNT_RECONN

public static final int ERR_COUNT_RECONN

See Also:

Constant Field Values

SLEEPING_TIME

public static final long SLEEPING_TIME

See Also:

Constant Field Values

THREAD_POOL_SIZE

public static final int THREAD_POOL_SIZE

See Also:

Constant Field Values

Constructor Detail

KafkaSimpleConsumer

public KafkaSimpleConsumer(KafkaConf conf)

constructor by kafka config

Parameters:

conf -

Method Detail

findMaxOffset

public long findMaxOffset(int partition)

find max offset

Returns:

max offset

findMinOffset

public long findMinOffset(int partition)

find min offset

Parameters:

partition -

Returns:

min offset

getTopic

public String getTopic()

getOrigin topic in this consumer

Returns:

topic name

close

public void close()

close thread pool

consume

public KafkaMsg consume()
                 throws Exception

consume message

Returns:

kafka msg

Throws:

Exception

getQueueSize

public int getQueueSize()

getOrigin queue size

Returns:

size of queue

isConsumeEmpty

public boolean isConsumeEmpty()

is queue empty

Returns:

bool