org.cg.eventbus.consumer

Class SymmetricDispatcher<K,V>

java.lang.Object

org.cg.eventbus.consumer.SymmetricDispatcher<K,V>

All Implemented Interfaces:

IConsumer<K,V>, IEventBus

public class SymmetricDispatcher<K,V>
extends Object
implements IConsumer<K,V>

SymmetricDispatcher has one kafka consumer, dispatcher can be launched into multiple processes, kafka should auto balance its consumers therefore it is symmetric. One dispatcher/consumer can take msgs from multiple topic and each topic get multiple streams for multiple thread to work on. (One partition will only end up with one stream, one stream has msgs from 0 to n partitions).

Author:

yanlinwang

Field Summary

Fields inherited from interface org.cg.eventbus.consumer.IConsumer

COMMIT_INTERVAL, CONSUMER_LISTENERS, CONSUMER_STREAMS, CONSUMER_THREAD_POOL_SIZE, CONSUMER_TOPICS, DEFAULT_COMMIT_INTERVAL, DEFAULT_CONNECTION_TIMEOUT, DEFAULT_GROUP_ID, DEFAULT_SINGLE_TOPIC, DEFAULT_STREAM_THREADS, DEFAULT_SUB_ZK_CONNECT, DEFAULT_THREAD_POOL_SIZE, DEFAULT_ZKCLIENT_CONNECTION_TIMEOUT, DEFAULT_ZKCLIENT_SERVER, DEFAULT_ZKCLIENT_SESSION_TIMEOUT, GROUP_ID, KEY_DECODER, NO_SUCH_BROKER, NO_SUCH_TOPIC, SINGLE_TOPIC, VALUE_DECODER, ZKCONNECTION_TIMEOUT

Fields inherited from interface org.cg.eventbus.IEventBus

AUTO_CREATE, DEFAULT_PRO_ZK_CONNECT, ZK_CONNECT

Constructor Summary

Constructors

Constructor and Description
SymmetricDispatcher(org.apache.commons.configuration.Configuration config)
SymmetricDispatcher(Properties props)
SymmetricDispatcher(String configFile)

Method Summary

Methods

Modifier and Type	Method and Description
String	getGroupId() Just get client ID
void	launch() launch processor thread N topic, each topic -> M stream -> M thread
void	shutdown() Shutdown this CONSUMER, set offsets correctly and then shutdown everything

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SymmetricDispatcher

public SymmetricDispatcher(String configFile)
                    throws Exception

Throws:

Exception

SymmetricDispatcher

public SymmetricDispatcher(org.apache.commons.configuration.Configuration config)
                    throws Exception

Throws:

Exception

SymmetricDispatcher

public SymmetricDispatcher(Properties props)
                    throws Exception

Throws:

Exception

Method Detail

getGroupId

public String getGroupId()

Just get client ID

Returns:

client ID

launch

public void launch()

launch processor thread N topic, each topic -> M stream -> M thread

shutdown

public void shutdown()

Shutdown this CONSUMER, set offsets correctly and then shutdown everything