| Modifier and Type | Method and Description |
|---|---|
StateVertex |
UnfiredCandidateActions.awaitNewTask() |
StateVertex |
UnfiredCandidateActions.awaitNewTaskPriority(CrawlRules.CrawlPriorityMode crawlPriorityMode,
boolean crawlNearDuplicates,
boolean delayNearDuplicateCrawling) |
StateVertex |
Crawler.crawlIndex()
This method calls the index state.
|
StateVertex |
CrawlTaskConsumer.crawlIndex()
This method calls the index state.
|
StateVertex |
CrawlerContext.getCurrentState() |
StateVertex |
CrawlSession.getInitialState() |
StateVertex |
UnfiredCandidateActions.getNextNonDuplicate() |
StateVertex |
UnfiredCandidateActions.getOldest() |
StateVertex |
StateUnreachableException.getTarget() |
| Modifier and Type | Method and Description |
|---|---|
void |
UnfiredCandidateActions.addActions(com.google.common.collect.ImmutableList<CandidateElement> extract,
StateVertex currentState) |
void |
Crawler.execute(StateVertex crawlTask) |
com.google.common.collect.ImmutableList<CandidateElement> |
CandidateElementExtractor.extract(StateVertex currentState)
This method extracts candidate elements from the current DOM tree in the browser, based on
the crawl tags defined by the user.
|
void |
UnfiredCandidateActions.purgeActionsForState(StateVertex crawlTask) |
| Constructor and Description |
|---|
CrawlSession(CrawljaxConfiguration config,
StateFlowGraph stateFlowGraph,
StateVertex state,
com.codahale.metrics.MetricRegistry registry) |
StateUnreachableException(StateVertex state,
String reason) |
| Modifier and Type | Method and Description |
|---|---|
void |
OnNewStatePlugin.onNewState(CrawlerContext context,
StateVertex newState)
Method that is called when a new state is found.
|
void |
OnRevisitStatePlugin.onRevisitState(CrawlerContext context,
StateVertex currentState)
Method that is called every time a state is revisited by Crawljax.
|
void |
PreStateCrawlingPlugin.preStateCrawling(CrawlerContext context,
com.google.common.collect.ImmutableList<CandidateElement> candidateElements,
StateVertex state)
Method that is called before firing events on the current DOM state.
|
void |
Plugins.runOnNewStatePlugins(CrawlerContext context,
StateVertex newState)
load and run the OnNewStatePlugins.
|
void |
Plugins.runOnRevisitStatePlugins(CrawlerContext context,
StateVertex currentState)
load and run the onRevisitStateValidator.
|
void |
Plugins.runPreStateCrawlingPlugins(CrawlerContext context,
com.google.common.collect.ImmutableList<CandidateElement> candidateElements,
StateVertex state)
load and run the PreStateCrawlingPlugins.
|
| Modifier and Type | Class and Description |
|---|---|
class |
StateVertexImpl
The state vertex class which represents a state in the browser.
|
| Modifier and Type | Method and Description |
|---|---|
StateVertex |
StateVertexFactory.createIndex(String url,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
StateFlowGraph.getById(int id) |
StateVertex |
InMemoryStateFlowGraph.getById(int id) |
StateVertex |
StateMachine.getCurrentState()
Return the current State in this state machine.
|
StateVertex |
StateFlowGraph.getInitialState() |
StateVertex |
InMemoryStateFlowGraph.getInitialState() |
StateVertex |
Eventable.getSourceStateVertex() |
StateVertex |
Eventable.getTargetStateVertex() |
StateVertex |
StateMachine.newStateFor(EmbeddedBrowser browser) |
abstract StateVertex |
StateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser)
Defines a State.
|
StateVertex |
DefaultStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
InMemoryStateFlowGraph.putIfAbsent(StateVertex stateVertex)
Adds a state (as a vertex) to the State-Flow Graph if not already present.
|
StateVertex |
InMemoryStateFlowGraph.putIndex(StateVertex index) |
| Modifier and Type | Method and Description |
|---|---|
List<List<org.jgrapht.GraphPath<StateVertex,Eventable>>> |
StateFlowGraph.getAllPossiblePaths(StateVertex index)
This method returns all possible paths from the index state using the k-shortest paths.
|
List<List<org.jgrapht.GraphPath<StateVertex,Eventable>>> |
InMemoryStateFlowGraph.getAllPossiblePaths(StateVertex index) |
com.google.common.collect.ImmutableSet<StateVertex> |
StateFlowGraph.getAllStates()
Return all the states in the StateFlowGraph.
|
com.google.common.collect.ImmutableSet<StateVertex> |
InMemoryStateFlowGraph.getAllStates() |
List<StateVertex> |
StateMachine.getOnURLSet() |
com.google.common.collect.ImmutableSet<StateVertex> |
StateFlowGraph.getOutgoingStates(StateVertex stateVertex) |
com.google.common.collect.ImmutableSet<StateVertex> |
InMemoryStateFlowGraph.getOutgoingStates(StateVertex stateVertex) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
InMemoryStateFlowGraph.addEdge(StateVertex sourceVertex,
StateVertex targetVertex,
Eventable clickable)
Adds the specified edge to this graph, going from the source vertex to the target vertex.
|
boolean |
StateFlowGraph.canGoTo(StateVertex source,
StateVertex target)
Is it possible to go from s1 -> s2?
|
boolean |
InMemoryStateFlowGraph.canGoTo(StateVertex source,
StateVertex target) |
boolean |
StateMachine.changeState(StateVertex nextState)
Change the currentState to the nextState if possible.
|
List<List<org.jgrapht.GraphPath<StateVertex,Eventable>>> |
StateFlowGraph.getAllPossiblePaths(StateVertex index)
This method returns all possible paths from the index state using the k-shortest paths.
|
List<List<org.jgrapht.GraphPath<StateVertex,Eventable>>> |
InMemoryStateFlowGraph.getAllPossiblePaths(StateVertex index) |
double |
StateVertex.getDist(StateVertex vertexOfGraph) |
double |
StateVertexImpl.getDist(StateVertex vertexOfGraph) |
com.google.common.collect.ImmutableSet<Eventable> |
StateFlowGraph.getIncomingClickable(StateVertex stateVertex)
Returns a set of all edges incoming into the specified vertex.
|
com.google.common.collect.ImmutableSet<Eventable> |
InMemoryStateFlowGraph.getIncomingClickable(StateVertex stateVertex) |
com.google.common.collect.ImmutableSet<Eventable> |
StateFlowGraph.getOutgoingClickables(StateVertex stateVertex)
Returns a set of all clickables outgoing from the specified vertex.
|
com.google.common.collect.ImmutableSet<Eventable> |
InMemoryStateFlowGraph.getOutgoingClickables(StateVertex stateVertex) |
com.google.common.collect.ImmutableSet<StateVertex> |
StateFlowGraph.getOutgoingStates(StateVertex stateVertex) |
com.google.common.collect.ImmutableSet<StateVertex> |
InMemoryStateFlowGraph.getOutgoingStates(StateVertex stateVertex) |
com.google.common.collect.ImmutableList<Eventable> |
StateFlowGraph.getShortestPath(StateVertex start,
StateVertex end)
Convenience method to find the Dijkstra shortest path between two states on the graph.
|
com.google.common.collect.ImmutableList<Eventable> |
InMemoryStateFlowGraph.getShortestPath(StateVertex start,
StateVertex end) |
boolean |
StateFlowGraph.hasClone(StateVertex vertex) |
boolean |
InMemoryStateFlowGraph.hasClone(StateVertex vertex) |
boolean |
StateVertex.inThreshold(StateVertex vertexOfGraph) |
boolean |
StateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
StateVertex |
InMemoryStateFlowGraph.putIfAbsent(StateVertex stateVertex)
Adds a state (as a vertex) to the State-Flow Graph if not already present.
|
StateVertex |
InMemoryStateFlowGraph.putIndex(StateVertex index) |
void |
StateMachine.setCurrentState(StateVertex currentState) |
void |
Eventable.setSource(StateVertex source) |
void |
Eventable.setTarget(StateVertex target) |
boolean |
StateMachine.switchToStateAndCheckIfClone(Eventable event,
StateVertex newState,
CrawlerContext context)
Adds an edge between the current and new state.
|
| Constructor and Description |
|---|
StateMachine(InMemoryStateFlowGraph sfg,
com.google.common.collect.ImmutableList<Invariant> invariantList,
Plugins plugins,
StateComparator stateComparator,
List<StateVertex> onURLSet) |
| Modifier and Type | Method and Description |
|---|---|
void |
CrawlSessionProvider.setup(StateVertex indexState) |
| Modifier and Type | Class and Description |
|---|---|
class |
LevenshteinStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
RTEDStateVertexImpl
The state vertex class which represents a state in the browser.
|
| Modifier and Type | Method and Description |
|---|---|
StateVertex |
RTEDStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
LevenshteinStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
| Modifier and Type | Method and Description |
|---|---|
double |
RTEDStateVertexImpl.getDist(StateVertex vertexOfGraph) |
double |
LevenshteinStateVertexImpl.getDist(StateVertex vertexOfGraph) |
| Modifier and Type | Class and Description |
|---|---|
class |
ColorHistogramStateVertexImpl
The state vertex class which represents a state in the browser.
|
| Modifier and Type | Method and Description |
|---|---|
StateVertex |
ColorHistogramStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
| Modifier and Type | Class and Description |
|---|---|
class |
AverageImageHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
BlockMeanImageHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
ColorMomentImageHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
DHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
MarrHildrethImageHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
PerceptualImageHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
class |
RadialVarianceImageHashStateVertexImpl
The state vertex class which represents a state in the browser.
|
| Modifier and Type | Method and Description |
|---|---|
StateVertex |
ColorMomentImageHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
BlockMeanImageHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
PerceptualImageHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
AverageImageHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
RadialVarianceImageHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
MarrHildrethImageHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
StateVertex |
DHashStateVertexFactory.newStateVertex(int id,
String url,
String name,
String dom,
String strippedDom,
EmbeddedBrowser browser) |
| Modifier and Type | Method and Description |
|---|---|
double |
RadialVarianceImageHashStateVertexImpl.getDist(StateVertex vertexOfGraph) |
double |
AverageImageHashStateVertexImpl.getDist(StateVertex vertexOfGraph) |
double |
MarrHildrethImageHashStateVertexImpl.getDist(StateVertex vertexOfGraph) |
double |
PerceptualImageHashStateVertexImpl.getDist(StateVertex vertexOfGraph) |
double |
ColorMomentImageHashStateVertexImpl.getDist(StateVertex vertexOfGraph) |
double |
BlockMeanImageHashStateVertexImpl.getDist(StateVertex vertexOfGraph) |
boolean |
RadialVarianceImageHashStateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
boolean |
AverageImageHashStateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
boolean |
MarrHildrethImageHashStateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
boolean |
PerceptualImageHashStateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
boolean |
ColorMomentImageHashStateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
boolean |
BlockMeanImageHashStateVertexImpl.inThreshold(StateVertex vertexOfGraph) |
Copyright © 2007–2019. All rights reserved.