| Package | Description |
|---|---|
| edu.uci.ics.crawler4j.crawler | |
| edu.uci.ics.crawler4j.fetcher | |
| edu.uci.ics.crawler4j.frontier | |
| edu.uci.ics.crawler4j.parser |
| Modifier and Type | Field and Description |
|---|---|
protected CrawlConfig |
Configurable.config
Deprecated.
|
| Modifier and Type | Method and Description |
|---|---|
CrawlConfig |
Configurable.getConfig()
Deprecated.
|
CrawlConfig |
CrawlController.getConfig() |
| Constructor and Description |
|---|
Configurable(CrawlConfig config)
Deprecated.
|
CrawlController(CrawlConfig config,
PageFetcher pageFetcher,
Parser parser,
RobotstxtServer robotstxtServer) |
CrawlController(CrawlConfig config,
PageFetcher pageFetcher,
RobotstxtServer robotstxtServer) |
| Modifier and Type | Field and Description |
|---|---|
protected CrawlConfig |
PageFetcher.config
This field is protected for retro compatibility.
|
| Modifier and Type | Method and Description |
|---|---|
protected CrawlConfig |
PageFetcher.getConfig() |
| Constructor and Description |
|---|
PageFetcher(CrawlConfig config) |
| Constructor and Description |
|---|
Counters(com.sleepycat.je.Environment env,
CrawlConfig config) |
DocIDServer(com.sleepycat.je.Environment env,
CrawlConfig config) |
Frontier(com.sleepycat.je.Environment env,
CrawlConfig config) |
| Constructor and Description |
|---|
Parser(CrawlConfig config) |
Parser(CrawlConfig config,
HtmlParser htmlParser) |
TikaHtmlParser(CrawlConfig config) |
Copyright © 2018. All rights reserved.