com.github.vector4wang

类 VWCrawler.Builder

java.lang.Object

com.github.vector4wang.VWCrawler.Builder

封闭类:

VWCrawler

public static class VWCrawler.Builder
extends Object

比较流行的链式编程

构造器概要

构造器

构造器和说明
Builder()

方法概要

限定符和类型	方法和说明
VWCrawler	build()
VWCrawler.Builder	setAbsProxyExtracter(AbstractProxyExtractor extracter)
VWCrawler.Builder	setCookie(String key, String value)
VWCrawler.Builder	setCookies(Map<String,String> cookies)
VWCrawler.Builder	setDownloader(AbstractDownloader downloader)
VWCrawler.Builder	setHeader(String key, String value)
VWCrawler.Builder	setHeaders(HashMap<String,String> headerMap)
VWCrawler.Builder	setPageParser(CrawlerService crawlerService)
VWCrawler.Builder	setProxys(List<Proxy2> proxys)
VWCrawler.Builder	setRetryCount(int retryCount)
VWCrawler.Builder	setSeedsPage(String... seedsPage)
VWCrawler.Builder	setSeedsPageUrlRex(String... seedsPageUrlRex) 设置种子页面URL的正则表达式
VWCrawler.Builder	setSeedUrl(String... targetUrl)
VWCrawler.Builder	setTargetUrlRex(String... targetUrlRex) 设置目标页URL的正则表达式
VWCrawler.Builder	setThreadCount(int count)
VWCrawler.Builder	setTimeOut(int timeOut)
VWCrawler.Builder	setUrl(String url)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Builder

public Builder()

方法详细资料

setUrl

public VWCrawler.Builder setUrl(String url)

setTimeOut

public VWCrawler.Builder setTimeOut(int timeOut)

setSeedUrl

public VWCrawler.Builder setSeedUrl(String... targetUrl)

setThreadCount

public VWCrawler.Builder setThreadCount(int count)

setSeedsPage

public VWCrawler.Builder setSeedsPage(String... seedsPage)

setTargetUrlRex

public VWCrawler.Builder setTargetUrlRex(String... targetUrlRex)

设置目标页URL的正则表达式

参数:

targetUrlRex - seed url正则表达式

返回:

this

setSeedsPageUrlRex

public VWCrawler.Builder setSeedsPageUrlRex(String... seedsPageUrlRex)

设置种子页面URL的正则表达式

参数:

seedsPageUrlRex - seeds url 正则表达式

返回:

this

setPageParser

public VWCrawler.Builder setPageParser(CrawlerService crawlerService)

setDownloader

public VWCrawler.Builder setDownloader(AbstractDownloader downloader)

setHeaders

public VWCrawler.Builder setHeaders(HashMap<String,String> headerMap)

setHeader

public VWCrawler.Builder setHeader(String key,
                                   String value)

setCookie

public VWCrawler.Builder setCookie(String key,
                                   String value)

setCookies

public VWCrawler.Builder setCookies(Map<String,String> cookies)

setProxys

public VWCrawler.Builder setProxys(List<Proxy2> proxys)

setAbsProxyExtracter

public VWCrawler.Builder setAbsProxyExtracter(AbstractProxyExtractor extracter)

setRetryCount

public VWCrawler.Builder setRetryCount(int retryCount)

build

public VWCrawler build()