Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

switch to httpcomponents, get rid of archive-overlay-commons-httpclient #28

Merged
merged 170 commits into from
Jan 14, 2014

Conversation

nlevitt
Copy link
Contributor

@nlevitt nlevitt commented Jan 12, 2014

No description provided.

… This commit also gets rid of most egregious commons-httpclient-specific code in CrawlURI
…e end of http headers. is there a problem with not buffering at this level?
…for SessionInputBuffer; refactor helper classes into their own file RecordingHttpClient.java
…HTTP does, and also avoids sending weird Cookie2:$Version1
Conflicts:
	.classpath
…can't rely on stopping right after the headers, which is an assumption of readFullyOrUntil()
Conflicts:
	.classpath
… httpclient (restore functionality from fcece02 to work with current httpcomponents
Conflicts:
	commons/src/main/java/org/apache/commons/httpclient/HttpParser.java
	engine/pom.xml
	modules/src/main/java/org/archive/modules/CrawlURI.java
	modules/src/main/java/org/archive/modules/deciderules/MatchesStatusCodeDecideRule.java
	modules/src/main/java/org/archive/modules/deciderules/NotMatchesStatusCodeDecideRule.java
	modules/src/main/java/org/archive/modules/fetcher/FetchHTTP.java
…mTest.testReadFullyOrUntil() test passes (how does this pass on master?)
Conflicts:
	commons/pom.xml
	commons/src/main/java/org/archive/io/RecordingInputStream.java
	commons/src/main/java/org/archive/io/RecordingOutputStream.java
	commons/src/main/java/org/archive/io/ReplayInputStream.java
	dist/pom.xml
	engine/pom.xml
	modules/pom.xml
	modules/src/main/java/org/archive/modules/extractor/ExtractorHTTP.java
	modules/src/main/java/org/archive/modules/recrawl/FetchHistoryProcessor.java
	pom.xml
kngenie added a commit that referenced this pull request Jan 14, 2014
switch to httpcomponents, get rid of archive-overlay-commons-httpclient
@kngenie kngenie merged commit 07293fb into internetarchive:master Jan 14, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants