EepPost

java.lang.Object

net.i2p.util.EepGet

net.i2p.util.EepPost

public class EepPostextends EepGet

Extends EepGet for POST. Adapted from old jrandom EepPost, removed 2012 as unused. Ref: RFC 7578.

Nested Class Summary
Nested classes/interfaces inherited from class EepGet
EepGet.AUTH_MODE, EepGet.AuthState, EepGet.CLIStatusListener, EepGet.ContentRange, EepGet.Gunzipper, EepGet.StatusListener
Modifier and Type
Class
Description
protected static enum
EepGet.AUTH_MODE
Authentication mode enumeration.
protected class
EepGet.AuthState
Manage the authentication parameters Ref: RFC 2617 Supports both Basic and Digest, however i2ptunnel HTTP proxy has migrated all previous Basic support to Digest.
protected class
EepGet.CLIStatusListener
Reports fetch progress to the command line, one mark per markSize bytes and a summary line every lineSize marks.
(package private) static final class
EepGet.ContentRange
Parsed Content-Range header value.
protected class
EepGet.Gunzipper
Decompressor thread.
static interface
EepGet.StatusListener
Callback interface for monitoring EepGet transfer progress.
Field Summary
Fields
Modifier and Type
Field
Description
private static final String
CRLF
Line ending in an HTTP header.
private static final byte[]
CRLFB
The header line ending, as bytes.
private static final int
PROP_MAX_POST_PAYLOAD_RAM
Most of a POST body kept in memory, in bytes.
Fields inherited from class EepGet
_aborted, _acceptRanges, _actualURL, _alreadyTransferred, _authState, _bytesRemaining, _bytesTransferred, _cacheControl, _contentEncoding, _contentLanguage, _contentRange, _contentType, _context, _cookie, _csp, _currentAttempt, _decompressException, _encodingChunked, _etag, _etagOrig, _expiryDate, _extraHeaders, _fetchHeaderTimeout, _fetchInactivityTimeout, _fetchTotalTimeout, _isGzippedResponse, _keepFetching, _lastModified, _lastModifiedOrig, _listeners, _log, _maxCompleteFails, _notModified, _numRetries, _out, _outputFile, _outputStream, _proxy, _proxyHost, _proxyIn, _proxyOut, _proxyPort, _redirectLocation, _redirects, _referrerPolicy, _responseCode, _responseText, _retryDelayMs, _server, _shouldProxy, _shouldWriteErrorToOutput, _status, _transferEncoding, _transferFailed, _url, _vary, _xContentTypeOptions, _xframeOptions, _xPoweredBy, _xssProtection, DEFAULT_CONNECT_TIMEOUT, DEFAULT_INACTIVITY_TIMEOUT, DEFAULT_MAX_COMPLETE_FAILS, DEFAULT_NUM_RETRIES, DEFAULT_RETRY_DELAY, DEFAULT_RETRY_JITTER, GZIP_PARTIAL_MARKER_SUFFIX, PROP_CONNECT_TIMEOUT, PROP_DEFAULT_RETRIES, PROP_INACTIVITY_TIMEOUT, PROP_MAX_COMPLETE_FAILS, PROP_RETRY_DELAY, USER_AGENT
Modifier and Type
Field
Description
protected boolean
_aborted
Whether the fetch was aborted due to timeout or user request.
protected String
_acceptRanges
Accept-Ranges header value from the response.
protected String
_actualURL
The URL we actually fetch from (may differ from _url in case of redirect).
protected long
_alreadyTransferred
Total bytes transferred across all attempts, including resumed content.
protected EepGet.AuthState
_authState
Authentication state for proxy digest/basic auth; created via EepGet.addAuthorization(String, String).
protected long
_bytesRemaining
Remaining bytes on the current attempt, -1 if unknown (chunked or no Content-Length).
protected long
_bytesTransferred
Body bytes transferred in the current EepGet.fetch(), summed across attempts.
protected String
_cacheControl
Cache-Control header value from the response.
protected String
_contentEncoding
Content-Encoding header value from the response.
protected String
_contentLanguage
Content-Language header value from the response.
protected String
_contentRange
Content-Range header value from the response, for validating 206/416 resumes.
protected String
_contentType
Content-Type header value from the response.
protected final I2PAppContext
_context
I2P application context for configuration, logging, and random number generation.
protected String
_cookie
Set-Cookie header value from the response.
protected String
_csp
Content-Security-Policy header value from the response.
protected int
_currentAttempt
Zero-based attempt counter for the current fetch; read by the watchdog command.
protected IOException
_decompressException
IOException from the background decompressor thread, if any.
protected boolean
_encodingChunked
Whether the response is using chunked transfer encoding.
protected String
_etag
ETag received from the server (for conditional requests).
protected final String
_etagOrig
Original ETag passed in constructor, preserved across redirects.
protected String
_expiryDate
Expires header value from the response.
protected List<String>
_extraHeaders
Additional HTTP headers to include in the request.
protected int
_fetchHeaderTimeout
Timeout in ms for receiving the HTTP response headers.
protected int
_fetchInactivityTimeout
Inactivity timeout in ms between data packets.
protected int
_fetchTotalTimeout
Total timeout in ms for the entire fetch operation.
protected boolean
_isGzippedResponse
Whether the response body is gzip-compressed.
protected boolean
_keepFetching
Whether to continue fetching; set false to abort.
protected String
_lastModified
Last-Modified header received from the server.
protected final String
_lastModifiedOrig
Original Last-Modified passed in constructor, preserved across redirects.
protected final List<EepGet.StatusListener>
_listeners
Registered status listeners for progress callbacks.
protected final Log
_log
Logger for this instance.
protected int
_maxCompleteFails
Maximum number of complete (zero-byte) failures before giving up.
protected boolean
_notModified
Whether the server returned 304 Not Modified.
protected final int
_numRetries
Maximum number of retry attempts per fetch.
protected OutputStream
_out
Output stream for writing fetched data (file or pipe).
protected final String
_outputFile
Path to the output file for saving the fetched content.
protected final OutputStream
_outputStream
Output stream destination, overrides outputFile when non-null.
protected Socket
_proxy
The socket connection to the proxy or the target server (if not proxied).
protected final String
_proxyHost
Proxy hostname or IP address.
protected InputStream
_proxyIn
Input stream from the proxy/server socket.
protected OutputStream
_proxyOut
Output stream to the proxy/server socket.
protected final int
_proxyPort
Proxy port number.
protected String
_redirectLocation
Location header value from redirect or 407 proxy auth response.
protected AtomicInteger
_redirects
Counter tracking the number of HTTP redirects followed.
protected String
_referrerPolicy
Referrer-Policy header value from the response.
protected int
_responseCode
HTTP response status code, -1 if no response received.
protected String
_responseText
HTTP response status text (e.g.
protected final long
_retryDelayMs
Fixed retry delay in ms, -1 selects the jittered default @since 0.9.71+.
protected String
_server
Server header value from the response.
protected final boolean
_shouldProxy
Whether to route requests through an HTTP proxy.
protected boolean
_shouldWriteErrorToOutput
Whether to write error response bodies to the output.
protected String
_status
Status header value from the response.
protected String
_transferEncoding
Transfer-Encoding header value from the response.
protected boolean
_transferFailed
Whether the current transfer attempt failed (non-2xx response code).
protected final String
_url
The URL we were asked to fetch.
protected String
_vary
Vary header value from the response.
protected String
_xContentTypeOptions
X-Content-Type-Options header value from the response.
protected String
_xframeOptions
X-Frame-Options header value from the response.
protected String
_xPoweredBy
X-Powered-By header value from the response.
protected String
_xssProtection
X-XSS-Protection header value from the response.
protected static final int
DEFAULT_CONNECT_TIMEOUT
Default connect timeout in milliseconds (90 seconds).
protected static final int
DEFAULT_INACTIVITY_TIMEOUT
Default inactivity timeout in milliseconds (5 minutes).
protected static final int
DEFAULT_MAX_COMPLETE_FAILS
Maximum times to try without getting any data at all, even if numRetries is higher @since 0.7.14.
protected static final int
DEFAULT_NUM_RETRIES
Default number of retry attempts.
protected static final int
DEFAULT_RETRY_DELAY
Base retry delay in milliseconds when the jittered default is used @since 0.9.71+.
protected static final int
DEFAULT_RETRY_JITTER
Maximum additional jitter in milliseconds added to the base retry delay @since 0.9.71+.
(package private) static final String
GZIP_PARTIAL_MARKER_SUFFIX
Suffix of the sidecar marker file recording that the output file holds transparently-decompressed (gunzipped) bytes rather than raw response bytes, so its length must not be used as a Range resume offset.
(package private) static final String
PROP_CONNECT_TIMEOUT
Property name for connect timeout configuration.
(package private) static final String
PROP_DEFAULT_RETRIES
Property name for default retries configuration.
(package private) static final String
PROP_INACTIVITY_TIMEOUT
Property name for inactivity timeout configuration.
(package private) static final String
PROP_MAX_COMPLETE_FAILS
Property name for max complete fails configuration.
(package private) static final String
PROP_RETRY_DELAY
Property name for the fixed retry delay in milliseconds.
protected static final String
USER_AGENT
Default User-Agent header value.
Constructor Summary
Constructors
Constructor
Description
EepPost(I2PAppContext ctx, String proxyHost, int proxyPort, int numRetries, String outputFile, String url)
Constructor for a POST session.
Method Summary
Modifier and Type
Method
Description
boolean
fetch()
Not supported, use post() instead.
boolean
fetch(long fetchHeaderTimeout)
Not supported, use post() instead.
boolean
fetch(long fetchHeaderTimeout, long totalTimeout, long inactivityTimeout)
Not supported, use post() instead.
private String
getSeparator()
Adapted from old jrandom EepPost.
static void
main(String[] args)
Command-line entry point for EepPost.
boolean
post(String contentType, byte[] data, long headerTimeout, long totalTimeout, long inactivityTimeout)
In-memory, not for large POSTs.
boolean
post(String contentType, File data, long headerTimeout, long totalTimeout, long inactivityTimeout)
For large POSTs.
boolean
post(String contentType, String data, long headerTimeout, long totalTimeout, long inactivityTimeout)
In-memory, not for large POSTs.
boolean
post(Map<String,Object> fields, long headerTimeout, long totalTimeout, long inactivityTimeout)
Submit an HTTP POST to the given URL (using the proxy if specified), uploading the given fields.
private static void
sendField(OutputStream out, String separator, String field, String val)
Multipart Adapted from old jrandom EepPost.
private static void
sendField(StringBuilder out, String field, String val)
Adapted from old jrandom EepPost.
private static void
sendFields(OutputStream out, String separator, Map<String,Object> fields)
Multipart Adapted from old jrandom EepPost.
private static void
sendFields(StringBuilder out, Map<String,Object> fields)
Adapted from old jrandom EepPost.
private static void
sendFile(OutputStream out, String separator, String field, File file)
Multipart Adapted from old jrandom EepPost.
(package private) static String
usage()
Usage text for the command-line entry point.
Methods inherited from class EepGet
addAuthorization, addHeader, addStatusListener, doFetch, failureReason, fatalAbort, getAcceptRanges, getCacheControl, getContentEncoding, getContentLanguage, getContentType, getCookie, getCSP, getEtag, getExpiryDate, getLastModified, getNotModified, getReferrerPolicy, getRequest, getResumeOffset, getServer, getStatus, getStatusCode, getStatusText, getTransferEncoding, getVary, getXContentTypeOptions, getXframeOptions, getXPoweredBy, getXSSProtection, gzipMarkerExists, isStalledButProgressing, isTotalBudgetExhausted, markGzipPartial, parseAuthArgs, parseChunkLength, parseContentRange, readChunkLength, readHeaders, redactedUrl, requestedRangeStart, seconds, sendRequest, setPostData, setPostData, setPostData, setWriteErrorToOutput, shouldReadBody, stopFetching, suggestName, usageText, validateResumeResponse
Modifier and Type
Method
Description
void
addAuthorization(String userName, String password)
Add basic authorization header for the proxy.
void
addHeader(String name, String value)
Add an extra header to the request.
void
addStatusListener(EepGet.StatusListener lsnr)
Add a status listener.
protected void
doFetch(SocketTimeout timeout)
Read response body for a single fetch.
(package private) static String
failureReason(Throwable t, long inactivityMs)
The failure reason for a transfer-failed log line.
(package private) static boolean
fatalAbort(boolean aborted, boolean strictSize, long remaining, boolean sawEof)
Decide whether a watchdog abort observed after the body loop must fail the attempt.
String
getAcceptRanges()
Show the Accept-Ranges field.
String
getCacheControl()
Show the Cache-Control field.
String
getContentEncoding()
Show the Content-Encoding field.
String
getContentLanguage()
Show the Content-Language field.
String
getContentType()
After fetch, the received value from the server, or null if none.
String
getCookie()
Show the Set-Cookie field.
String
getCSP()
Content-Security-Policy header.
String
getEtag()
After fetch, the received value from the server, or null if none.
String
getExpiryDate()
Show the Expires field.
String
getLastModified()
After fetch, the received value from the server, or null if none.
boolean
getNotModified()
Whether the server returned 304.
String
getReferrerPolicy()
Referrer-Policy header.
protected String
getRequest()
Build the HTTP request string for the current URL and state.
protected long
getResumeOffset(File outFile)
Byte offset to resume from for a file-based fetch, accounting for the persisted gunzip state: a marker means the file holds decompressed bytes, whose length is not a valid offset into the compressed representation, so the fetch restarts instead of resuming.
String
getServer()
Show the Server field.
String
getStatus()
Combined server status message e.g.
int
getStatusCode()
The server response (200, etc).
String
getStatusText()
The server text ("OK", "Not Found", etc).
String
getTransferEncoding()
Show the Transfer-Encoding field.
String
getVary()
Vary header.
String
getXContentTypeOptions()
X-Content-Type-Options header.
String
getXframeOptions()
X-Frame-Options header.
String
getXPoweredBy()
X-Powered-By header.
String
getXSSProtection()
X-XSS-Protection header.
(package private) boolean
gzipMarkerExists()
Whether this fetch's output file was written by the transparent gunzipper, so its length is a decompressed size that must not be used as a Range resume offset.
(package private) static boolean
isStalledButProgressing(IOException ioe, boolean aborted, long attemptStartBytes, long bytesTransferred)
Whether a failed attempt was a data-phase stall on an otherwise working path: the read timed out or our SocketTimeout watchdog aborted the transfer (which closes the socket first, surfacing as a raw SocketException, so the explicit aborted signal.
(package private) static boolean
isTotalBudgetExhausted(long totalTimeoutMs, long attemptStartMs, long nowMs)
Whether an attempt has already consumed its total-timeout budget.
(package private) void
markGzipPartial(File outFile)
Record that the output file now holds decompressed bytes.
static Map<String,String>
parseAuthArgs(String args)
Parse the args in an authentication header.
(package private) static long
parseChunkLength(String line)
Extract the chunk size from a chunk-size line, dropping any chunk extensions.
(package private) static EepGet.ContentRange
parseContentRange(String val)
Parse a Content-Range header value.
protected long
readChunkLength()
Parse a chunk length from the HTTP response stream.
protected void
readHeaders()
Read and parse HTTP response headers.
(package private) static String
redactedUrl(String url)
The request URL for log output.
(package private) static long
requestedRangeStart(long alreadyTransferred, List<String> extraHeaders)
Determine the start offset this fetch requested, so a 206's Content-Range can be validated against what was actually asked for.
(package private) static String
seconds(long ms)
Render a millisecond duration in seconds for log output, keeping milliseconds only for sub-second or non-whole-second values.
protected void
sendRequest(SocketTimeout timeout)
Open connection and send HTTP request.
protected void
setPostData(String contentType, byte[] data)
Set post data (binary body).
protected void
setPostData(String contentType, File data)
Set post data (file body).
protected void
setPostData(String contentType, String data)
Set post data (string body).
void
setWriteErrorToOutput()
If called (before calling fetch()), data from the server or proxy will be written to the output file or stream even on an error response code (4xx, 5xx, etc).
protected boolean
shouldReadBody()
Whether to read the response body.
void
stopFetching()
Stop the fetch in progress.
static String
suggestName(String url)
Parse URL for a viable filename.
(package private) static String
usageText()
The command-line help text, listing every option accepted by EepGet.main(String[]).
(package private) boolean
validateResumeResponse()
Validate a resume-sensitive response once all headers are parsed.
Methods inherited from class Object
clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details
- CRLF
  private static final String CRLF
  Line ending in an HTTP header.
  See Also:
  Constant Field Values
- CRLFB
  private static final byte[] CRLFB
  The header line ending, as bytes.
- PROP_MAX_POST_PAYLOAD_RAM
  private static final int PROP_MAX_POST_PAYLOAD_RAM
  Most of a POST body kept in memory, in bytes.
  See Also:
  Constant Field Values
Constructor Details
- EepPost
  public EepPost(I2PAppContext ctx, String proxyHost, int proxyPort, int numRetries, String outputFile, String url)
  Constructor for a POST session. The post body is supplied later by one of the post(Map, long, long, long) methods; fetch() is not supported.
  Parameters:
  ctx - the app context
  proxyHost - the proxy hostname, empty for no proxy
  proxyPort - the proxy port, 0 for no proxy
  numRetries - number of retries
  outputFile - file to save the response to
  url - URL to post to
Method Details
- post
  public boolean post(Map<String,Object> fields, long headerTimeout, long totalTimeout, long inactivityTimeout)
  Submit an HTTP POST to the given URL (using the proxy if specified), uploading the given fields. If the field's value is a File object, then that file is uploaded, and if the field's value is a String object, the value is posted for that particular field. Multiple values for one field name is not currently supported.
  Large files will be copied to a temp file. For large String content, consider the post(File) method.
  Note: param field values must be String or File.
  Parameters:
  fields - the field names and values to submit, each value a String or a File
  headerTimeout - milliseconds to wait for the response headers of each attempt, <= 0 for none
  totalTimeout - milliseconds for the whole post including retries, <= 0 for none
  inactivityTimeout - milliseconds to wait between body bytes, <= 0 for the default
  Returns:
  true if the post succeeded
- post
  public boolean post(String contentType, String data, long headerTimeout, long totalTimeout, long inactivityTimeout)
  In-memory, not for large POSTs.
  Parameters:
  contentType - the value for the Content-Type header
  data - the post body, must not be empty
  headerTimeout - milliseconds to wait for the response headers of each attempt, <= 0 for none
  totalTimeout - milliseconds for the whole post including retries, <= 0 for none
  inactivityTimeout - milliseconds to wait between body bytes, <= 0 for the default
  Returns:
  true if the post succeeded
- post
  public boolean post(String contentType, byte[] data, long headerTimeout, long totalTimeout, long inactivityTimeout)
  In-memory, not for large POSTs.
  Parameters:
  contentType - the value for the Content-Type header
  data - the post body, must not be empty
  headerTimeout - milliseconds to wait for the response headers of each attempt, <= 0 for none
  totalTimeout - milliseconds for the whole post including retries, <= 0 for none
  inactivityTimeout - milliseconds to wait between body bytes, <= 0 for the default
  Returns:
  true if the post succeeded
- post
  public boolean post(String contentType, File data, long headerTimeout, long totalTimeout, long inactivityTimeout)
  For large POSTs.
  Parameters:
  contentType - the value for the Content-Type header
  data - the post body, must be a regular file and not empty
  headerTimeout - milliseconds to wait for the response headers of each attempt, <= 0 for none
  totalTimeout - milliseconds for the whole post including retries, <= 0 for none
  inactivityTimeout - milliseconds to wait between body bytes, <= 0 for the default
  Returns:
  true if the post succeeded
- fetch
  public boolean fetch()
  Not supported, use post() instead.
  Overrides:
  fetch in class EepGet
  Returns:
  whether the URL was retrieved; false if every attempt failed
  Throws:
  UnsupportedOperationException - always; this class posts only
- fetch
  public boolean fetch(long fetchHeaderTimeout)
  Not supported, use post() instead.
  Overrides:
  fetch in class EepGet
  Parameters:
  fetchHeaderTimeout - timeout in ms
  Returns:
  whether the URL was retrieved; false if every attempt failed
  Throws:
  UnsupportedOperationException - always; this class posts only
- fetch
  public boolean fetch(long fetchHeaderTimeout, long totalTimeout, long inactivityTimeout)
  Not supported, use post() instead.
  Overrides:
  fetch in class EepGet
  Parameters:
  fetchHeaderTimeout - <= 0 for none (proxy will timeout if none, none isn't recommended if no proxy) forced to totalTimeout if totalTimeout is set and this is <= 0
  totalTimeout - operation-wide deadline for the whole fetch, including retries and backoff between attempts; <= 0 for default none
  inactivityTimeout - <= 0 for default EepGet.DEFAULT_INACTIVITY_TIMEOUT (5 minutes)
  Returns:
  whether the URL was retrieved; false if every attempt failed
  Throws:
  UnsupportedOperationException - always; this class posts only
- sendFields
  private static void sendFields(StringBuilder out, Map<String,Object> fields)
  Adapted from old jrandom EepPost.
  Parameters:
  out - the StringBuilder the urlencoded body is appended to
  fields - field names mapped to values, stringified with toString()
- sendFields
  private static void sendFields(OutputStream out, String separator, Map<String,Object> fields) throws IOException
  Multipart Adapted from old jrandom EepPost.
  Parameters:
  out - the stream the multipart body is written to
  separator - non-null
  fields - field names mapped to values, File values sent as file parts
  Throws:
  IOException - if writing fails or a File value cannot be read
- sendField
  private static void sendField(StringBuilder out, String field, String val)
  Adapted from old jrandom EepPost.
  Parameters:
  out - the StringBuilder the name=value pair is appended to
  field - the field name, spaces replaced with '+'
  val - the field value, spaces replaced with '+' as well
- sendField
  private static void sendField(OutputStream out, String separator, String field, String val) throws IOException
  Multipart Adapted from old jrandom EepPost.
  Parameters:
  out - the stream the part is written to
  separator - non-null
  field - the field name, written into the content disposition
  val - the field value, written as the part body
  Throws:
  IOException - if writing to the stream fails
- sendFile
  private static void sendFile(OutputStream out, String separator, String field, File file) throws IOException
  Multipart Adapted from old jrandom EepPost.
  Parameters:
  out - the stream the part is written to
  separator - non-null
  field - the field name, written into the content disposition
  file - the file to upload, sent as application/octet-stream
  Throws:
  IOException - if the file cannot be read or writing fails
- getSeparator
  private String getSeparator()
  Adapted from old jrandom EepPost.
  Returns:
  a fresh random multipart boundary, base32 encoded
- main
  public static void main(String[] args)
  Command-line entry point for EepPost. See usage() for the full option list.
  Usage: eeppost [-p 127.0.0.1:4444 | -c] [-n #retries] [-o outputFile] [-s key=value] | [-f key=file] url
  At least one -s (string field) or -f (file field) is required. All timeouts are in seconds: -t is the inactivity timeout, -v the header timeout, and -w the total timeout, which is unlimited by default.
  Parameters:
  args - the options and URL as described by usage()
- usage
  static String usage()
  Usage text for the command-line entry point. Every option accepted by main(String[]) must appear here, with the defaults main() actually uses.
  Returns:
  the help text

Nested Class Summary

Nested classes/interfaces inherited from class EepGet

Field Summary

Fields inherited from class EepGet

Constructor Summary

Method Summary

Methods inherited from class EepGet

Methods inherited from class Object

Field Details

CRLF

CRLFB

PROP_MAX_POST_PAYLOAD_RAM

Constructor Details

Method Details

post

post

post

post

fetch

fetch

fetch

sendFields

sendFields

sendField

sendField

sendFile

getSeparator

main

usage