Class WARCRecordWriter

java.lang.Object

org.archive.format.warc.WARCRecordWriter

All Implemented Interfaces:

ArchiveFileConstants, HttpConstants, WARCConstants

public class WARCRecordWriter
extends Object
implements WARCConstants, HttpConstants

Nested Class Summary

Nested classes/interfaces inherited from interface org.archive.format.warc.WARCConstants

WARCConstants.WARCRecordType

Field Summary

Fields inherited from interface org.archive.format.ArchiveFileConstants

ABSOLUTE_OFFSET_KEY, CDX, CDX_FILE, CDX_LINE_BUFFER_SIZE, CRLF, DATE_FIELD_KEY, DEFAULT_DIGEST_METHOD, DOT_COMPRESSED_FILE_EXTENSION, DUMP, GZIP_DUMP, HEADER, INVALID_SUFFIX, LENGTH_FIELD_KEY, MIMETYPE_FIELD_KEY, NOHEAD, OCCUPIED_SUFFIX, ORIGIN_FIELD_KEY, READER_IDENTIFIER_FIELD_KEY, RECORD_IDENTIFIER_FIELD_KEY, SINGLE_SPACE, TYPE_FIELD_KEY, URL_FIELD_KEY, VERSION_FIELD_KEY

Fields inherited from interface org.archive.format.http.HttpConstants

COLON, CR, CRLF, HTAB, LF, METHOD_CONNECT, METHOD_CONNECT_STRING, METHOD_DELETE, METHOD_DELETE_STRING, METHOD_GET, METHOD_GET_STRING, METHOD_HEAD, METHOD_HEAD_STRING, METHOD_POST, METHOD_POST_STRING, METHOD_PUT, METHOD_PUT_STRING, METHOD_TRACE, METHOD_TRACE_STRING, METHOD_UNK, METHOD_UNK_STRING, REASON_UNK, SP, STATUS_UNK, UTF8, VERSION_0, VERSION_0_STATUS, VERSION_1, VERSION_1_STATUS, VERSION_1_UNK, VERSION_9, VERSION_9_STATUS

Fields inherited from interface org.archive.format.warc.WARCConstants

COLON_SPACE, COMPRESSED_WARC_FILE_EXTENSION, CONTENT_DESCRIPTION, CONTENT_LENGTH, CONTENT_TYPE, DEFAULT_ENCODING, DEFAULT_MAX_WARC_FILE_SIZE, DOT_COMPRESSED_WARC_FILE_EXTENSION, DOT_WARC_FILE_EXTENSION, FTP_CONTROL_CONVERSATION_MIMETYPE, HEADER_FIELD_SEPARATOR, HEADER_KEY_BLOCK_DIGEST, HEADER_KEY_CONCURRENT_TO, HEADER_KEY_DATE, HEADER_KEY_ETAG, HEADER_KEY_FILENAME, HEADER_KEY_ID, HEADER_KEY_IP, HEADER_KEY_LAST_MODIFIED, HEADER_KEY_PAYLOAD_DIGEST, HEADER_KEY_PROFILE, HEADER_KEY_REFERS_TO, HEADER_KEY_REFERS_TO_DATE, HEADER_KEY_REFERS_TO_FILE_OFFSET, HEADER_KEY_REFERS_TO_FILENAME, HEADER_KEY_REFERS_TO_TARGET_URI, HEADER_KEY_TRUNCATED, HEADER_KEY_TYPE, HEADER_KEY_URI, HEADER_LINE_ENCODING, HTTP_REQUEST_MIMETYPE, HTTP_RESPONSE_MIMETYPE, HTTP_RESPONSE_MIMETYPE_NS, MAX_LINE_LENGTH, MAX_WARC_HEADER_LINE_LENGTH, NAMED_FIELD_CHECKSUM_LABEL, NAMED_FIELD_DESCRIPTION, NAMED_FIELD_FILEDESC, NAMED_FIELD_IP_LABEL, NAMED_FIELD_RELATED_LABEL, NAMED_FIELD_TRUNCATED, NAMED_FIELD_TRUNCATED_VALUE_HEAD, NAMED_FIELD_TRUNCATED_VALUE_LENGTH, NAMED_FIELD_TRUNCATED_VALUE_TIME, NAMED_FIELD_TRUNCATED_VALUE_UNSPECIFIED, NAMED_FIELD_WARCFILENAME, PLACEHOLDER_RECORD_LENGTH_STRING, PROFILE_REVISIT_IDENTICAL_DIGEST, PROFILE_REVISIT_NOT_MODIFIED, TRUNCATED_VALUE_UNSPECIFIED, TYPE, WARC_FIELDS_TYPE, WARC_FILE_EXTENSION, WARC_HEADER_ENCODING, WARC_ID, WARC_MAGIC, WARC_VERSION, WSP

Constructor Summary

Constructors

Constructor	Description
WARCRecordWriter()

Method Summary

Modifier and Type	Method	Description
void	writeJSONMetadataRecord(OutputStream out, byte[] contents, String targetURI, Date originalDate, String origRecordId)
void	writeWARCInfoRecord(OutputStream out, String filename, byte[] contents)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

WARCRecordWriter

public WARCRecordWriter()

Method Details

writeWARCInfoRecord

public void writeWARCInfoRecord(OutputStream out,
 String filename,
 byte[] contents)
                         throws IOException

Throws:

IOException

writeJSONMetadataRecord

public void writeJSONMetadataRecord(OutputStream out,
 byte[] contents,
 String targetURI,
 Date originalDate,
 String origRecordId)
                             throws IOException

Throws:

IOException