org.archive.format.warc

Class WARCRecordWriter

java.lang.Object

org.archive.format.warc.WARCRecordWriter

All Implemented Interfaces:

ArchiveFileConstants, HttpConstants, WARCConstants

public class WARCRecordWriter
extends java.lang.Object
implements WARCConstants, HttpConstants

Nested Class Summary

Nested classes/interfaces inherited from interface org.archive.format.warc.WARCConstants

WARCConstants.WARCRecordType

Field Summary

Fields inherited from interface org.archive.format.warc.WARCConstants

COLON_SPACE, COMPRESSED_WARC_FILE_EXTENSION, CONTENT_DESCRIPTION, CONTENT_LENGTH, CONTENT_TYPE, DEFAULT_ENCODING, DEFAULT_MAX_WARC_FILE_SIZE, DOT_COMPRESSED_WARC_FILE_EXTENSION, DOT_WARC_FILE_EXTENSION, FTP_CONTROL_CONVERSATION_MIMETYPE, HEADER_FIELD_SEPARATOR, HEADER_KEY_BLOCK_DIGEST, HEADER_KEY_CONCURRENT_TO, HEADER_KEY_DATE, HEADER_KEY_ETAG, HEADER_KEY_FILENAME, HEADER_KEY_ID, HEADER_KEY_IP, HEADER_KEY_LAST_MODIFIED, HEADER_KEY_PAYLOAD_DIGEST, HEADER_KEY_PROFILE, HEADER_KEY_REFERS_TO, HEADER_KEY_REFERS_TO_DATE, HEADER_KEY_REFERS_TO_FILE_OFFSET, HEADER_KEY_REFERS_TO_FILENAME, HEADER_KEY_REFERS_TO_TARGET_URI, HEADER_KEY_TRUNCATED, HEADER_KEY_TYPE, HEADER_KEY_URI, HEADER_LINE_ENCODING, HTTP_REQUEST_MIMETYPE, HTTP_RESPONSE_MIMETYPE, HTTP_RESPONSE_MIMETYPE_NS, MAX_LINE_LENGTH, MAX_WARC_HEADER_LINE_LENGTH, NAMED_FIELD_CHECKSUM_LABEL, NAMED_FIELD_DESCRIPTION, NAMED_FIELD_FILEDESC, NAMED_FIELD_IP_LABEL, NAMED_FIELD_RELATED_LABEL, NAMED_FIELD_TRUNCATED, NAMED_FIELD_TRUNCATED_VALUE_HEAD, NAMED_FIELD_TRUNCATED_VALUE_LENGTH, NAMED_FIELD_TRUNCATED_VALUE_TIME, NAMED_FIELD_TRUNCATED_VALUE_UNSPECIFIED, NAMED_FIELD_WARCFILENAME, PLACEHOLDER_RECORD_LENGTH_STRING, PROFILE_REVISIT_IDENTICAL_DIGEST, PROFILE_REVISIT_NOT_MODIFIED, TRUNCATED_VALUE_UNSPECIFIED, TYPE, WARC_FIELDS_TYPE, WARC_FILE_EXTENSION, WARC_HEADER_ENCODING, WARC_ID, WARC_MAGIC, WARC_VERSION, WSP

Fields inherited from interface org.archive.format.ArchiveFileConstants

ABSOLUTE_OFFSET_KEY, CDX, CDX_FILE, CDX_LINE_BUFFER_SIZE, CRLF, DATE_FIELD_KEY, DEFAULT_DIGEST_METHOD, DOT_COMPRESSED_FILE_EXTENSION, DUMP, GZIP_DUMP, HEADER, INVALID_SUFFIX, LENGTH_FIELD_KEY, MIMETYPE_FIELD_KEY, NOHEAD, OCCUPIED_SUFFIX, ORIGIN_FIELD_KEY, READER_IDENTIFIER_FIELD_KEY, RECORD_IDENTIFIER_FIELD_KEY, SINGLE_SPACE, TYPE_FIELD_KEY, URL_FIELD_KEY, VERSION_FIELD_KEY

Fields inherited from interface org.archive.format.http.HttpConstants

COLON, CR, CRLF, HTAB, LF, METHOD_CONNECT, METHOD_CONNECT_STRING, METHOD_DELETE, METHOD_DELETE_STRING, METHOD_GET, METHOD_GET_STRING, METHOD_HEAD, METHOD_HEAD_STRING, METHOD_POST, METHOD_POST_STRING, METHOD_PUT, METHOD_PUT_STRING, METHOD_TRACE, METHOD_TRACE_STRING, METHOD_UNK, METHOD_UNK_STRING, REASON_UNK, SP, STATUS_UNK, UTF8, VERSION_0, VERSION_0_STATUS, VERSION_1, VERSION_1_STATUS, VERSION_1_UNK, VERSION_9, VERSION_9_STATUS

Constructor Summary

Constructors

Constructor and Description
WARCRecordWriter()

Method Summary

Modifier and Type	Method and Description
void	writeJSONMetadataRecord(java.io.OutputStream out, byte[] contents, java.lang.String targetURI, java.util.Date originalDate, java.lang.String origRecordId)
void	writeWARCInfoRecord(java.io.OutputStream out, java.lang.String filename, byte[] contents)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WARCRecordWriter

public WARCRecordWriter()

Method Detail

writeWARCInfoRecord

public void writeWARCInfoRecord(java.io.OutputStream out,
                                java.lang.String filename,
                                byte[] contents)
                         throws java.io.IOException

Throws:

java.io.IOException

writeJSONMetadataRecord

public void writeJSONMetadataRecord(java.io.OutputStream out,
                                    byte[] contents,
                                    java.lang.String targetURI,
                                    java.util.Date originalDate,
                                    java.lang.String origRecordId)
                             throws java.io.IOException

Throws:

java.io.IOException