Serialized Form (BUbiNG 0.9.15)

Package it.unimi.di.law.bubing.frontier
- Class it.unimi.di.law.bubing.frontier.VisitState extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialization Methods
    - readObject
```
private void readObject(java.io.ObjectInputStream s)
                 throws java.io.IOException,
                        java.lang.ClassNotFoundException,
                        java.lang.NoSuchFieldException,
                        java.lang.SecurityException,
                        java.lang.IllegalArgumentException,
                        java.lang.IllegalAccessException
```
      Throws:
      
      java.io.IOException
      
      java.lang.ClassNotFoundException
      
      java.lang.NoSuchFieldException
      
      java.lang.SecurityException
      
      java.lang.IllegalArgumentException
      
      java.lang.IllegalAccessException
    - writeObject
```
private void writeObject(java.io.ObjectOutputStream s)
                  throws java.io.IOException
```
      Throws:
      
      java.io.IOException
  - Serialized Fields
    - cookies
```
org.apache.http.cookie.Cookie[] cookies
```
      The cookies of this visit state.
    - lastExceptionClass
```
java.lang.Class<? extends java.lang.Throwable> lastExceptionClass
```
      If not null, this fields contains the class of the exception that was thrown during the last attempt to access this scheme+authority. If this happens, it might be the case that VisitState.workbenchEntry is null.
    - lastRobotsFetch
```
long lastRobotsFetch
```
      System.currentTimeMillis() when we fetched the robots we are caching.
    - nextFetch
```
long nextFetch
```
      The minimum time at which this visit state can be accessed because of host-based politeness, zero at creation. If it is equal to Long.MAX_VALUE, the maximum number of URLs has been reached for this visit state.
    - retries
```
int retries
```
      If VisitState.lastExceptionClass is not null, the count of the retries for this type of exception.
    - robotsFilter
```
char[][] robotsFilter
```
      The robots-forbidden prefixes we are caching, as returned from the URLRespectsRobots.parseRobotsReader(Reader, String) method.
    - schemeAuthority
```
byte[] schemeAuthority
```
      The scheme and authority visited by this visit state.
    - spammicity
```
float spammicity
```
      The spammicity score, if computed; -1, otherwise.
    - termCount
```
Short2ShortOpenHashMap termCount
```
      A map from term indices to counts for the pages of this host. This map is instantiated only if RuntimeConfiguration.spamDetector is not null.
    - termCountUpdates
```
int termCountUpdates
```
      The number of calls performed to VisitState.updateTermCount(Short2ShortMap).
- Class it.unimi.di.law.bubing.frontier.VisitStateSet extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  0L
  - Serialization Methods
    - readObject
```
private void readObject(java.io.ObjectInputStream s)
                 throws java.io.IOException,
                        java.lang.ClassNotFoundException
```
      Throws:
      
      java.io.IOException
      
      java.lang.ClassNotFoundException
    - writeObject
```
private void writeObject(java.io.ObjectOutputStream s)
                  throws java.io.IOException
```
      Throws:
      
      java.io.IOException
  - Serialized Fields
    - maxFill
```
int maxFill
```
      The maximum number of entries that can be filled before rehashing.
    - size
```
int size
```
      Number of entries in the set.
- Class it.unimi.di.law.bubing.frontier.WorkbenchEntrySet extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  0L
  - Serialization Methods
    - readObject
```
private void readObject(java.io.ObjectInputStream s)
                 throws java.io.IOException,
                        java.lang.ClassNotFoundException
```
      Throws:
      
      java.io.IOException
      
      java.lang.ClassNotFoundException
    - writeObject
```
private void writeObject(java.io.ObjectOutputStream s)
                  throws java.io.IOException
```
      Throws:
      
      java.io.IOException
  - Serialized Fields
    - maxFill
```
int maxFill
```
      The maximum number of entries that can be filled before rehashing.
    - size
```
int size
```
      Number of entries in the set.
Package it.unimi.di.law.bubing.parser
- Class it.unimi.di.law.bubing.parser.SpamTextProcessor.TermCount extends Short2ShortOpenHashMap implements Serializable
  
  serialVersionUID:
  
  1L
Package it.unimi.di.law.bubing.spam
Package it.unimi.di.law.bubing.util
- Class it.unimi.di.law.bubing.util.BubingJob extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialized Fields
    - url
```
ByteArrayList url
```
      The BUbiNG URL that should be visited.
- Class it.unimi.di.law.bubing.util.ByteArrayDiskQueues.QueueData extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialized Fields
    - count
```
long count
```
      The number of elements in the list (always nonzero).
    - head
```
long head
```
      The pointer to the head of the list (the least recently enqueued, but not dequeued, element).
    - tail
```
long tail
```
      The pointer to the tail of the list (the most recently enqueued element).
    - usage
```
long usage
```
      The number of bytes used by the list.
- Class it.unimi.di.law.bubing.util.ConcurrentCountingMap extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialized Fields
    - lock
```
java.util.concurrent.locks.ReentrantReadWriteLock[] lock
```
      An array of locks parallel to ConcurrentCountingMap.stripe, protecting each stripe.
    - shift
```
int shift
```
      64 minus the base-2 logarithm of stripe.length, cached.
    - stripe
```
ConcurrentCountingMap.Stripe[] stripe
```
      The stripes. Keys are distributed among them using the lower bits of their Object.hashCode().
- Class it.unimi.di.law.bubing.util.ConcurrentCountingMap.Stripe extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  0L
  - Serialization Methods
    - readObject
```
private void readObject(java.io.ObjectInputStream s)
                 throws java.io.IOException,
                        java.lang.ClassNotFoundException
```
      Throws:
      
      java.io.IOException
      
      java.lang.ClassNotFoundException
    - writeObject
```
private void writeObject(java.io.ObjectOutputStream s)
                  throws java.io.IOException
```
      Throws:
      
      java.io.IOException
  - Serialized Fields
    - maxFill
```
int maxFill
```
      Threshold after which we rehash.
    - n
```
int n
```
      The current table size.
    - size
```
int size
```
      Number of entries in the stripe.
- Class it.unimi.di.law.bubing.util.TooSlowException extends java.io.IOException implements Serializable
  
  serialVersionUID:
  
  1L
Package it.unimi.di.law.warc.filters.parser
- Class it.unimi.di.law.warc.filters.parser.ParseException extends java.lang.Exception implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialized Fields
    - currentToken
```
Token currentToken
```
      This is the last token that has been consumed successfully. If this object has been created due to a parse error, the token followng this token will (therefore) be the first error token.
    - expectedTokenSequences
```
int[][] expectedTokenSequences
```
      Each entry in this array is an array of integers. Each array of integers represents a sequence of tokens (by their ordinal values) that is expected at this point of the parse.
    - tokenImage
```
java.lang.String[] tokenImage
```
      This is a reference to the "tokenImage" array of the generated parser within which the parse error occurred. This array is defined in the generated ...Constants interface.
- Class it.unimi.di.law.warc.filters.parser.Token extends java.lang.Object implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialized Fields
    - beginColumn
```
int beginColumn
```
      The column number of the first character of this Token.
    - beginLine
```
int beginLine
```
      The line number of the first character of this Token.
    - endColumn
```
int endColumn
```
      The column number of the last character of this Token.
    - endLine
```
int endLine
```
      The line number of the last character of this Token.
    - image
```
java.lang.String image
```
      The string image of the token.
    - kind
```
int kind
```
      An integer that describes the kind of this token. This numbering system is determined by JavaCCParser, and a table of these numbers is stored in the file ...Constants.java.
    - next
```
Token next
```
      A reference to the next regular (non-special) token from the input stream. If this is the last token from the input stream, or if the token manager has not read tokens beyond this one, this field is set to null. This is true only if this token is also a regular token. Otherwise, see below for a description of the contents of this field.
    - specialToken
```
Token specialToken
```
      This field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token. If there are no such special tokens, this field is set to null. When there are more than one such special token, this field refers to the last of these special tokens, which in turn refers to the next previous special token through its specialToken field, and so on until the first special token (whose specialToken field is null). The next fields of special tokens refer to other special tokens that immediately follow it (without an intervening regular token). If there is no such token, this field is null.
- Class it.unimi.di.law.warc.filters.parser.TokenMgrError extends java.lang.Error implements Serializable
  
  serialVersionUID:
  
  1L
  - Serialized Fields
    - errorCode
```
int errorCode
```
      Indicates the reason why the exception is thrown. It will have one of the above 4 values.
Package it.unimi.di.law.warc.io
- Class it.unimi.di.law.warc.io.WarcFormatException extends java.io.IOException implements Serializable
Package it.unimi.di.law.warc.io.gzarc
- Class it.unimi.di.law.warc.io.gzarc.GZIPArchive.FormatException extends java.io.IOException implements Serializable
Package it.unimi.di.law.warc.records
- Class it.unimi.di.law.warc.records.WarcHeader extends org.apache.http.message.BasicHeader implements Serializable

Serialized Form

Package it.unimi.di.law.bubing.frontier

Class it.unimi.di.law.bubing.frontier.VisitState extends java.lang.Object implements Serializable

Serialization Methods

readObject

writeObject

Serialized Fields

cookies

lastExceptionClass

lastRobotsFetch

nextFetch

retries

robotsFilter

schemeAuthority

spammicity

termCount

termCountUpdates

Class it.unimi.di.law.bubing.frontier.VisitStateSet extends java.lang.Object implements Serializable

Serialization Methods

readObject

writeObject

Serialized Fields

maxFill

size

Class it.unimi.di.law.bubing.frontier.WorkbenchEntrySet extends java.lang.Object implements Serializable

Serialization Methods

readObject

writeObject

Serialized Fields

maxFill

size

Package it.unimi.di.law.bubing.parser

Class it.unimi.di.law.bubing.parser.SpamTextProcessor.TermCount extends Short2ShortOpenHashMap implements Serializable

Package it.unimi.di.law.bubing.spam

Package it.unimi.di.law.bubing.util

Class it.unimi.di.law.bubing.util.BubingJob extends java.lang.Object implements Serializable

Serialized Fields

url

Class it.unimi.di.law.bubing.util.ByteArrayDiskQueues.QueueData extends java.lang.Object implements Serializable

Serialized Fields

count

head

tail

usage

Class it.unimi.di.law.bubing.util.ConcurrentCountingMap extends java.lang.Object implements Serializable

Serialized Fields

lock

shift

stripe

Class it.unimi.di.law.bubing.util.ConcurrentCountingMap.Stripe extends java.lang.Object implements Serializable

Serialization Methods

readObject

writeObject

Serialized Fields

maxFill

n

size

Class it.unimi.di.law.bubing.util.TooSlowException extends java.io.IOException implements Serializable

Package it.unimi.di.law.warc.filters.parser

Class it.unimi.di.law.warc.filters.parser.ParseException extends java.lang.Exception implements Serializable

Serialized Fields

currentToken

expectedTokenSequences

tokenImage

Class it.unimi.di.law.warc.filters.parser.Token extends java.lang.Object implements Serializable

Serialized Fields

beginColumn

beginLine

endColumn

endLine

image

kind

next

specialToken

Class it.unimi.di.law.warc.filters.parser.TokenMgrError extends java.lang.Error implements Serializable

Serialized Fields

errorCode

Package it.unimi.di.law.warc.io

Class it.unimi.di.law.warc.io.WarcFormatException extends java.io.IOException implements Serializable

Package it.unimi.di.law.warc.io.gzarc