org.apache.nutch.indexer
Class DeleteDuplicates.UrlsReducer
java.lang.Object
org.apache.nutch.indexer.DeleteDuplicates.UrlsReducer
- All Implemented Interfaces:
- Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc,org.apache.hadoop.io.MD5Hash,DeleteDuplicates.IndexDoc>
- Enclosing class:
- DeleteDuplicates
public static class DeleteDuplicates.UrlsReducer
- extends Object
- implements org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc,org.apache.hadoop.io.MD5Hash,DeleteDuplicates.IndexDoc>
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
DeleteDuplicates.UrlsReducer
public DeleteDuplicates.UrlsReducer()
configure
public void configure(org.apache.hadoop.mapred.JobConf job)
- Specified by:
configure
in interface org.apache.hadoop.mapred.JobConfigurable
close
public void close()
- Specified by:
close
in interface Closeable
reduce
public void reduce(org.apache.hadoop.io.Text key,
Iterator<DeleteDuplicates.IndexDoc> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.MD5Hash,DeleteDuplicates.IndexDoc> output,
org.apache.hadoop.mapred.Reporter reporter)
throws IOException
- Specified by:
reduce
in interface org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.Text,DeleteDuplicates.IndexDoc,org.apache.hadoop.io.MD5Hash,DeleteDuplicates.IndexDoc>
- Throws:
IOException
Copyright © 2006 The Apache Software Foundation