parsing - Why does Nutch think it has already parsed all segments when it hasn't? -

-

I am using the Nutch 1.6 to crawl a few forums and lists them with Solr 1.6.2 I am I ran a test question on Solar and was surprised that there were only a few results, I was worried that there was either a problem that was with parsing of pages of nach or indexing of solar. After around snooping I discovered that Nutch pages it has parsed a lot has been taken: 

  bin / Nutch readseg -List -dir crawl mothering2 / Regions / Names Generated Paras 20130228001531 23 27 9 20130228003940 1430 1434 661 20130228001829 202 206 105 20130228061337 1068 1090 475 20130228091009 1 2 20130228085956 34 34 25 20130228090348 44 45 34 20130228090851 7 7 6 20130228080438 364 374 192 20130228030933 1774 1795 903 20130228084205 168 169 63 168 169 63   
 But when I try to parse the fields, I get this:  
  bin / nutch cross Crawl-mothering2 / regions / * ParseSegment: Starting 2013-03-21 00:20: 43 parasaggements: Segment: Crawl-Miting 2 / Segment / 20130228001531 "Exception" main in the thread "java.io.IOException: Segment first the parsed! org.apache on org.apache.nutch.parse.ParseOutputFormat.checkOutputSpecs (ParseOutputFormat.java:89) (JobClient.java:889) on org.apache.hadoop.mapred.JobClient $ 2.run. hadoop.mapred.JobClient java.security.AccessController.doPrivileged (Native method at $ 2 .run (JobClient.java:850) javax.security.auth.Subject.doAs on org.apache.hadoop.security.UserGroupInformation.doAs) (UserGroupInformation.java1212) at org.apache.hadoop.mapred.jobClient.submitJobInternal (JobClient.java:85) 0) at org.apache.hadoop.mapred.JobClient.submitJob (JobClient.java:824) at org.apache. hadoop.mapred.JobClient.runJob (JobClient.java:1261) org.apache.nutch.parse.ParseSegment.parse (ParseSegment.java:209) on org.apache.nutch.parse.ParseSegment.run (on ParseSegment.java: 243) org.apache.hadoop.util.ToolRunner.run (ToolRunner.java:65) on org.apache.nutch.parse.ParseSegment.main (ParseSegment.java:216)   
 What gives?   
 
 
 Can not react to segments. To overcome this, you have to delete some folders. Please check the mailing list discussion.  
 You will get a quick response to   .

Comments

Post a Comment

Popular posts from this blog

excel vba - How to delete Solver(SOLVER.XLAM) code -

-
After opening several examples of macro / code written, I suddenly get stuck with a code that seems safe. Solver (SOLVER.XLAM) is doing this notation and I would like to remove it from my system. I do not think this is a relativant code. Can anyone tell me what should I do? I have already installed something to remove the password but Solver is still asking for password and I can not get rid of it! itemprop = "text"> Solver Excel is add-in If you want to delete it, then Excel Application & gt; Options & gt; Add-ins & gt; Search for 'Go to' button and gt; Uncheck the solver on the list like press something (I can not give you the exact path because I have the Polish version of Excel). Trying to open Solver's VBA code is not good because it There is allegedly copyright. Besides, I do not think Solver creates any disadvantages while working with Excel or VBA.
Read more

github - Teamcity & Git - PR merge builds - anyway to get HEAD commit hash? -

-
I have a team city build project with Gitbab VCS route, I have been triggered for both / head on PR and / Merge the referee. The annoying thing is that you can not do anything useful with the merged hash - it is not present in Gitobb. I want to exclude newsgate packages with head in gutub comet situations in the version number along with Hewash (Newsaging 7) for the music build, but against head hash. However, I can not see a way to get the head hashes while constructing that merge. I just want to head because it's useless - we only care about merge. (PR - Pull Request) This command works reliably while running One on / merge is git log --no-merge -1 ---- = '% h'
Read more

ios - Replace text in UITextView run slowly -

-
I have a UITextView and I change a word like the code at the end of UITextView.text: - (void) Replace TexttechWitWord: (NSString *) word {NSString * currentTextViewText = self.textView.text; CurrentTextViewText = [currentTextViewText stringByReplacingCharactersInRange: NSMakeRange ([self.textView.text length] - [word length], [word length]) withString: word; Self.textView.text = currentTextViewText; } Replacement work is fine, but it runs very slowly and very slowly when the textView now lengthens Is there any better way? I try the replacement range: with text for a week but still stuck. Not to know how to use it to replace it in your case. Please guide! Thanks in advance! This is an important job. As you are using an irreversible string and you are creating a very long string and before Assigned to NSString created from. NSString will be used instead of NSMutableString . - (UITableViewCell *) TableView: (UITableView *) Table View CellForOutPath: (NSIndex...
Read more