hadoop - use SequenceFile class write file -

-

I use the follow code to write some data in the sequencefile format file. When the program runs a little longer, I was paused in the program via the red button on the eclipse console. However, when I check the data file on the HDFS, the sequence file size is zero. And also see the file 'can not use the hadoop fs -text filename' command. When I use the sequencefile. Reader has already read the file that I created, I complete the 'exception in the thread' main "java.io.EOFException" exception. In this case, how to do? My development environment on Eclipse 3.7 (on Windows 7) 

  Private string uri = "hdfs: //172.20.11.60: 9000"  
 ; Private string filePath = "/ user / thupp / input /"; personal string filename = "sequence -01.seq"; public index Author Author; Private Static Int Cnt = 0; Private Zero Init (try {config conf = new configuration}; {FileSystem fs = FileSystem.get (URI.create (uri), conf); Author = Sequence File Generator (FS, conf, new path (filespath + filename), longterative class, text class);} hold (IOException e) {// TODO auto-generated catch block e.printStackTrace ();}} public order } {Init ();} @ Override Public Wide Run () {While {true} {try {writer.append (new long (100), new text ("Hello, Wish Or ")); cnt ++; if (cnt% 100 == 0) {System.out.println (" flush the system to flush the existing file "); Writer.syncFs (); }} Grip (IOException E) {// TODO Auto-Generated Cache Block System.out.println ("Adding Data Error"); E.printStackTrace (); } Try {Thread.sleep (1000); } Grip (Interrupted E) E. {// TODO Auto-Generated Cache Block System.out.printLine ("Thread Interrupted"); E.printStackTrace (); }}}   
}  
 Public class TestSequenceFile {  * absolute args * / public static zero main String [] args) {// TODO auto-generated method stub new sequence (). Start (); }   
}   
 
 
 A general idea: process.  
 Solution: The following code was working fine for me.  
  import java.io.IOException; Import java.net.URI; Import org.apache.hadoop.conf.configuration; Import org.apache.hadoop.fs.FileSystem; Import org.apache.hadoop.fs.Path; Import org.apache.hadoop.io.IOUtils; Import org.apache.hadoop.io.IntWritable; Import org.apache.hadoop.io.SequenceFile; Import org.apache.hadoop.io.Text; Public square sequencefileWorld demo {Private Stable Last String [] Data = {"One, Two, Buckle My Shoes", "Three, Four, Closed Door", "Five, Six, Pick Sticks", "Seven, Eight, , "Nine, ten, a big fat hen"}; Public static zero main (string [] args throws IOException {// string uri = "/home/Desktop/inputSort.txt"; String uri = "hdfs: // localhost: 9900 / out1 .seq"; Configuration conf = new configuration (); File system fs = FileSystem.get (URI.create (uri), conf); Path path = new path (uri); IntWritable key = new intWritable (); Text value = new text (); Index file Author writer = null; {Author = sequencefile.creditor (fs, conf, path, keygateclass (), value .getClass ()); {Key.set (100 - i) for (int i = 0; i   
 For details of writing on the sequence file, please see Book Hadoop-The Definitive Guide (O'Reilly Publishing).

Comments

Post a Comment

Popular posts from this blog

excel vba - How to delete Solver(SOLVER.XLAM) code -

-
After opening several examples of macro / code written, I suddenly get stuck with a code that seems safe. Solver (SOLVER.XLAM) is doing this notation and I would like to remove it from my system. I do not think this is a relativant code. Can anyone tell me what should I do? I have already installed something to remove the password but Solver is still asking for password and I can not get rid of it! itemprop = "text"> Solver Excel is add-in If you want to delete it, then Excel Application & gt; Options & gt; Add-ins & gt; Search for 'Go to' button and gt; Uncheck the solver on the list like press something (I can not give you the exact path because I have the Polish version of Excel). Trying to open Solver's VBA code is not good because it There is allegedly copyright. Besides, I do not think Solver creates any disadvantages while working with Excel or VBA.
Read more

github - Teamcity & Git - PR merge builds - anyway to get HEAD commit hash? -

-
I have a team city build project with Gitbab VCS route, I have been triggered for both / head on PR and / Merge the referee. The annoying thing is that you can not do anything useful with the merged hash - it is not present in Gitobb. I want to exclude newsgate packages with head in gutub comet situations in the version number along with Hewash (Newsaging 7) for the music build, but against head hash. However, I can not see a way to get the head hashes while constructing that merge. I just want to head because it's useless - we only care about merge. (PR - Pull Request) This command works reliably while running One on / merge is git log --no-merge -1 ---- = '% h'
Read more

ios - Replace text in UITextView run slowly -

-
I have a UITextView and I change a word like the code at the end of UITextView.text: - (void) Replace TexttechWitWord: (NSString *) word {NSString * currentTextViewText = self.textView.text; CurrentTextViewText = [currentTextViewText stringByReplacingCharactersInRange: NSMakeRange ([self.textView.text length] - [word length], [word length]) withString: word; Self.textView.text = currentTextViewText; } Replacement work is fine, but it runs very slowly and very slowly when the textView now lengthens Is there any better way? I try the replacement range: with text for a week but still stuck. Not to know how to use it to replace it in your case. Please guide! Thanks in advance! This is an important job. As you are using an irreversible string and you are creating a very long string and before Assigned to NSString created from. NSString will be used instead of NSMutableString . - (UITableViewCell *) TableView: (UITableView *) Table View CellForOutPath: (NSIndex...
Read more