hadoop - Hive index rebuild too slow in compare with PostgreSQL -

-

I am trying to compare the same functionality on my PostgreSQL data warehouse and the new one on the same box on the same box I am trying to understand the hive data warehouse and the same table structure I understand the hive benefits, but ... despite the fact that Data Load is running 3 times in postgresqual - Index build / rebuild on PostGrace SQL To fold The index hive do not need to create every time. My question is, what am I missing in the hive configuration?

My setup is: '' Status / Data / Spaces / Hadoop / hadoopfs '' set by ROW FORMAT DELIMITED FIELDS; Make Table Tablet (AR ANAR, BB String);

Load data local INPATH / data / Informix94 / spaces / postgres / myfile_big 'Overlay in table matrix;

Index mytable_indx 'org.apache as Current Table Matabable (AA) Thoop Hv.kill.inx.com Compact index handler with 'defrade rebuild space' / data / spaces / halaps / thophis';

Set Hive OPTIMATE. Otto indices = true; Set hive.aptimize.inx.filter = true;

Turn on mytable_indx to rebuild mytable_indx;

My box is VGM with 3G RAM on which PostgreSQL is running and 1GB RAM. They are serving as a metadata store. I am using the most recent stable versions of CentOS, Hadoop, Hive and have not been able to change the hive's default setting except to disable matadata store location and statistics.

Result: Index reconstruction takes 260,000,000 rows or 8098 seconds on 5000,000 lines for 80 seconds.

The hive works well only when your data does not fit on one machine. So the result you are seeing is the expected outcome, so once you have gathered the terabytes or petabytes data, you will be very happy with the hive. In the case of usage you would describe PostgreSQL would be a better match.

Comments

Post a Comment

Popular posts from this blog

excel vba - How to delete Solver(SOLVER.XLAM) code -

-
After opening several examples of macro / code written, I suddenly get stuck with a code that seems safe. Solver (SOLVER.XLAM) is doing this notation and I would like to remove it from my system. I do not think this is a relativant code. Can anyone tell me what should I do? I have already installed something to remove the password but Solver is still asking for password and I can not get rid of it! itemprop = "text"> Solver Excel is add-in If you want to delete it, then Excel Application & gt; Options & gt; Add-ins & gt; Search for 'Go to' button and gt; Uncheck the solver on the list like press something (I can not give you the exact path because I have the Polish version of Excel). Trying to open Solver's VBA code is not good because it There is allegedly copyright. Besides, I do not think Solver creates any disadvantages while working with Excel or VBA.
Read more

github - Teamcity & Git - PR merge builds - anyway to get HEAD commit hash? -

-
I have a team city build project with Gitbab VCS route, I have been triggered for both / head on PR and / Merge the referee. The annoying thing is that you can not do anything useful with the merged hash - it is not present in Gitobb. I want to exclude newsgate packages with head in gutub comet situations in the version number along with Hewash (Newsaging 7) for the music build, but against head hash. However, I can not see a way to get the head hashes while constructing that merge. I just want to head because it's useless - we only care about merge. (PR - Pull Request) This command works reliably while running One on / merge is git log --no-merge -1 ---- = '% h'
Read more

ios - Replace text in UITextView run slowly -

-
I have a UITextView and I change a word like the code at the end of UITextView.text: - (void) Replace TexttechWitWord: (NSString *) word {NSString * currentTextViewText = self.textView.text; CurrentTextViewText = [currentTextViewText stringByReplacingCharactersInRange: NSMakeRange ([self.textView.text length] - [word length], [word length]) withString: word; Self.textView.text = currentTextViewText; } Replacement work is fine, but it runs very slowly and very slowly when the textView now lengthens Is there any better way? I try the replacement range: with text for a week but still stuck. Not to know how to use it to replace it in your case. Please guide! Thanks in advance! This is an important job. As you are using an irreversible string and you are creating a very long string and before Assigned to NSString created from. NSString will be used instead of NSMutableString . - (UITableViewCell *) TableView: (UITableView *) Table View CellForOutPath: (NSIndex...
Read more