| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
60 (0.193s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Matrix multiplication in Hadoop - Hadoop - [mail # user]
|
|
...Is Hadoop the best tool for doing large matrix math. Sure you can do it, but, aren't there better tools for these types of proble ms? Sent from a remote device. Please excuse an...
|
|
|
Author: Michel Segel,
2011-11-18, 17:33
|
|
|
Re: Data locality for a custom input format - Hadoop - [mail # user]
|
|
...There's this article on InfoQ that deals with this issue... ;-) http://www.infoq.com/articles/HadoopInputFormat Sent from a remote device. Please excuse any typos... Mike S...
|
|
|
Author: Michel Segel,
2011-11-13, 02:30
|
|
|
Re: Map-Reduce in memory - Hadoop - [mail # user]
|
|
...Hi, First, you have 8 physical cores. Hyper threading makes the machine think th at it has 16. The trouble is that you really don't have 16 cores so you need to be a little more ...
|
|
|
Author: Michel Segel,
2011-11-04, 11:24
|
|
|
Re: data locality - Hadoop - [mail # user]
|
|
...Umm... You can override the scheduler and force it to ignore data locality. We did t his as an experiment to better balance cluster CPU utilization. It wasn't pr etty and we started to look ...
|
|
|
Author: Michel Segel,
2011-10-28, 09:24
|
|
|
Re: Map-Reduce in memory - Hadoop - [mail # user]
|
|
...Uhm... He has plenty of memory... Depending on what sort of m/r tasks... He could p ush it. Didn't say how much disk... I wouldn't start that high... Try 10 mappers and 2. Reducers. Gr...
|
|
|
Author: Michel Segel,
2011-10-28, 09:14
|
|
|
Re: Job Submission schedule, one file at a time ? - Hadoop - [mail # user]
|
|
...Not sure what you are attempting to do... If you submit the directory name... You get a single m/r job to process all. ( but it doesn't sound like that is what you want...) You ...
|
|
|
Author: Michel Segel,
2011-10-25, 21:25
|
|
|
Re: Question on mianframe files - Hadoop - [mail # user]
|
|
...Ok... Your best bet is to bite the bullet and forego using dd. What end up doing i s staging the files twice ... Raw ebcdic, converted ASCII then move to HDFS. .. You would be better o...
|
|
|
Author: Michel Segel,
2011-10-15, 17:48
|
|
|
Re: Question on mianframe files - Hadoop - [mail # user]
|
|
...You may not want to do this... Does the data contain and packed or zoned decimals? If so, the dd conversion will corrupt your data. Sent from a remote device. Please excuse any typos....
|
|
|
Author: Michel Segel,
2011-10-15, 14:58
|
|
|
Re: Hadoop cluster optimization - Hadoop - [mail # user]
|
|
...Avi, First why 32 bit OS? You have a 64 bit processor that has 4 cores hyper threaded looks like 8cpus . With only 1.7 GB you're going to be limited on the number of slots you can c on...
|
|
|
Author: Michel Segel,
2011-08-22, 02:17
|
|
|
Re: Namenode Scalability - Hadoop - [mail # user]
|
|
...So many questions, why stop there? First question... What would cause the name node to have a GC issue? Second question... You're streaming 1PB a day. Is this a single stream of da ta?...
|
|
|
Author: Michel Segel,
2011-08-10, 18:26
|
|
|
|
