| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
10 (0.107s).
|
|
|
Loading phrases to help you
refine your search...
|
|
RE: Binary Search in map reduce - MapReduce - [mail # user]
|
|
...You will incur the cost of map reduce across all nodes in your cluster anyways. Not sure, you will get enough speed advantage. HBase may help you get close to what you are looking for but th...
|
|
|
Author: Pamecha, Abhishek,
2013-01-07, 23:31
|
|
|
RE: HDFS using SAN - MapReduce - [mail # user]
|
|
...Check this out: http://www.symantec.com/connect/articles/getting-hang-iops-v13#a12 May be this helps. I think their RAID configuration or striping is contribu ting to it. Just my guess...
|
|
|
Author: Pamecha, Abhishek,
2012-10-19, 00:29
|
|
|
RE: i am about to scrape a page - MapReduce - [mail # user]
|
|
...A little bit better than plain scraping..use lynx.. You don't have to parse HTML at least. Thanks, Abhishek From: Patai Sangbutsarakum [mailto:[EMAIL PROTECTED]] Sent: Th...
|
|
|
Author: Pamecha, Abhishek,
2012-10-18, 22:00
|
|
|
Re: HDFS using SAN - MapReduce - [mail # user]
|
|
...Yes, I have been reaching the same conclusions here. Tom would you care to spell out the 'obvious' io considerations? I would like to see if there are more that are differe...
|
|
|
Author: Pamecha, Abhishek,
2012-10-18, 15:18
|
|
|
Re: HDFS using SAN - MapReduce - [mail # user]
|
|
...Yes, I had similar views from the netapp paper. My usecase is io heavy an d that's why ( atleast IMO), when data set grows, a shared SAN begins to ma ke less sense as opposed to ...
|
|
|
Author: Pamecha, Abhishek,
2012-10-18, 15:08
|
|
|
RE: HDFS using SAN - MapReduce - [mail # user]
|
|
...In a SAN? Would it be a concern if I am relying on HDFS to do the replicati on and using SAN only for dumb storage tier. In that case, the only differ ence is remote vs local access. &...
|
|
|
Author: Pamecha, Abhishek,
2012-10-18, 00:26
|
|
|
RE: HDFS using SAN - MapReduce - [mail # user]
|
|
...Tom Do you mean you are using GPFS instead of HDFS? Also, if you can share, are you deploying it as DAS set up or a SAN? Thanks, Abhishek From: Tom Deutsch [mailto:[EMAIL P...
|
|
|
Author: Pamecha, Abhishek,
2012-10-18, 00:21
|
|
|
RE: HDFS using SAN - MapReduce - [mail # user]
|
|
...Yes, for MR, my impression is typically the n/w utilization is next to none during map and reduce tasks but jumps during shuffle. With a SAN, I would assume there is no such separation...
|
|
|
Author: Pamecha, Abhishek,
2012-10-16, 23:28
|
|
|
HDFS on SAN - MapReduce - [mail # user]
|
|
...Hi I have read scattered documentation across the net which mostly say HDFS do esn't go well with SAN being used to store data. While some say, it is an e merging trend. I would love ...
|
|
|
Author: Pamecha, Abhishek,
2012-10-16, 22:24
|
|
|
HDFS using SAN - MapReduce - [mail # user]
|
|
...Hi I have read scattered documentation across the net which mostly say HDFS do esn't go well with SAN being used to store data. While some say, it is an e merging trend. I would love t...
|
|
|
Author: Pamecha, Abhishek,
2012-10-16, 18:28
|
|
|
|
