| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
86 (0.685s).
|
|
|
Loading phrases to help you
refine your search...
|
|
End2EndTests - Apache Hive - Apache Software Foundation - Hive - [wiki]
|
|
... show comment hide comment &nb...
|
|
|
|
|
|
|
|
[HDFS-566] INode.permissions should be marked as volatile to avoid synchronization problems - HDFS - [issue]
|
|
...Looking at INode, I can see that the long permissions field is updated in the synchronized updatePermissions, read in other non-synchronized contextsI believe that to avoid race conditions a...
|
|
|
|
|
|
|
|
[expand - 3 more]
[collapse]
-
Re: How to add debugging to map- red code - Hadoop - [mail # user]
|
|
...Thanks Harsh. Are they in cdh3 too ? On Thu, May 3, 2012 at 4:32 PM, Harsh J wrote: ...
|
|
|
|
|
| |
|
|
Re: How to add debugging to map- red code - Hadoop - [mail # user]
|
|
...(Shit, sorry about my last response, I got confused and thought this were a cdh-user list. I deeply apologize.) The (i) is in 0.23.1/2.x if you upgrade to that today. On Fri, May...
|
|
|
Author: Harsh J,
2012-05-03, 23:33
|
|
|
Re: How to add debugging to map- red code - Hadoop - [mail # user]
|
|
...Doing (ii) would be an isolated app-level config and wouldn't get affected by the toggling of (i). The feature from (i) is available already in CDH 4.0.0-b2 btw. On Fri, May 4, 2012 at...
|
|
|
Author: Harsh J,
2012-05-03, 23:32
|
|
|
Re: How to add debugging to map- red code - Hadoop - [mail # user]
|
|
...Hi Harsh, Does doing (ii) mess up with hadoop (i) level ? Or does it happen in both the options anyways ? Thanks, -JJ On Fri, Apr 20, 2012 at 8:28 AM, Harsh J ...
|
|
|
Author: Mapred Learn,
2012-05-03, 23:28
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Re: Reduce Hangs at 66% - Hadoop - [mail # user]
|
|
...I am not sure about ulimits, but I can answer the rest. It's a Cloudera distribution of Hadoop 0.20.2. The HDFS has 9 TB free. In the reduce step, I am taking keys in the form of (gridID, da...
|
|
|
|
|
| |
|
|
Re: Reduce Hangs at 66% - Hadoop - [mail # user]
|
|
...Well... Lots of information but still missing some of the basics... Which release and version? What are your ulimits set to? How much free disk space do you have? What are you attempti...
|
|
|
Author: Michel Segel,
2012-05-03, 09:02
|
|
|
|
|
[FLUME-1176] Fan out and CBR should be refactored to be composite channels - Flume - [issue]
|
|
...I'd like to propose that ChannelProcessor and ChannelSelector go away in favor of a simplified composite channel based implementation.Today, fan out and content based routing (CBR, or techni...
|
|
|
|
|
|
|
|
[HADOOP-6114] bug in documentation: org.apache.hadoop.fs.FileStatus.getLen() - Hadoop - [issue]
|
|
...In javadoc method org.apache.hadoop.fs.FileStatus.getLen() writtend that this method "return the length of this file, in blocks"But method return size in bytes....
|
|
|
|
|
|
|
|
[expand - 4 more]
[collapse]
-
Re: 0.92.2? - HBase - [mail # dev]
|
|
...Shall we open a jira for investigating the performance issue, and mark it as a blocker for 0.92.2? Enis On Thu, May 3, 2012 at 10:44 AM, Elliott Clark wrote: ...
|
|
|
|
|
| |
|
|
Re: 0.92.2? - HBase - [mail # dev]
|
|
...I'm going to try and test 0.94.0 RC3 a little today. After that I can try and do some poking to see why 92 was so slow. On Thu, May 3, 2012 at 10:09 AM, Todd Lipcon wrote: ...
|
|
|
Author: Elliott Clark,
2012-05-03, 17:44
|
|
|
Re: 0.92.2? - HBase - [mail # dev]
|
|
...Anyone looked into the apparent performance issue that Elliott reported earlier this week? If we have a big perf regression from 0.90 we should probably spend at least a few minutes looking ...
|
|
|
Author: Todd Lipcon,
2012-05-03, 17:09
|
|
|
Re: 0.92.2? - HBase - [mail # dev]
|
|
...+1 On May 3, 2012, at 8:58 AM, Stack wrote: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=1231075 3&version=12319888...
|
|
|
Author: Devaraj Das,
2012-05-03, 17:06
|
|
|
0.92.2? - HBase - [mail # dev]
|
|
...Should I put up a 0.92.2 candidate? There have been a bunch of fixes since 0.92.1: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12319888 St.A...
|
|
|
Author: Stack,
2012-05-03, 15:58
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Re: kerberos security enabled and hadoop/hdfs/mapred users - MapReduce - [mail # user]
|
|
...Yes Koert! That is correct! On Thu, May 3, 2012 at 6:08 PM, Koert Kuipers wrote: ...
|
|
|
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Re: Problem with cluster - Hadoop - [mail # user]
|
|
...Hi Pat, 20.205 is the stable version before 1.0. 1.0 is not substantially different than 0.20. Any reasons you don't wanna use it? I don't think "occasional HDFS corruption" is a...
|
|
|
|
|
| |
|
|
Problem with cluster - Hadoop - [mail # user]
|
|
...I'm trying to use a small cluster to make sure I understand the setup and have my code running before going to a big cluster. I have two machines. I've followed the tutorial here...
|
|
|
Author: Pat Ferrel,
2012-05-03, 17:09
|
|
|
|
|
[expand - 12 more]
[collapse]
-
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Ok... So riddle me this... I currently have a replication factor of 3. I reset it to two. What do you have to do to get the replication factor of 3 down to 2? Do I just try to rebalanc...
|
|
|
|
|
| |
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...This probably is a more relevant question in CDH mailing lists. That said, what Edward is suggesting seems reasonable. Reduce replication factor, decommission some of the nodes and create a ...
|
|
|
Author: Suresh Srinivas,
2012-05-03, 16:26
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Honestly that is a hassle, going from 205 to cdh3u3 is probably more or a cross-grade then an upgrade or downgrade. I would just stick it out. But yes like Michael said two clusters on the s...
|
|
|
Author: Edward Capriolo,
2012-05-03, 15:25
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Ok... When you get your new hardware... Set up one server as your new NN, JT, SN. Set up the others as a DN. (Cloudera CDH3u3) On your existing cluster... Remove your old l...
|
|
|
Author: Michel Segel,
2012-05-03, 11:25
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Yeah I know :-) and this is not a production cluster ;-) and yes there is more hardware coming :-) On Thu, May 3, 2012 at 4:10 PM, Michel Segel wrote: ...
|
|
|
Author: Austin Chungath,
2012-05-03, 10:46
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Well, you've kind of painted yourself in to a corner... Not sure why you didn't get a response from the Cloudera lists, but it's a g eneric question... 8 out of 10 TB. Are you talking ...
|
|
|
Author: Michel Segel,
2012-05-03, 10:40
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Yes. This was first posted on the cloudera mailing list. There were no responses. But this is not related to cloudera as such. cdh3 is based on apache hadoop 0.20 as the base. My...
|
|
|
Author: Austin Chungath,
2012-05-03, 10:25
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Seems like a matter of upgrade. I am not a Cloudera user so would not know much, but you might find some help moving this to Cloudera mailing list. On Thu, May 3, 2012 at 2:51 AM, Aust...
|
|
|
Author: Prashant Kommireddi,
2012-05-03, 09:55
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...There is only one cluster. I am not copying between clusters. Say I have a cluster running apache 0.20.205 with 10 TB storage capacity and has about 8 TB of data. Now how can I migrate...
|
|
|
Author: Austin Chungath,
2012-05-03, 09:51
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...you can actually look at the distcp http://hadoop.apache.org/common/docs/r0.20.0/distcp.html but this means that you have two different set of clusters available to do the migrat...
|
|
|
Author: Nitin Pawar,
2012-05-03, 09:42
|
|
|
Re: Best practice to migrate HDFS from 0.20.205 to CDH3u3 - Hadoop - [mail # user]
|
|
...Thanks for the suggestions, My concerns are that I can't actually copyToLocal from the dfs because the data is huge. Say if my hadoop was 0.20 and I am upgrading to 0.20.205 I can do a...
|
|
|
Author: Austin Chungath,
2012-05-03, 07:21
|
|
|
|
|
|
|
|
|
