| clear query|facets|time |
Search criteria: MiniDFSCluster.
Results from 41 to 50 from
211 (0.439s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: mini node in a cluster - Hadoop - [mail # user]
|
|
... and the tasktracker on the mini-node slave? Remove it from slaves? - what do I minimally need to start on the mini-node? Also I have replication set to 2 so the data will just get re-replicated once...
|
|
... the mini-node is reconfigured, right? There should be another copy somewhere on the cluster. Thanks Pat On 6/4/12 2:38 PM, Tom Melendez wrote: ...
|
|
|
Author: Pat Ferrel,
2012-06-04, 21:50
|
|
|
Re: mini node in a cluster - Hadoop - [mail # user]
|
|
...OK, so remove the mini-node (client) from the master's slaves since it's no longer a node. This will cause the client to not get started when the master starts. There is no init.d script...
|
|
|
Author: Pat Ferrel,
2012-06-05, 14:36
|
|
|
Re: mini node in a cluster - Hadoop - [mail # user]
|
|
.../path/in/hdfs and it succeeds, you're probably OK. Probably. It's not really a "mini-node", it's really just a client at this point, it's not known by your cluster. You could configure your laptop or any other...
|
|
|
Author: Tom Melendez,
2012-06-04, 23:06
|
|
|
Re: mini node in a cluster - Hadoop - [mail # user]
|
|
...Hi Pat, Sounds like you would just turn off the datanode and the tasktracker. Your config will still point to the Namenode and JT, so you can still launch jobs and read/write from HDFS...
|
|
|
Author: Tom Melendez,
2012-06-04, 21:38
|
|
|
mini node in a cluster - Hadoop - [mail # user]
|
|
...I have a machine that is part of the cluster but I'd like to dedicate it to being the web server and run the db but still have access to starting jobs and getting data out of hdf...
|
|
|
Author: Pat Ferrel,
2012-06-04, 21:06
|
|
|
TestingNov2009 - Hadoop - [wiki]
|
|
... that your code will work.
Testing changes to Hadoop, fast
Hadoop unit/functional testing is slow with MiniMR/MiniDFS cluster setup and teardowns per test. This could be addressed by having more...
|
|
... Mini cluster reuse, but it could be even faster if people could push out newly compiled JARs and test them at scale.
Testing Hadoop Distributions
This is a problem which Cloudera and others...
|
|
|
http://wiki.apache.org/hadoop/TestingNov2009
Author: SteveLoughran,
2009-11-22, 12:24
|
|
|
Hadoop Change Log - Hadoop - [web site]
|
|
... exited TT threads as dead in MiniMRCluster
(eli)
MAPREDUCE-3424. Some LinuxTaskController cleanup
(eli)
MAPREDUCE-2103. task-controller shouldn't require o-r permissions.
(eli)
HDFS-2638...
|
|
...-7816. Allow HADOOP_HOME deprecated warning suppression based
on config specified in hadoop-env.sh
(Dave Thompson via suresh)
MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only...
|
[+ show more]
[- hide]
| ... .classpath from ivy config.
(Thomas Graves and Tom White via cdouglas)
MAPREDUCE-2558. Add queue-level metrics 0.20-security branch (test fixes)
(Jeffrey Naisbitt via mahadev)
HADOOP-7364. TestMini... |
|
|
http://hadoop.apache.org/common/docs/stable/changes.html
2013-03-06, 08:41
|
|
|
DeveloperOffsite20090612 - Hadoop - [wiki]
|
|
...)
Testing:
We have 10 new machines which can be used soon
Need "ten minute test" so that individuals can run this Some MR folks are removing MiniMR from tests where it's not needed
Phil: We...
|
|
... utils.
We should start using some mock framework JMock, EasyMock, etc
LocalJobRunner needs improvement
TestNG allows for shared MiniMRCluster which will help This should do things...
|
|
|
http://wiki.apache.org/hadoop/DeveloperOffsite20090612
Author: localhost,
2009-09-20, 23:53
|
|
|
BristolHadoopWorkshop - Hadoop - [wiki]
|
|
... of this
Security
This is going to take lots of work. Its really hard to get security right.
Scaling Down
standalone doesn't have >1 reducer.
MiniMR will run multicore, but you have the overhead...
|
|
|
http://wiki.apache.org/hadoop/BristolHadoopWorkshop
Author: SteveLoughran,
2009-10-16, 16:11
|
|
|
Re: [VOTE] Should we create sub-projects for HDFS and Map/Reduce? - Hadoop - [mail # general]
|
|
... tests be divided? For instance, will all three have to have MiniDFSCluster and other shared test infrastructure? We can use Ivy now to manage dependencies on outside libraries. We can build...
|
|
|
Author: Nigel Daley,
2008-08-07, 23:22
|
|
|
|
