Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hadoop is for whom? Data architect or Java Architect or All


Copy link to this message
-
Re: Hadoop is for whom? Data architect or Java Architect or All
On Thu, Jan 27, 2011 at 5:42 AM, Steve Loughran <[EMAIL PROTECTED]> wrote:
> On 27/01/11 07:28, Manuel Meßner wrote:
>>
>> Hi,
>>
>> you may want to take a look into the streaming api, which allows users
>> to write there map-reduce jobs with any language, which is capable of
>> writing to stdout and reading from stdin.
>>
>> http://hadoop.apache.org/mapreduce/docs/current/streaming.html
>>
>> furthermore pig and hive are hadoop related projects and may be of
>> interest for non java people:
>>
>> http://pig.apache.org/
>> http://hive.apache.org/
>>
>> So finally my answer: no it isn't ;)
>
> Helps if your ops team have some experience in running java app servers or
> similar, as well as large linux clusters
>

IMHO Hadoop is not a technology you want to use unless you have people
with Java experience on your staff, or you are willing to learn those
skills. Hadoop does not have a standard interface such as SQL. Working
with it involves reading API, reading through source code, reading
blogs, etc.

I would say the average hadoop user is also somewhat of a hadoop
developer/administrator. Where the average MySQL user for example has
never delved into source code.

In other words if you would with hadoop you are bound to see Java
Exception and stack trace in common every day usage.

This does not mean you have to know java to use hadoop but to use it
very effectively I would suggest it.