-Upload files directly to hdfs from standard out using pipes
Mapred Learn 2011-01-12, 10:07
I found out that :
can be used to write data directly to HDFS without writing to a local
filesystem but I am not able to understand how.
Could somebody tell me how can I do this ? Or is there some other best way to do it ?
Basiclly my use case is to pipe standard out from a program directly
to HDFS so that it does not have to go through the disk write.
Thanks in advance !