Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> Ways to ingest data into hadoop


Copy link to this message
-
Re: Ways to ingest data into hadoop
Hi,

I as far as I know, t hadoop inherently does not support ingesting video
files into HDFS, as video needs to be split on specific video frames. I am
also working on similar problem I actually wrote my own RecordReader and
and InputFormat for video, so that the video block can be submitted to the
Map Task in its entirety. But this only works if you have pre-split the
video using something like ffmpeg, and each split is smaller than your
configured blocksize.
Regards,
Shraddha

On Wed, Feb 20, 2013 at 5:52 AM, Shouvanik Haldar <
[EMAIL PROTECTED]> wrote:

> Hi,
>
> I have various sources like -
> 1. video
> 2. audio
> 3. email
> 4. RDBMS
> 5. flat files
> 6. Main Frames
> 7. RFID
>
>
> how to ingest data from the above sources to hadoop
>
>
> Regards,
> Shouvanik
>
> --
> Thanks,
> *Shouvanik*
>