|
|
-
Ways to ingest data into hadoop
Shouvanik Haldar 2013-02-20, 10:52
Hi,
I have various sources like - 1. video 2. audio 3. email 4. RDBMS 5. flat files 6. Main Frames 7. RFID how to ingest data from the above sources to hadoop Regards, Shouvanik
-- Thanks, *Shouvanik*
+
Shouvanik Haldar 2013-02-20, 10:52
-
Re: Ways to ingest data into hadoop
Shraddha Pandhe 2013-02-20, 15:12
Hi,
I as far as I know, t hadoop inherently does not support ingesting video files into HDFS, as video needs to be split on specific video frames. I am also working on similar problem I actually wrote my own RecordReader and and InputFormat for video, so that the video block can be submitted to the Map Task in its entirety. But this only works if you have pre-split the video using something like ffmpeg, and each split is smaller than your configured blocksize. Regards, Shraddha
On Wed, Feb 20, 2013 at 5:52 AM, Shouvanik Haldar < [EMAIL PROTECTED]> wrote:
> Hi, > > I have various sources like - > 1. video > 2. audio > 3. email > 4. RDBMS > 5. flat files > 6. Main Frames > 7. RFID > > > how to ingest data from the above sources to hadoop > > > Regards, > Shouvanik > > -- > Thanks, > *Shouvanik* >
+
Shraddha Pandhe 2013-02-20, 15:12
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext