Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Feed hdfs with external data.


Copy link to this message
-
Re: Feed hdfs with external data.
Hemanth Yamijala 2010-06-23, 08:52
Pierre,

> I have a program that generates the data that's supposed to be treated by
> hadoop.
> It's a java program that should write right on hdfs.
> So as a test, I do this:
>
>
>
>            Configuration config = new Configuration();
>            FileSystem dfs = FileSystem.get(config);
>            dfs.mkdirs(new Path("/test"));
>
> Which of course failed, certainly because it's unaware of the position of
> the configuration files.
> How should I do this?
> Thanks.
>
>
> P.S. Just in case, here's my error:
>
> 10/06/23 10:04:06 ERROR conf.Configuration: Failed to set
> setXIncludeAware(true) for parser
> gnu.xml.dom.JAXPFactory@1d6096:java.lang.UnsupportedOperationException:
> This parser does not support specification "null" version "null"
> java.lang.UnsupportedOperationException: This parser does not support
> specification "null" version "null"
>        at
> javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:590)
>        at

This exception seems very similar to the one we faced and fixed using
the information here: http://bit.ly/a5zX1e. Could you give it a try ?

Thanks
Hemanth