Hi Friends,

I have an application in which allow various users to upload docs, images etc . I want to use HDFS for storing the uploads.
I know about HDFS utilities like -copyFromLocal and -put from which I can copy the files present on local filesystem  to HDFS filesystem.

Now I want to know that as users upload from webpage, it is directly saved to HDFS . For downloading also can I directly connect to HDFS and download the file to users machine.

Any pointers will be good

Thanks & Regards
Stuti Awasthi
Sr Specialist
________________________________
::DISCLAIMER::
-----------------------------------------------------------------------------------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
It shall not attach any liability on the originator or HCL or its affiliates. Any views or opinions presented in
this email are solely those of the author and may not necessarily reflect the opinions of HCL or its affiliates.
Any form of reproduction, dissemination, copying, disclosure, modification, distribution and / or publication of
this message without the prior written consent of the author of this e-mail is strictly prohibited. If you have
received this email in error please delete it and notify the sender immediately. Before opening any mail and
attachments please check them for viruses and defect.

-----------------------------------------------------------------------------------------------------------------------

08.09.11 12:12, Stuti Awasthi ???????(??):
>
> Hi Friends,
>
> I have an application in which allow various users to upload docs,
> images etc . I want to use HDFS for storing the uploads.
>
> I know about HDFS utilities like -copyFromLocal and ?put from which I
> can copy the files present on local filesystem  to HDFS filesystem.
>
> Now I want to know that as users upload from webpage, it is directly
> saved to HDFS . For downloading also can I directly connect to HDFS
> and download the file to users machine.
>
>
Mount it with fuse.

Best regards, Vitalii Tymchyshyn

Vitalii's suggestion is good, but would limit to users using *nix I reckon.

If I understand your question right, you need a way via HTTP/web to
put/get files from/to users?

I'd recommend using 'Hue' [1] in that case, which brings a web
interface for Hadoop that lets users upload files/documents directly
onto the HDFS, lets an admin manage users over HDFS, and much more.
See Hue in action here:
http://www.cloudera.com/blog/2010/07/whats-new-in-cdh3b2-hue/

Hue is free and open-source software that you can install Hue by
following - https://ccp.cloudera.com/display/CDHDOC/Hue+Installation

[1] - http://cloudera.github.com/hue/

P.s. There's also a platform for custom web-apps development in Hue --
Please see http://cloudera.github.com/hue for more details, downloads
and development specifics -- and
https://groups.google.com/a/cloudera.org/group/hue-user/ is where the
community is at, for further Hue-specific questions!

On Thu, Sep 8, 2011 at 2:58 PM, Vitalii Tymchyshyn <[EMAIL PROTECTED]> wrote:
> 08.09.11 12:12, Stuti Awasthi написав(ла):
>
> Hi Friends,
>
>
>
> I have an application in which allow various users to upload docs, images
> etc . I want to use HDFS for storing the uploads.
>
> I know about HDFS utilities like -copyFromLocal and –put from which I can
> copy the files present on local filesystem  to HDFS filesystem.
>
>
>
> Now I want to know that as users upload from webpage, it is directly saved
> to HDFS . For downloading also can I directly connect to HDFS and download
> the file to users machine.
>
>
>
> Mount it with fuse.
>
> Best regards, Vitalii Tymchyshyn
>

--
Harsh J

Yes. But a while ago we had some issues with uploading huge files with Hue.
Not sure if it still exist.
Hoop is another way. Have not tried it though.

Thanks
Sudhan S

On Thu, Sep 8, 2011 at 4:01 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Vitalii's suggestion is good, but would limit to users using *nix I reckon.
>
> If I understand your question right, you need a way via HTTP/web to
> put/get files from/to users?
>
> I'd recommend using 'Hue' [1] in that case, which brings a web
> interface for Hadoop that lets users upload files/documents directly
> onto the HDFS, lets an admin manage users over HDFS, and much more.
> See Hue in action here:
> http://www.cloudera.com/blog/2010/07/whats-new-in-cdh3b2-hue/
>
> Hue is free and open-source software that you can install Hue by
> following - https://ccp.cloudera.com/display/CDHDOC/Hue+Installation
>
> [1] - http://cloudera.github.com/hue/
>
> P.s. There's also a platform for custom web-apps development in Hue --
> Please see http://cloudera.github.com/hue for more details, downloads
> and development specifics -- and
> https://groups.google.com/a/cloudera.org/group/hue-user/ is where the
> community is at, for further Hue-specific questions!
>
> On Thu, Sep 8, 2011 at 2:58 PM, Vitalii Tymchyshyn <[EMAIL PROTECTED]>
> wrote:
> > 08.09.11 12:12, Stuti Awasthi написа��(ла):
> >
> > Hi Friends,
> >
> >
> >
> > I have an application in which allow various users to upload docs, images
> > etc . I want to use HDFS for storing the uploads.
> >
> > I know about HDFS utilities like -copyFromLocal and –put from which I can
> > copy the files present on local filesystem  to HDFS filesystem.
> >
> >
> >
> > Now I want to know that as users upload from webpage, it is directly
> saved
> > to HDFS . For downloading also can I directly connect to HDFS and
> download
> > the file to users machine.
> >
> >
> >
> > Mount it with fuse.
> >
> > Best regards, Vitalii Tymchyshyn
> >
>
>
>
> --
> Harsh J
>

On Thu, Sep 08, 2011 at 04:01PM, Harsh J wrote:

> Hue is free and open-source software that you can install Hue by
> following

Does it work with Apache Hadoop? Or just CDH?

Thansk,
  Cos

Cos,

I reckon it is just CDH out of the box cause of a few unreleased,
apache-hadoop trunk-only features it leverages, looking at its
interfacing points. But Hue's merely a client on its own, and can
surely be made to work atop Apache Hadoop with some effort (there's no
proprietary stuff involved, as already mentioned). This is definitely
discussable on https://groups.google.com/a/cloudera.org/group/hue-user
I should think :)

On Thu, Sep 8, 2011 at 8:50 PM, Konstantin Boudnik <[EMAIL PROTECTED]> wrote:
> On Thu, Sep 08, 2011 at 04:01PM, Harsh J wrote:
>
>> Hue is free and open-source software that you can install Hue by
>> following
>
> Does it work with Apache Hadoop? Or just CDH?
>
> Thansk,
>  Cos
>

--
Harsh J