Thilee Subramaniam 2012-10-05, 17:27
Steve Loughran 2012-10-09, 19:22
Harsh J 2012-10-10, 07:05
-Re: Need to add fs shim to use QFS
Thilee Subramaniam 2012-10-10, 15:03
Like Harsh said, HADOOP-8886 addresses removing KFS from apache tree.
But I interpret your suggestion as 'moving qfs.jar out of apache tree, and
keeping the jar in possibly a maven repo externally. The new fs shim for
QFS will pull this jar from the repo upon compilation etc.'.
Please correct me if I am wrong.
On 10/10/12 12:05 AM, "Harsh J" <[EMAIL PROTECTED]> wrote:
>Check out https://issues.apache.org/jira/browse/HADOOP-8886 for the
>KFS removal. Seems relevant to your question here.
>On Wed, Oct 10, 2012 at 12:52 AM, Steve Loughran <[EMAIL PROTECTED]>
>> On 5 October 2012 18:27, Thilee Subramaniam <[EMAIL PROTECTED]>
>>> We at Quantcast have released QFS 1.0 (Quantcast File System) to open
>>> source. This is based on the KFS 0.5 (Kosmos Distributed File System),
>>> a C++ distributed filesystem implementation. KFS plugs into Apache
>>> Hadoop via the 'kfs' shim that is part of Hadoop codebase.
>>> QFS has added support for permissions, and also, provides fault
>>> through Reed-Solomon encoding as well as replication. There are also a
>>> number of performance and stability improvements, including a rewrite
>>> the client library to allow parallel concurrent I/Os. Going forward,
>>> releases of KFS will come from QFS.
>> Does this mean the kfs plugin can go from the apache tree?
>> One problem that we've always had with KFS is that nobody ever tested
>> filesystem, and it was inevitably out of sync with what was in KFS.
>> Have you considered just pulling the kfs lib out and releasing the
>> classes yourself? It's what the other FS suppliers do, as it gives them
>> more control over the libraries, including the ability to release more
Steve Loughran 2012-10-10, 19:14
Eli Collins 2012-10-10, 19:21
Steve Loughran 2012-10-11, 08:59
Thilee Subramaniam 2012-10-10, 23:34
Steve Loughran 2012-10-11, 15:01
Thilee Subramaniam 2012-10-26, 00:24
Steve Loughran 2012-10-26, 17:32
Eli Collins 2012-10-05, 17:32
Thilee Subramaniam 2012-10-05, 23:27
Thilee Subramaniam 2012-10-09, 17:24