Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # dev - S3 FS tests broken?
Trevor
2012-08-14, 01:04
Eli Collins
2012-08-14, 01:35
Eli Collins
2012-08-14, 17:33
Copy link to this message
-
Re: S3 FS tests broken?
Alejandro Abdelnur 2012-08-14, 18:37
This is me,

https://issues.apache.org/jira/browse/HADOOP-8699

On it

Thx

On Tue, Aug 14, 2012 at 10:33 AM, Eli Collins <[EMAIL PROTECTED]> wrote:
> Trevor,
> Forgot to ask, since you can reproduce this can you confirm and see
> why S3Conf.get is returning null for test.fs.s3.name?
>
> On Mon, Aug 13, 2012 at 6:35 PM, Eli Collins <[EMAIL PROTECTED]> wrote:
>> Passes for me locally, and the precondition that's failing (passing
>> null to Conf#set) from the backtrace looks like the null is coming
>> from:
>>
>>     S3Conf.set(FS_DEFAULT_NAME_DEFAULT, S3Conf.get("test.fs.s3.name"));
>>
>> which is set in core-site.xml so something strange is going on.
>> HADOOP-6296 looks related btw.
>>
>>
>> On Mon, Aug 13, 2012 at 6:04 PM, Trevor <[EMAIL PROTECTED]> wrote:
>>> Anyone know why these tests have started failing? It happens for me locally
>>> and it just happened in Jenkins:
>>> https://builds.apache.org/job/PreCommit-HADOOP-Build/1288/
>>>
>>> I don't see any obvious changes recently that would cause it.
>>>
>>> Tests in error:
>>>   testCreateFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>
>>> testCreateFileWithNullName(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testCreateExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testCreateDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testIsDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testDeleteFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>
>>> testDeleteNonExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testDeleteDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testModificationTime(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testFileStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testListStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>   testBlockSize(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testFsStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWorkingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testMkdirs(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testListStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)

Alejandro