Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Joins in Sqoop


+
Sambit Tripathy 2014-01-16, 13:20
+
Jarek Jarcec Cecho 2014-01-17, 16:55
+
Sambit Tripathy 2014-01-17, 18:59
+
Sambit Tripathy 2014-01-21, 16:47
+
Chalcy 2014-01-21, 17:07
+
Chalcy 2014-01-16, 13:48
+
Sambit Tripathy 2014-01-16, 14:13
Copy link to this message
-
Re: Joins in Sqoop
You can try concat_ws(' ', map_keys(UNION_MAP(MAP(your_column, 'dummy'))))
as mentioned in https://issues.apache.org/jira/browse/HIVE-707

On Thu, Jan 16, 2014 at 9:13 AM, Sambit Tripathy (RBEI/PJ-NBS) <
[EMAIL PROTECTED]> wrote:

> Hi Chalcy,
>
>
>
> I am using the group_concat function in my query and that actually puts
> all columns in the memory and I am afraid Hive does not have this feature.
>
>
>
>
>
> Regards,
>
> Sambit.
>
>
>
> *From:* Chalcy [mailto:[EMAIL PROTECTED]]
> *Sent:* Thursday, January 16, 2014 7:19 PM
> *To:* [EMAIL PROTECTED]
>
> *Subject:* Re: Joins in Sqoop
>
>
>
> Hi Sambit,
>
>
>
> I would import all the relevant tables into hive and then do the join
> there if you have enough space in the hadoop cluster.
>
>
>
> Hope this helps,
>
> Chalcy
>
>
>
> On Thu, Jan 16, 2014 at 8:20 AM, Sambit Tripathy (RBEI/PJ-NBS) <
> [EMAIL PROTECTED]> wrote:
>
> Hi,
>
>
>
> I have written query which has 5 Join clauses and I am passing this query
> in Sqoop import.
>
>
>
> Problem: This produces a large temp file in the MySQL server temp
> directory and throws back an error saying No Space left on the device. Yes
> this can be fixed by increasing the size of the temp directory in the MySQL
> server, but what if you actually don’t have any space left on MySQL server.
> Are there any workarounds for this? I mean something like a batch import
> which does not create a big temp file in the server.
>
>
>
>
>
> Regards,
>
> Sambit.
>
>
>
>
>

--
-- JChan
+
Anas Mosaad 2014-01-16, 13:58
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB