Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # dev >> Review Request: SQOOP-659. Design metadata upgrade procedure


+
Hari Shreedharan 2013-04-04, 04:29
+
Hari Shreedharan 2013-04-12, 16:54
+
Hari Shreedharan 2013-04-12, 19:26
+
Jarek Cecho 2013-04-13, 16:34
+
Hari Shreedharan 2013-04-14, 09:34
+
Jarek Cecho 2013-04-15, 03:53
+
Hari Shreedharan 2013-04-16, 20:58
+
Hari Shreedharan 2013-04-18, 06:58
+
Hari Shreedharan 2013-04-18, 18:15
+
Hari Shreedharan 2013-04-18, 21:33
+
Hari Shreedharan 2013-04-18, 22:07
+
Jarek Cecho 2013-04-19, 01:54
+
Jarek Cecho 2013-04-18, 20:52
Copy link to this message
-
Re: Review Request: SQOOP-659. Design metadata upgrade procedure

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10281/#review19320
-----------------------------------------------------------
Hi Hari,
thank you very much for your effort to get this in. I think that we're almost there!
common/src/main/java/org/apache/sqoop/model/MJob.java
<https://reviews.apache.org/r/10281/#comment40043>

    I do not feel comfortable with exposing this interface. Model classes are (will be) part of public API, so I would prefer not to expose ability to switch forms in place and rather create new objects during the upgrade procedure.

connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcConnectorMetadataUpgrader.java
<https://reviews.apache.org/r/10281/#comment39996>

    I think that the upgrader should not be responsible for changing the form structures, just for transferring the actual values (e.g the upgrade method should just call "setValue()" on the forms).

connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcConnectorMetadataUpgrader.java
<https://reviews.apache.org/r/10281/#comment39997>

    I think that the upgrader should not be responsible for changing the form structures, just for transferring the actual values (e.g the upgrade method should just call "setValue()" on the forms).

core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryHandler.java
<https://reviews.apache.org/r/10281/#comment40042>

    I would recommend to merge those two methods together as it do not make much sense to use them separately.

core/src/main/java/org/apache/sqoop/repository/Repository.java
<https://reviews.apache.org/r/10281/#comment40044>

    What about just:
    1) Get all connections for connector
    2) Get all jobs for connector
    3) Wipe out previous forms,inputs,connection inputs, job inputs
    4) Update connector in the repository (Connector upgrade most likely will change form and input ids!)
    5) for each connection call upgrader to transfer values and save output to the repository
    6) for each job call upgrader to transfer values and save output to the repository

repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbySchemaQuery.java
<https://reviews.apache.org/r/10281/#comment40048>

    Nit: Extra indent.

repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbySchemaQuery.java
<https://reviews.apache.org/r/10281/#comment40047>

    Nit: Extra indent.

repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbySchemaQuery.java
<https://reviews.apache.org/r/10281/#comment40046>

    Nit: Extra indent.

repository/repository-derby/src/main/java/org/apache/sqoop/repository/derby/DerbySchemaQuery.java
<https://reviews.apache.org/r/10281/#comment40045>

    Nit: The "WHERE" should not be intended on the same level as "ON".
Jarcec

- Jarek Cecho
On April 16, 2013, 8:58 p.m., Hari Shreedharan wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10281/
> -----------------------------------------------------------
>
> (Updated April 16, 2013, 8:58 p.m.)
>
>
> Review request for Sqoop.
>
>
> Description
> -------
>
> Metadata upgrade for connector upgrades. This is an initial patch soliciting feedback. Limited testing has been done. I will add some unit tests once I get feedback.
>
>
> This addresses bug SQOOP-659.
>     https://issues.apache.org/jira/browse/SQOOP-659
>
>
> Diffs
> -----
>
>   common/src/main/java/org/apache/sqoop/model/MConnection.java 36dca42
>   common/src/main/java/org/apache/sqoop/model/MJob.java a53f04e
>   connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcConnector.java c315e48
>   connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcConnectorMetadataUpgrader.java PRE-CREATION
+
Hari Shreedharan 2013-04-18, 07:01
+
Jarek Cecho 2013-04-18, 15:00
+
Jarek Cecho 2013-04-12, 15:07
+
Hari Shreedharan 2013-04-12, 16:47
+
rj.vasanthkumar@... 2013-04-09, 22:00
+
Hari Shreedharan 2013-04-12, 16:54