Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Morphlines: getting the error "unclosed quotation" although handled


Copy link to this message
-
Morphlines: getting the error "unclosed quotation" although handled
Hi,
Firstly, sorry for inundating you with queries every other day.
While trying to push data into Solr from a TSV file using Flume/Morphlines.

I'm getting the error
"Unable to deliver event

Caused by: org.kitesdk.morphline.api.MorphlineRuntimeException: java.lang.IllegalStateException: unexpected end of file, unclosed quotation
"

My morphline.conf file has the following properties:
"
readCSV {
          separator : "\t"
          columns : [parcelid,propertyaddress,streetnumber,streetdirection,streetname,streettype,unitnumber,heatedarea,bedrooms,bathrooms,book,page,instrumentnumber,pid,link,mailingaddress1,mailingaddress2,mailingaddresscity,mailingaddresscountry,mailingaddressstate,mailingaddresszip,buyers,sellers,saleamount,saledescriptioncode,saledescription,averageyearbuilt,dateofsale,propertyusecode,numberofbuildings,propertyusetype]
          ignoreFirstLine : false
          quoteChar : "\""
          commentPrefix : " "
          trim : true
          charset : UTF-8

      }
"
I've tried commentPrefix with "" "#" " "
I've tried trim with true and false.

I'm using the flume 1.5.0. The kite-morphlines jars in the lib folder are 0.12.0 version.

I've attached the TSV file(POCSampleData-2.txt).
I don't think there is anything wrong with the flume.conf file as it pushes data properly into Solr, if the records with quotes are removed.
Thanks in advance.
Sincerely,

Sanjay Ramanathan
 27-22-30-4330-00-160 5885  DAHLIA DR  UNIT 16 5885 DAHLIA DR 16 830 2 1 10612 3493 20130409259 302227433000160 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302227433000160 608 White River Dr Orlando FL 32828 RODRIGUEZ EDUARDO DILIK SEVCAN E 25800 73 CT SOLD TO INDIVIDUAL >$100 1972 7/31/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
23-23-30-1205-45-020 6492 S GOLDENROD RD  UNIT 45B 6492 S GOLDENROD RD 45B 1544 3 2.5 10610 5363 20130402528 302323120545020 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302323120545020 2698 Pine Glen Ct Orlando FL 32833 PHILLIPS BRICE CHRISTOPHER AYBAR MARIA 98000 73 CT SOLD TO INDIVIDUAL >$100 2006 7/26/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
27-21-29-8924-01-835 1835  SHADOW VIEW CIR  UNIT 1835 1835 SHADOW VIEW CIR 1835 1583 3 2.5 10642 4541 20130521196 292127892401835 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292127892401835 3128 W 24Th Ave Vancouver Bc Canada XX V6L REN MINGAHAN "HEMRAJ CARMEN
ELLISTON ICILDA" 94600 73 CT SOLD TO INDIVIDUAL >$100 2000 9/20/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
36-22-28-0199-25-040 6412  RALEIGH ST  UNIT 2504 6412 RALEIGH ST 2504 794 1 1 10670 4142 20130629033 282236019925040 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/282236019925040 1943 Westpointe Cir Orlando FL 32835 JOHNSON CHRISTOPHER E SCHWARTZ LARRY 40100 73 CT SOLD TO INDIVIDUAL >$100 1997 11/22/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
10-24-29-3055-35-030 2432  SWAILES DR  UNIT 3 2432 SWAILES DR 3 905 2 2 10618 3145 20130430983 292410305535030 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292410305535030 2432 Swailes Dr Apt 3 Orlando FL 32837 BELLIDO EDWARD ROBLES HSU HOWARD 38900 73 CT SOLD TO INDIVIDUAL >$100 1985 7/31/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
22-23-30-1820-11-111 6530  SWISSCO DR  UNIT 1111 6530 SWISSCO DR 1111 1088 2 2 10648 1376 20130542526 302322182011111 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302322182011111 3642 Rothbury Dr Orlando FL 32812 ABI-AOUN JEAN S AND W INVESTMENT GROUP LLC 54500 73 CT SOLD TO INDIVIDUAL >$100 1999 10/8/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
07-23-29-3139-14-100 3397 S KIRKMAN RD  UNIT 1410 3397 S KIRKMAN RD 1410 1443 3 2 10608 4612 20130394835 292307313914100 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292307313914100 4501 Gilpin Way Orlando FL 32812 CRUZ ELVIRA F ORAEVSKY ALEXANDER 57900 73 CT SOLD TO INDIVIDUAL >$100 1999 7/24/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
24-23-30-3715-06-110 6240  CONTESSA DR  UNIT 110 6240 CONTESSA DR 110 1408 3 2 10642 4514 20130521190 302324371506110 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302324371506110 3128 24Th Ave Vancouver Bc Canada XX V6L REN MINGAHAN MENDOZA MARVIN 78800 73 CT SOLD TO INDIVIDUAL >$100 2005 9/12/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
23-24-28-2901-01-510 12556  FLORIDAYS RESORT DR  UNIT 510-A 12556 FLORIDAYS RESORT DR 510-A 957 2 2 10612 2976 20130409051 282423290101510 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/282423290101510 11209 Sw 112Th St Miami FL 33176 "MACHADO VILMA
MACHADO EDUARDO" HUA HELEN 183100 73 CT SOLD TO INDIVIDUAL >$100 2006 7/30/2013 12:00:00 AM 3903 1 CONDO HOTEL III
05-23-30-5625-28-001 1928  CONWAY RD  UNIT 1 1928 CONWAY RD 1 825 1 1 10668 7517 20130622244 302305562528001 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302305562528001 1900 Sunset Habour Dr The Annex Fl 2 Miami Beach FL 33139 DAYNITA REVOCABLE TRUST STAPLEY NEIL 5400 73 CT SOLD TO INDIVIDUAL >$100 1970 11/13/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
24-23-30-3715-03-103 8710  SARATOGA INLET DR  UNIT 103 8710 SARATOGA INLET DR 103 1248 3 2 10741 8695 20140228560 302324371503103 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302324371503103 8214 Lake Serene Dr Orlando FL 32836 "SOTO LOPES ANTHONY K
SOTO RIVERA ANTONIO L" DIAZ NEURYS 10100 73 CT SOLD TO INDIVIDUAL >$100 2005 11/5/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
12-23-28-8179-26-108 6302  DAYSBROOK DR  UNIT 108 6302 DAYSBROOK DR 108 1665 3 2.5 10608 4391 20130394738 282312817926108 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/282312817926108 Po Box 5668 Sarasota FL 34277 KNOWLES CHARLES A MOLINARES ECHEVERRI LUCIA FERNANDA 130100 73 CT SOLD TO INDIVIDUAL >$100 2005 7/24/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
23-22-29-5974-00-141 860 N ORANGE AVE  UNIT 141 860 N ORANGE AVE 141 774 1 1 10625 3152 20130457377 292223597400141 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292223597400141 5127 S