Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Morphlines: getting the error "unclosed quotation" although handled


Copy link to this message
-
Morphlines: getting the error "unclosed quotation" although handled
Hi,
Firstly, sorry for inundating you with queries every other day.
While trying to push data into Solr from a TSV file using Flume/Morphlines.

I'm getting the error
"Unable to deliver event

Caused by: org.kitesdk.morphline.api.MorphlineRuntimeException: java.lang.IllegalStateException: unexpected end of file, unclosed quotation
"

My morphline.conf file has the following properties:
"
readCSV {
          separator : "\t"
          columns : [parcelid,propertyaddress,streetnumber,streetdirection,streetname,streettype,unitnumber,heatedarea,bedrooms,bathrooms,book,page,instrumentnumber,pid,link,mailingaddress1,mailingaddress2,mailingaddresscity,mailingaddresscountry,mailingaddressstate,mailingaddresszip,buyers,sellers,saleamount,saledescriptioncode,saledescription,averageyearbuilt,dateofsale,propertyusecode,numberofbuildings,propertyusetype]
          ignoreFirstLine : false
          quoteChar : "\""
          commentPrefix : " "
          trim : true
          charset : UTF-8

      }
"
I've tried commentPrefix with "" "#" " "
I've tried trim with true and false.

I'm using the flume 1.5.0. The kite-morphlines jars in the lib folder are 0.12.0 version.

I've attached the TSV file(POCSampleData-2.txt).
I don't think there is anything wrong with the flume.conf file as it pushes data properly into Solr, if the records with quotes are removed.
Thanks in advance.
Sincerely,

Sanjay Ramanathan
 27-22-30-4330-00-160 5885  DAHLIA DR  UNIT 16 5885 DAHLIA DR 16 830 2 1 10612 3493 20130409259 302227433000160 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302227433000160 608 White River Dr Orlando FL 32828 RODRIGUEZ EDUARDO DILIK SEVCAN E 25800 73 CT SOLD TO INDIVIDUAL >$100 1972 7/31/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
23-23-30-1205-45-020 6492 S GOLDENROD RD  UNIT 45B 6492 S GOLDENROD RD 45B 1544 3 2.5 10610 5363 20130402528 302323120545020 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302323120545020 2698 Pine Glen Ct Orlando FL 32833 PHILLIPS BRICE CHRISTOPHER AYBAR MARIA 98000 73 CT SOLD TO INDIVIDUAL >$100 2006 7/26/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
27-21-29-8924-01-835 1835  SHADOW VIEW CIR  UNIT 1835 1835 SHADOW VIEW CIR 1835 1583 3 2.5 10642 4541 20130521196 292127892401835 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292127892401835 3128 W 24Th Ave Vancouver Bc Canada XX V6L REN MINGAHAN "HEMRAJ CARMEN
ELLISTON ICILDA" 94600 73 CT SOLD TO INDIVIDUAL >$100 2000 9/20/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
36-22-28-0199-25-040 6412  RALEIGH ST  UNIT 2504 6412 RALEIGH ST 2504 794 1 1 10670 4142 20130629033 282236019925040 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/282236019925040 1943 Westpointe Cir Orlando FL 32835 JOHNSON CHRISTOPHER E SCHWARTZ LARRY 40100 73 CT SOLD TO INDIVIDUAL >$100 1997 11/22/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
10-24-29-3055-35-030 2432  SWAILES DR  UNIT 3 2432 SWAILES DR 3 905 2 2 10618 3145 20130430983 292410305535030 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292410305535030 2432 Swailes Dr Apt 3 Orlando FL 32837 BELLIDO EDWARD ROBLES HSU HOWARD 38900 73 CT SOLD TO INDIVIDUAL >$100 1985 7/31/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
22-23-30-1820-11-111 6530  SWISSCO DR  UNIT 1111 6530 SWISSCO DR 1111 1088 2 2 10648 1376 20130542526 302322182011111 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302322182011111 3642 Rothbury Dr Orlando FL 32812 ABI-AOUN JEAN S AND W INVESTMENT GROUP LLC 54500 73 CT SOLD TO INDIVIDUAL >$100 1999 10/8/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
07-23-29-3139-14-100 3397 S KIRKMAN RD  UNIT 1410 3397 S KIRKMAN RD 1410 1443 3 2 10608 4612 20130394835 292307313914100 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292307313914100 4501 Gilpin Way Orlando FL 32812 CRUZ ELVIRA F ORAEVSKY ALEXANDER 57900 73 CT SOLD TO INDIVIDUAL >$100 1999 7/24/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
24-23-30-3715-06-110 6240  CONTESSA DR  UNIT 110 6240 CONTESSA DR 110 1408 3 2 10642 4514 20130521190 302324371506110 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302324371506110 3128 24Th Ave Vancouver Bc Canada XX V6L REN MINGAHAN MENDOZA MARVIN 78800 73 CT SOLD TO INDIVIDUAL >$100 2005 9/12/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
23-24-28-2901-01-510 12556  FLORIDAYS RESORT DR  UNIT 510-A 12556 FLORIDAYS RESORT DR 510-A 957 2 2 10612 2976 20130409051 282423290101510 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/282423290101510 11209 Sw 112Th St Miami FL 33176 "MACHADO VILMA
MACHADO EDUARDO" HUA HELEN 183100 73 CT SOLD TO INDIVIDUAL >$100 2006 7/30/2013 12:00:00 AM 3903 1 CONDO HOTEL III
05-23-30-5625-28-001 1928  CONWAY RD  UNIT 1 1928 CONWAY RD 1 825 1 1 10668 7517 20130622244 302305562528001 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302305562528001 1900 Sunset Habour Dr The Annex Fl 2 Miami Beach FL 33139 DAYNITA REVOCABLE TRUST STAPLEY NEIL 5400 73 CT SOLD TO INDIVIDUAL >$100 1970 11/13/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
24-23-30-3715-03-103 8710  SARATOGA INLET DR  UNIT 103 8710 SARATOGA INLET DR 103 1248 3 2 10741 8695 20140228560 302324371503103 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/302324371503103 8214 Lake Serene Dr Orlando FL 32836 "SOTO LOPES ANTHONY K
SOTO RIVERA ANTONIO L" DIAZ NEURYS 10100 73 CT SOLD TO INDIVIDUAL >$100 2005 11/5/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
12-23-28-8179-26-108 6302  DAYSBROOK DR  UNIT 108 6302 DAYSBROOK DR 108 1665 3 2.5 10608 4391 20130394738 282312817926108 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/282312817926108 Po Box 5668 Sarasota FL 34277 KNOWLES CHARLES A MOLINARES ECHEVERRI LUCIA FERNANDA 130100 73 CT SOLD TO INDIVIDUAL >$100 2005 7/24/2013 12:00:00 AM 0400 0 CONDOMINIUM-RESIDENTIAL
23-22-29-5974-00-141 860 N ORANGE AVE  UNIT 141 860 N ORANGE AVE 141 774 1 1 10625 3152 20130457377 292223597400141 http://www.ocpafl.org/Searches/ParcelSearch.aspx/PID/292223597400141 5127 S
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB