search

adeze / starschema-bigquery-jdbc

Automatically exported from code.google.com/p/starschema-bigquery-jdbc
0 stars 1 forks source link

No Such column returned in response #14

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. Create a BQ view which returns the columns with the postfixes for the 
dynamic fields.
2. Create a DIH with query: SELECT * FROM [spree.orders_v]
3. Run full import in solr admin

What is the expected output? What do you see instead?
For the import to complete. I'm currently getting:
Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: 
org.apache.solr.handler.dataimport.DataImportHandlerException: Error reading 
data from database Processing Document # 1
    at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:271)
    at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:416)
    at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:480)
    at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:461)
Caused by: java.lang.RuntimeException: 
org.apache.solr.handler.dataimport.DataImportHandlerException: Error reading 
data from database Processing Document # 1
    at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:417)
    at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:330)
    at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:232)
    ... 3 more
Caused by: org.apache.solr.handler.dataimport.DataImportHandlerException: Error 
reading data from database Processing Document # 1
    at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:71)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.getARow(JdbcDataSource.java:360)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.access$700(JdbcDataSource.java:258)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.next(JdbcDataSource.java:298)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.next(JdbcDataSource.java:290)
    at org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityProcessorBase.java:117)
    at org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:75)
    at org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:243)
    at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:476)
    at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:415)
    ... 5 more
Caused by: net.starschema.clouddb.jdbc.BQSQLException: No Such column labeled: 
types
    at net.starschema.clouddb.jdbc.BQForwardOnlyResultSet.findColumn(BQForwardOnlyResultSet.java:334)
    at net.starschema.clouddb.jdbc.BQForwardOnlyResultSet.getObject(BQForwardOnlyResultSet.java:997)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.getARow(JdbcDataSource.java:320)
    ... 13 more

What version of the product are you using? On what operating system?
BQ and solr 4.10.0

Please provide any additional information below.
Not much, it's a very basic import not working.

Original issue reported on code.google.com by j...@dotmodus.com on 2 Oct 2014 at 12:23

GoogleCodeExporter commented 9 years ago 
I noticed the Solr log also has the following warning:
2014/10/03, 10:12:59 AM     WARN    JdbcDataSource  Error reading data

net.starschema.clouddb.jdbc.BQSQLException: No Such column labeled: order_number
    at net.starschema.clouddb.jdbc.BQForwardOnlyResultSet.findColumn(BQForwardOnlyResultSet.java:334)
    at net.starschema.clouddb.jdbc.BQForwardOnlyResultSet.getObject(BQForwardOnlyResultSet.java:997)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.getARow(JdbcDataSource.java:320)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.access$700(JdbcDataSource.java:258)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.next(JdbcDataSource.java:298)
    at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.next(JdbcDataSource.java:290)
    at org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityProcessorBase.java:117)
    at org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:75)
    at org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:243)
    at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:476)
    at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:415)
    at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:330)
    at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:232)
    at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:416)
    at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:480)
    at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:461)

My data-config for the import look like:
<dataConfig>

    <dataSource
        name="bq"
        type="JdbcDataSource"
        driver="net.starschema.clouddb.jdbc.BQDriver"
        url="jdbc:BQDriver:media%2D24"
        withServiceAccount="true"
        user="479897838659-sfkvh34qr77cu08aqcrq15mgec5@developer.gserviceaccount.com"
        password="/Users/jaco/projects/media24/etl/Media24-2504a86bc2ee.p12"
    />

    <document>
        <entity
            name="order"
            dataSource="bq"
            query="SELECT order_number FROM [spree.orders]"
        />
    </document>

</dataConfig>

Original comment by j...@dotmodus.com on 3 Oct 2014 at 8:14