search

chrisamccoy / google-refine

Automatically exported from code.google.com/p/google-refine
Other
0 stars 1 forks source link

Bug(s): IllegalStateException: Committed, XML Importer / JSON #522

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 

What steps will reproduce the problem?
1. Load json mbox file (converted from pst)
2. I think this may have to relate to attachments that were encoded in the 
jason and could have large encoded values in a cell.
3. xml import errors: json tokenizing

What is the expected output? What do you see instead?

application log:
=====================

java.lang.IllegalStateException: Committed
        at org.mortbay.jetty.Response.resetBuffer(Response.java:1024)
        at javax.servlet.ServletResponseWrapper.resetBuffer(ServletResponseWrapp
er.java:202)
        at org.mortbay.servlet.GzipFilter$GZIPResponseWrapper.resetBuffer(GzipFi
lter.java:310)
        at org.mortbay.servlet.GzipFilter$GZIPResponseWrapper.sendError(GzipFilt
er.java:319)
        at edu.mit.simile.butterfly.Butterfly.error(Butterfly.java:1020)
        at edu.mit.simile.butterfly.Butterfly.service(Butterfly.java:528)
        at com.google.refine.RefineServlet.service(RefineServlet.java:200)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511
)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet
Handler.java:1166)
        at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)

        at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet
Handler.java:1157)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:3
88)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.jav
a:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:1
82)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:7
65)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)

        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:1
52)
        at org.mortbay.jetty.Server.handle(Server.java:326)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:54
2)
        at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpCo
nnection.java:923)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:547)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
        at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.
java:228)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
15:25:52.171 [                   refine] POST /command/core/get-importing-config
uration (491ms)
15:25:52.265 [                   refine] GET /command/core/get-all-project-metad
ata (94ms)
15:25:52.323 [                   refine] GET /command/core/get-version (58ms)
15:37:14.806 [                   refine] POST /command/core/create-importing-job
 (682483ms)
15:37:14.893 [                   refine] POST /command/core/importing-controller
 (87ms)
15:37:15.871 [                   refine] POST /command/core/get-importing-job-st
atus (978ms)
15:38:08.852 [                   refine] POST /command/core/get-importing-job-st
atus (52981ms)
15:38:09.514 [                   refine] POST /command/core/importing-controller
 (662ms)
15:39:30.062 [                   refine] POST /command/core/importing-controller
 (80548ms)
15:39:30.846 [       XmlImportUtilities] Exception from XML parse (784ms)
com.google.refine.importers.tree.TreeReaderException: No more Json Tokens in str
eam
        at com.google.refine.importers.JsonImporter$JSONTreeReader.next(JsonImpo
rter.java:313)
        at com.google.refine.importers.tree.XmlImportUtilities.importTreeData(Xm
lImportUtilities.java:250)
        at com.google.refine.importers.tree.TreeImportingParserBase.parseOneFile
(TreeImportingParserBase.java:203)
        at com.google.refine.importers.JsonImporter.parseOneFile(JsonImporter.ja
va:196)
        at com.google.refine.importers.tree.TreeImportingParserBase.parseOneFile
(TreeImportingParserBase.java:125)
        at com.google.refine.importers.tree.TreeImportingParserBase.parse(TreeIm
portingParserBase.java:82)
        at com.google.refine.importing.ImportingUtilities.previewParse(Importing
Utilities.java:866)
        at com.google.refine.importing.DefaultImportingController.doUpdateFormat
AndOptions(DefaultImportingController.java:185)
        at com.google.refine.importing.DefaultImportingController.doPost(Default
ImportingController.java:93)
        at com.google.refine.commands.importing.ImportingControllerCommand.doPos
t(ImportingControllerCommand.java:62)
        at com.google.refine.RefineServlet.service(RefineServlet.java:177)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511
)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet
Handler.java:1166)
        at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)

        at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet
Handler.java:1157)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:3
88)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.jav
a:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:1
82)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:7
65)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)

        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:1
52)
        at org.mortbay.jetty.Server.handle(Server.java:326)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:54
2)
        at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnectio
n.java:938)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:755)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
        at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.
java:228)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
15:39:30.861 [                   refine] POST /command/core/get-models (15ms)
15:39:30.868 [                   refine] POST /command/core/get-rows (7ms)
15:40:46.020 [                   refine] POST /command/core/importing-controller
 (75152ms)
15:40:46.653 [       XmlImportUtilities] Exception from XML parse (633ms)
com.google.refine.importers.tree.TreeReaderException: No more Json Tokens in str
eam
        at com.google.refine.importers.JsonImporter$JSONTreeReader.next(JsonImpo
rter.java:313)
        at com.google.refine.importers.tree.XmlImportUtilities.importTreeData(Xm
lImportUtilities.java:250)
        at com.google.refine.importers.tree.TreeImportingParserBase.parseOneFile
(TreeImportingParserBase.java:203)
        at com.google.refine.importers.JsonImporter.parseOneFile(JsonImporter.ja
va:196)
        at com.google.refine.importers.tree.TreeImportingParserBase.parseOneFile
(TreeImportingParserBase.java:125)
        at com.google.refine.importers.tree.TreeImportingParserBase.parse(TreeIm
portingParserBase.java:82)
        at com.google.refine.importing.ImportingUtilities.previewParse(Importing
Utilities.java:866)
        at com.google.refine.importing.DefaultImportingController.doUpdateFormat
AndOptions(DefaultImportingController.java:185)
        at com.google.refine.importing.DefaultImportingController.doPost(Default
ImportingController.java:93)
        at com.google.refine.commands.importing.ImportingControllerCommand.doPos
t(ImportingControllerCommand.java:62)
        at com.google.refine.RefineServlet.service(RefineServlet.java:177)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511
)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet
Handler.java:1166)
        at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)

        at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servlet
Handler.java:1157)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:3
88)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.jav
a:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:1
82)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:7
65)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)

        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:1
52)
        at org.mortbay.jetty.Server.handle(Server.java:326)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:54
2)
        at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnectio
n.java:938)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:755)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
        at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.
java:228)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
15:40:46.666 [                   refine] POST /command/core/get-models (13ms)
15:40:46.674 [                   refine] POST /command/core/get-rows (8ms)
15:40:52.783 [                   refine] POST /command/core/importing-controller
 (6109ms)
15:40:53.818 [                   refine] POST /command/core/get-importing-job-st
atus (1035ms)
15:40:54.370 [       XmlImportUtilities] Exception from XML parse (552ms)
com.google.refine.importers.tree.TreeReaderException: No more Json Tokens in str
eam
        at com.google.refine.importers.JsonImporter$JSONTreeReader.next(JsonImpo
rter.java:313)
        at com.google.refine.importers.tree.XmlImportUtilities.importTreeData(Xm
lImportUtilities.java:250)
        at com.google.refine.importers.tree.TreeImportingParserBase.parseOneFile
(TreeImportingParserBase.java:203)
        at com.google.refine.importers.JsonImporter.parseOneFile(JsonImporter.ja
va:196)
        at com.google.refine.importers.tree.TreeImportingParserBase.parseOneFile
(TreeImportingParserBase.java:125)
        at com.google.refine.importers.tree.TreeImportingParserBase.parse(TreeIm
portingParserBase.java:82)
        at com.google.refine.importing.ImportingUtilities.createProjectSynchrono
usly(ImportingUtilities.java:927)
        at com.google.refine.importing.ImportingUtilities.access$200(ImportingUt
ilities.java:87)
        at com.google.refine.importing.ImportingUtilities$7.run(ImportingUtiliti
es.java:902)
15:40:54.790 [                   refine] POST /command/core/get-importing-job-st
atus (420ms)
15:40:54.799 [                   refine] POST /command/core/cancel-importing-job
 (9ms)
15:40:55.839 [                   refine] GET /command/core/get-preference (1040m
s)
15:40:55.929 [                   refine] GET /command/core/get-project-metadata
(90ms)
15:40:55.974 [                   refine] GET /command/core/get-models (45ms)
15:40:56.125 [                   refine] POST /command/core/get-rows (151ms)
15:40:56.141 [                   refine] GET /command/core/get-history (16ms)
15:40:56.972 [                   refine] GET /command/core/get-history (831ms)
15:42:13.460 [                   refine] POST /command/core/text-transform (7648
8ms)
15:42:13.550 [                   refine] GET /command/core/get-history (90ms)
15:42:13.588 [                   refine] POST /command/core/get-rows (38ms)
15:42:14.326 [                   refine] POST /command/core/compute-facets (738m
s)
15:42:40.320 [                   refine] POST /command/core/text-transform (2599
4ms)
15:42:40.413 [                   refine] GET /command/core/get-history (93ms)
15:42:40.439 [                   refine] POST /command/core/get-rows (26ms)
15:42:41.136 [                   refine] POST /command/core/compute-facets (697m
s)

What version of Google Refine are you using?

What operating system and browser are you using?
windows 2008 r2 sp1 - w/ hyper-v

I didn't attempt to replicate the bug on ubuntu, or suse.

Is this problem specific to the type of browser you're using or it happens
in all the browsers you tried?

firefox 9
chromium

haven't tried it in IE due to security restrictions.

Please provide any additional information below.

-- Randall Amiel

Original issue reported on code.google.com by randy123...@gmail.com on 21 Jan 2012 at 1:21

GoogleCodeExporter commented 8 years ago 
Did you mean to attach a file which can be used to reproduce the problem?  Did 
your import fail?

Issue 416 and issue 513 cover the two exceptions that you saw, both of which 
were non-fatal in other contexts, which is why I'm wondering if the data 
actually got imported.  Note also that the initial exception occurred 15 
minutes before the others, likely at session startup.

Original comment by tfmorris on 26 Jan 2012 at 9:07

GoogleCodeExporter commented 8 years ago 
No response from user.  Closing, but feel free to reopen if you can provide 
additional information.

Original comment by tfmorris on 18 Sep 2012 at 8:02