search

blazegraph / database

Blazegraph High Performance Graph Database
GNU General Public License v2.0
872 stars 170 forks source link

java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded #232

Open webshark opened 2 years ago

webshark commented 2 years ago

Getting this error while running the wikidata runUpdater.sh

java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded

I don't see where I can set this config to a higher number

thompsonbry commented 2 years ago

Stack trace?

On Fri, Jul 1, 2022 at 05:55 Simon Gelfand @.***> wrote:

Getting this error while running the wikidata runUpdater.sh

java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded

I don't see where I can set this config to a higher number

— Reply to this email directly, view it on GitHub https://github.com/blazegraph/database/issues/232, or unsubscribe https://github.com/notifications/unsubscribe-auth/AATW7YE5N7UKD2HL4ARPFQLVR3TDVANCNFSM52MUWT7Q . You are receiving this because you are subscribed to this thread.Message ID: @.***>

webshark commented 2 years ago

I just have the log from the debug mode:

12:46:53.179 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933897.ttl?flavor=dump&nocache=1656679613179 12:46:53.186 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 95 ms 12:46:53.187 [update 7] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for Q111804028@1651920458@20220601124651|1703581390 12:46:53.187 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q111804028.ttl?flavor=dump&nocache=1656679613187 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.214 [update 5] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for Q94562706@1651920485@20220601124654|1703581419 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q94562706.ttl?flavor=dump&nocache=1656679613214 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 327 ms 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 106 ms 12:46:53.228 [update 1] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for Q5896227@1651920427@20220601124649|1703581359 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q5896227.ttl?flavor=dump&nocache=1656679613228 12:46:53.228 [update 0] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for Q50093816@1651920497@20220601124655|1703581428 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q50093816.ttl?flavor=dump&nocache=1656679613228 12:46:53.230 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 110 ms 12:46:53.231 [update 6] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for Q103933898@1651920437@20220601124650|1703581371 12:46:53.231 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933898.ttl?flavor=dump&nocache=1656679613231 12:46:53.269 [update 3] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 216 ms 12:46:53.271 [update 9] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 142 ms 12:46:53.279 [update 2] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 202 ms 12:46:53.281 [update 8] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 108 ms 12:46:53.298 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 111 ms 12:46:53.300 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 121 ms 12:46:53.322 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 94 ms 12:46:53.332 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.355 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 127 ms 12:46:53.395 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 180 ms 12:46:53.424 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Processing 80 IDs and 15199 statements 12:46:53.467 [main] DEBUG o.w.q.rdf.tool.rdf.client.RdfClient - Completed in 42 ms 12:46:53.606 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Sending query 4331986 bytes 12:47:03.497 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 1, will retry 12:47:08.990 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 2, will retry 12:47:16.425 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 3, will retry

thompsonbry commented 2 years ago

Ok. That is in the wikidata integration. You want to check with them. Bryan

On Fri, Jul 1, 2022 at 6:16 AM Simon Gelfand @.***> wrote:

I just have the log from the debug mode:

12:46:53.179 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933897.ttl?flavor=dump&nocache=1656679613179 12:46:53.186 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 95 ms 12:46:53.187 [update 7] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @.@20220601124651|1703581390 12:46:53.187 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q111804028.ttl?flavor=dump&nocache=1656679613187 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.214 [update 5] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @.@20220601124654|1703581419 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q94562706.ttl?flavor=dump&nocache=1656679613214 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 327 ms 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 106 ms 12:46:53.228 [update 1] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @.@20220601124649|1703581359 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q5896227.ttl?flavor=dump&nocache=1656679613228 12:46:53.228 [update 0] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @.@20220601124655|1703581428 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q50093816.ttl?flavor=dump&nocache=1656679613228 12:46:53.230 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 110 ms 12:46:53.231 [update 6] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @.***@20220601124650|1703581371 12:46:53.231 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933898.ttl?flavor=dump&nocache=1656679613231 12:46:53.269 [update 3] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 216 ms 12:46:53.271 [update 9] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 142 ms 12:46:53.279 [update 2] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 202 ms 12:46:53.281 [update 8] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 108 ms 12:46:53.298 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 111 ms 12:46:53.300 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 121 ms 12:46:53.322 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 94 ms 12:46:53.332 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.355 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 127 ms 12:46:53.395 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 180 ms 12:46:53.424 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Processing 80 IDs and 15199 statements 12:46:53.467 [main] DEBUG o.w.q.rdf.tool.rdf.client.RdfClient - Completed in 42 ms 12:46:53.606 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Sending query 4331986 bytes 12:47:03.497 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 1, will retry 12:47:08.990 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 2, will retry 12:47:16.425 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 3, will retry

— Reply to this email directly, view it on GitHub https://github.com/blazegraph/database/issues/232#issuecomment-1172338822, or unsubscribe https://github.com/notifications/unsubscribe-auth/AATW7YBMQDG3KSW53IAOFGLVR3VUNANCNFSM52MUWT7Q . You are receiving this because you commented.Message ID: @.***>

webshark commented 2 years ago

Yeah been trying to - can’t get anyone to respond. I guess I’ll just keep trying On 1 Jul 2022, 18:19 +0300, Bryan Thompson @.***>, wrote:

Ok. That is in the wikidata integration. You want to check with them. Bryan

On Fri, Jul 1, 2022 at 6:16 AM Simon Gelfand @.***> wrote:

I just have the log from the debug mode:

12:46:53.179 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933897.ttl?flavor=dump&nocache=1656679613179 12:46:53.186 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 95 ms 12:46:53.187 [update 7] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @@.|1703581390 12:46:53.187 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q111804028.ttl?flavor=dump&nocache=1656679613187 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.214 [update 5] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @@.|1703581419 12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q94562706.ttl?flavor=dump&nocache=1656679613214 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 327 ms 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 106 ms 12:46:53.228 [update 1] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @@.|1703581359 12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q5896227.ttl?flavor=dump&nocache=1656679613228 12:46:53.228 [update 0] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @@.|1703581428 12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q50093816.ttl?flavor=dump&nocache=1656679613228 12:46:53.230 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 110 ms 12:46:53.231 [update 6] DEBUG org.wikidata.query.rdf.tool.Updater - Processing data for @@.|1703581371 12:46:53.231 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf from https://www.wikidata.org/wiki/Special:EntityData/Q103933898.ttl?flavor=dump&nocache=1656679613231 12:46:53.269 [update 3] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 216 ms 12:46:53.271 [update 9] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 142 ms 12:46:53.279 [update 2] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 202 ms 12:46:53.281 [update 8] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 108 ms 12:46:53.298 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 111 ms 12:46:53.300 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 121 ms 12:46:53.322 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 94 ms 12:46:53.332 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms 12:46:53.355 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 127 ms 12:46:53.395 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 180 ms 12:46:53.424 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Processing 80 IDs and 15199 statements 12:46:53.467 [main] DEBUG o.w.q.rdf.tool.rdf.client.RdfClient - Completed in 42 ms 12:46:53.606 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Sending query 4331986 bytes 12:47:03.497 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 1, will retry 12:47:08.990 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 2, will retry 12:47:16.425 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, attempt 3, will retry

— Reply to this email directly, view it on GitHub https://github.com/blazegraph/database/issues/232#issuecomment-1172338822, or unsubscribe https://github.com/notifications/unsubscribe-auth/AATW7YBMQDG3KSW53IAOFGLVR3VUNANCNFSM52MUWT7Q . You are receiving this because you commented.Message ID: @.***>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>