Background Scanning of the Project

Richard-CIV commented 1 year ago

Apache NetBeans version

Apache NetBeans 15

What happened

On startup, after the project opens it scans all the code to map all the code to enable jumps to called functions and function lookup.

We have large project and have just migrated to PHP 8.1 hence the move to NB 15. When the project opens it takes a very long time to scan the code and eventually errors with a GC overflow. This leaves me with no intellisense or click through to called functions and is slowing my work rate. I have tried clearing the cache and this made no difference.

I suspect it is failing in the javascript parts of the project. The public folder contains all the distributable javascript. Is there any way the background scanning process can be configured to omit the Public Folder.

How to reproduce

No response

Did this work correctly in an earlier version?

Apache NetBeans 12.6 or earlier

Operating System

Windows 11

JDK

Don't know

Apache NetBeans packaging

Apache NetBeans provided installer

Anything else

This occurs every time I open Netbeans, sometimes it hangs with a white flashing window. My PC has an Intel I7 processor and 16GB of ram.

Are you willing to submit a pull request?

No

Code of Conduct

Yes

rickware commented 1 year ago

Same with me:

Product Version: Apache NetBeans IDE 15 Java: 18.0.2; OpenJDK 64-Bit Server VM 18.0.2+9 Runtime: OpenJDK Runtime Environment 18.0.2+9 System: Windows 11 version 10.0 running on amd64; UTF-8; pt_BR (nb) User directory: C:\Users\ricar\AppData\Roaming\NetBeans\15 Cache directory: C:\Users\ricar\AppData\Local\NetBeans\Cache\15

java.lang.IllegalArgumentException: newPosition > limit: (1 > 0) at java.base/java.nio.Buffer.createPositionException(Buffer.java:341) at java.base/java.nio.Buffer.position(Buffer.java:316) at java.base/java.nio.ByteBuffer.position(ByteBuffer.java:1516) at java.base/java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:622) at org.netbeans.api.queries.FileEncodingQuery$ProxyCharset$ProxyDecoder.decodeLoop(FileEncodingQuery.java:191) at java.base/java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:585) Caused: java.nio.charset.CoderMalfunctionError at java.base/java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:587) at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:305) at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) at java.base/java.io.InputStreamReader.read(InputStreamReader.java:176) at org.netbeans.modules.parsing.api.Source.createSnapshot(Source.java:360) at org.netbeans.modules.parsing.impl.SourceCache.createSnapshot(SourceCache.java:157) at org.netbeans.modules.parsing.impl.SourceCache.getSnapshot(SourceCache.java:132) at org.netbeans.modules.parsing.api.ResultIterator.getSnapshot(ResultIterator.java:86) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Work$1T.run(RepositoryUpdater.java:3153) at org.netbeans.modules.parsing.impl.TaskProcessor.callUserTask(TaskProcessor.java:586) at org.netbeans.modules.parsing.api.ParserManager$MultiUserTaskAction.run(ParserManager.java:169) at org.netbeans.modules.parsing.api.ParserManager$MultiUserTaskAction.run(ParserManager.java:140) at org.netbeans.modules.parsing.impl.TaskProcessor$2.call(TaskProcessor.java:181) at org.netbeans.modules.parsing.impl.TaskProcessor$2.call(TaskProcessor.java:178) at org.netbeans.modules.masterfs.filebasedfs.utils.FileChangedManager.priorityIO(FileChangedManager.java:153) at org.netbeans.modules.masterfs.providers.ProvidedExtensions.priorityIO(ProvidedExtensions.java:335) at org.netbeans.modules.parsing.nb.DataObjectEnvFactory.runPriorityIO(DataObjectEnvFactory.java:118) at org.netbeans.modules.parsing.impl.Utilities.runPriorityIO(Utilities.java:67) at org.netbeans.modules.parsing.impl.TaskProcessor.runUserTask(TaskProcessor.java:178) at org.netbeans.modules.parsing.api.ParserManager.parse(ParserManager.java:85) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Work.indexEmbedding(RepositoryUpdater.java:3268) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Work.doIndex(RepositoryUpdater.java:2861) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Work.lambda$index$0(RepositoryUpdater.java:2626) at org.netbeans.modules.parsing.impl.indexing.errors.TaskCache.refreshTransaction(TaskCache.java:540) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Work.index(RepositoryUpdater.java:2625) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$AbstractRootsWork.lambda$scanSource$3(RepositoryUpdater.java:5735) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.lambda$runInContext$4(RepositoryUpdater.java:2119) at org.openide.util.lookup.Lookups.executeWith(Lookups.java:279) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.runInContext(RepositoryUpdater.java:2117) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.runInContext(RepositoryUpdater.java:2098) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater.access$1400(RepositoryUpdater.java:135) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$AbstractRootsWork.scanSource(RepositoryUpdater.java:5770) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$AbstractRootsWork.scanSources(RepositoryUpdater.java:5443) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$RootsWork.getDone(RepositoryUpdater.java:5075) [catch] at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Work.doTheWork(RepositoryUpdater.java:3452) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Task._run(RepositoryUpdater.java:6197) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Task.access$3400(RepositoryUpdater.java:5855) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Task$2.lambda$call$0(RepositoryUpdater.java:6116) at org.openide.util.lookup.Lookups.executeWith(Lookups.java:279) at org.netbeans.modules.parsing.impl.RunWhenScanFinishedSupport.performScan(RunWhenScanFinishedSupport.java:83) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Task$2.call(RepositoryUpdater.java:6116) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Task$2.call(RepositoryUpdater.java:6112) at org.netbeans.modules.masterfs.filebasedfs.utils.FileChangedManager.priorityIO(FileChangedManager.java:153) at org.netbeans.modules.masterfs.providers.ProvidedExtensions.priorityIO(ProvidedExtensions.java:335) at org.netbeans.modules.parsing.nb.DataObjectEnvFactory.runPriorityIO(DataObjectEnvFactory.java:118) at org.netbeans.modules.parsing.impl.Utilities.runPriorityIO(Utilities.java:67) at org.netbeans.modules.parsing.impl.indexing.RepositoryUpdater$Task.run(RepositoryUpdater.java:6112) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.openide.util.RequestProcessor$Task.run(RequestProcessor.java:1418) at org.netbeans.modules.openide.util.GlobalLookup.execute(GlobalLookup.java:45) at org.openide.util.lookup.Lookups.executeWith(Lookups.java:278) at org.openide.util.RequestProcessor$Processor.run(RequestProcessor.java:2033)

neilcsmith-net commented 1 year ago

Java: 18.0.2; OpenJDK 64-Bit Server VM 18.0.2+9 ... System: Windows 11 version 10.0 running on amd64; UTF-8; pt_BR (nb) ... Cache directory: C:\Users\ricar\AppData\Local\NetBeans\Cache\15

@rickware not sure if that is the same issue. Have you used that same installation with a different JDK and/or enabled UTF-8 since originally running it? Perhaps try deleting that cache folder and trying again? I haven't dug into the stack trace, but I wonder if either you have a file with a wrong charset or something is cached with the wrong charset.

Richard-CIV commented 1 year ago

Good Morning

I have tried deleting the Cache folder contents and that didn’t solve the problem and I am fairly sure we haven’t got any code that is non UTF8 as it the same code from prior upgrading to PHP 8.1. Also I don’t think we use Java (certainly we haven’t written anything in Java) we only write some elements in javascript.

Kind regards,

Richard Bevan Development Manager

The Technology Forge Limited (Part of the Civica Group) Email: @.**@.>

Websitehttp://www.technologyforge.com/ | Twitterhttp://www.twitter.com/tech_forge | LinkedInhttp://www.linkedin.com/company/the-technology-forge | TF User Communityhttp://community.technologyforge.com/

Main Line: 0113 288 2575 | Help Desk: 0113 288 2595 | Sales: 0113 288 2588

The Technology Forge Limited, Company Registration No: 02293004 | Place of Registration: Wetherby, West Yorkshire | VAT No: 492 4963 07 This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please advise the sender then delete. Please note that any views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. Finally, the recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.

From: Neil C Smith @.> Sent: 20 November 2022 10:39 To: apache/netbeans @.> Cc: Richard Bevan @.>; Author @.> Subject: Re: [apache/netbeans] Background Scanning of the Project (Issue #4967)

Java: 18.0.2; OpenJDK 64-Bit Server VM 18.0.2+9 ... System: Windows 11 version 10.0 running on amd64; UTF-8; pt_BR (nb) ... Cache directory: C:\Users\ricar\AppData\Local\NetBeans\Cache\15

@rickwarehttps://github.com/rickware not sure if that is the same issue. Have you used that same installation with a different JDK and/or enabled UTF-8 since originally running it? Perhaps try deleting that cache folder and trying again? I haven't dug into the stack trace, but I wonder if either you have a file with a wrong charset or something is cached with the wrong charset.

— Reply to this email directly, view it on GitHubhttps://github.com/apache/netbeans/issues/4967#issuecomment-1321095155, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A4GGSV4ANKN7CUZVCDKWHFDWJH5VRANCNFSM6AAAAAASAVF6VY. You are receiving this because you authored the thread.Message ID: @.**@.>>

UhligIT commented 1 year ago

Related Issue here: https://github.com/apache/netbeans/issues/4762

apache / netbeans