A compendium of parser bugs

[olafurpg]

I ran the following test on a few open source Scala projects and collected statistics on examples when the scala.meta parser throws a ParseException while scalac is happy.

https://github.com/olafurpg/scalafmt/blob/master/src/test/scala/scala/fmt/ProjectTest.scala

Here is the result:

Summary:

Successes: 27722, avg time to parse a single file 5.26 ms Skipped: 1334 (scalac not happy) Unknown failures: 1 Parse exceptions: 197

right arrow expected but ( found

• https://github.com/PredictionIO/PredictionIO/blob/0e143c77e9ff0cc7c47a5a1b4ddb85369cd224cc/examples/experimental/scala-recommendations/src/main/scala/Run.scala#L156 cols:34-35
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/compiler/scala/tools/nsc/transform/patmat/PatternMatching.scala#L68 cols:28-29
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t6022b.scala#L11 cols:36-37

  is not a valid block statement

• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/shootout/prodcons.scala#L22 cols:11-25

  ) expected but identifier found

• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/testdata/changeSignature/fromJava/ArrayToVarargs_after.scala#L8 cols:31-32
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor/src/main/scala/akka/event/Logging.scala#L1072 cols:69-70
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor/src/main/scala/akka/event/Logging.scala#L1072 cols:69-70
• https://github.com/apache/kafka/blob/c7c7f4cfa7e1c385d5f5706161572d657b495b7a/core/src/main/scala/kafka/message/ByteBufferMessageSet.scala#L267 cols:126-127
• https://github.com/apache/kafka/blob/c7c7f4cfa7e1c385d5f5706161572d657b495b7a/core/src/test/scala/other/kafka/TestLinearWriteSpeed.scala#L101 cols:172-173
• https://github.com/apache/kafka/blob/c7c7f4cfa7e1c385d5f5706161572d657b495b7a/core/src/test/scala/unit/kafka/log/LogSegmentTest.scala#L47 cols:86-87
• https://github.com/apache/kafka/blob/c7c7f4cfa7e1c385d5f5706161572d657b495b7a/core/src/test/scala/unit/kafka/message/ByteBufferMessageSetTest.scala#L146 cols:101-102
• https://github.com/apache/kafka/blob/c7c7f4cfa7e1c385d5f5706161572d657b495b7a/core/src/test/scala/unit/kafka/message/MessageCompressionTest.scala#L41 cols:106-107
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/names-defaults.scala#L388 cols:50-51

  right arrow expected but : found

• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/lang/psi/api/base/patterns/ScPattern.scala#L251 cols:18-19
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/lang/psi/api/toplevel/typedef/ScTemplateDefinition.scala#L326 cols:27-28
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/lang/psi/impl/toplevel/typedef/TypeDefinitionMembers.scala#L139 cols:21-22
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/testingSupport/test/scalatest/ScalaTestConfigurationProducer.scala#L176 cols:20-21
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor-tests/src/test/scala/akka/routing/ScatterGatherFirstCompletedSpec.scala#L29 cols:18-19
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor-tests/src/test/scala/akka/routing/ScatterGatherFirstCompletedSpec.scala#L29 cols:18-19

  macros must have explicitly specified return types

• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/macroAnnotations/src/org/jetbrains/plugins/scala/macroAnnotations/Cached.scala#L22 cols:8-22
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/macroAnnotations/src/org/jetbrains/plugins/scala/macroAnnotations/CachedInsidePsiElement.scala#L18 cols:8-22
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/macroAnnotations/src/org/jetbrains/plugins/scala/macroAnnotations/CachedMappedWithRecursionGuard.scala#L18 cols:8-22
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/macroAnnotations/src/org/jetbrains/plugins/scala/macroAnnotations/CachedWithRecursionGuard.scala#L21 cols:8-22
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/testdata/resolve2/bug3/StringInterpolatorPrefix.scala#L3 cols:10-13
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/testdata/resolve2/element/MacroDefinition.scala#L2 cols:8-9
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/partest-extras/scala/tools/partest/Util.scala#L17 cols:8-13
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/annotated-original/M_1.scala#L6 cols:8-9
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/attachments-typed-another-ident/Impls_1.scala#L17 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/attachments-typed-ident/Impls_1.scala#L17 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/macro-qmarkqmarkqmark.scala#L4 cols:8-12
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t5692a/Macros_1.scala#L5 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t5692b/Macros_1.scala#L5 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t5706.scala#L5 cols:8-14
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t5744/Macros_1.scala#L5 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t6485a/Test_2.scala#L4 cols:8-9
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t6485b/Test.scala#L5 cols:8-9
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t6516.scala#L8 cols:8-9
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t7461/Macros_1.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-abort-fresh/Macros_1.scala#L14 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-auto-duplicate/Macros_1.scala#L16 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-bundle-static/Impls_Macros_1.scala#L8 cols:10-15
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-bundle-toplevel/Impls_Macros_1.scala#L6 cols:8-13
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-bundle-whitebox-decl/Impls_Macros_1.scala#L7 cols:8-13
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-duplicate/Impls_Macros_1.scala#L28 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-expand-implicit-argument/Macros_1.scala#L22 cols:8-13
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-expand-tparams-prefix/Impls_1.scala#L36 cols:12-15
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-impl-default-params/Impls_Macros_1.scala#L19 cols:8-17
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-impl-rename-context/Impls_Macros_1.scala#L11 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-invalidret-nontypeable/Impls_Macros_1.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-invalidusage-badret/Impls_Macros_1.scala#L8 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-invalidusage-partialapplication-with-tparams/Impls_Macros_1.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-invalidusage-partialapplication/Impls_Macros_1.scala#L13 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-openmacros/Impls_Macros_1.scala#L24 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-quasiinvalidbody-c/Impls_Macros_1.scala#L8 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reflective-ma-normal-mdmi/Impls_Macros_1.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reify-basic/Macros_1.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reify-splice-outside-reify/Impls_Macros_1.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reify-staticXXX/Macros_1.scala#L29 cols:8-12
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reify-tagful-a/Macros_1.scala#L5 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reify-tagless-a/Impls_Macros_1.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-reify-unreify/Macros_1.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-settings/Impls_Macros_1.scala#L13 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-term-declared-in-annotation/Macros_2.scala#L6 cols:14-22
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-term-declared-in-implicit-class/Impls_Macros_1.scala#L17 cols:10-23
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-typecheck-implicitsdisabled/Impls_Macros_1.scala#L12 cols:8-34
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-typecheck-macrosdisabled/Impls_Macros_1.scala#L13 cols:8-31
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-typecheck-macrosdisabled2/Impls_Macros_1.scala#L13 cols:8-31
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/macro-undetparams-macroitself/Impls_Macros_1.scala#L10 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t5753_1/Impls_Macros_1.scala#L9 cols:10-13
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t5753_2/Impls_Macros_1.scala#L8 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t7008-scala-defined/Impls_Macros_2.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t7008/Impls_Macros_2.scala#L12 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t7047/Impls_Macros_1.scala#L18 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t7375b/Macros_1.scala#L11 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/typed-annotated/Macros_1.scala#L16 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/neg/macro-invalidusage-badbounds-b/Macros_Test_2.scala#L2 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-expand-default/Macros_Test_2.scala#L2 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-expand-macro-has-context-bound/Macros_Test_2.scala#L2 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-expand-named/Macros_Test_2.scala#L2 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-expand-tparams-prefix-e1/Macros_Test_2.scala#L6 cols:12-15
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-expand-tparams-prefix-f1/Macros_Test_2.scala#L6 cols:12-15
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-quasiinvalidbody-a/Macros_Test_2.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-quasiinvalidbody-b/Macros_Test_2.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-reify-array/Macros_1.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-reify-tagful-b/Macros_1.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-reify-tagless-b/Impls_Macros_1.scala#L4 cols:8-11
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/macro-term-declared-in-anonymous-explicit-import/Macros_Test_2.scala#L4 cols:27-30
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/run/t5692/Impls_Macros_1.scala#L8 cols:8-12
• https://github.com/twitter/scalding/blob/12eb0db02a97f43eedb3558ac0fb43bab6aff403/scalding-serialization/src/test/scala/com/twitter/scalding/serialization/macros/MacroOrderingProperties.scala#L32 cols:17-47

  illegal start of declaration

• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-cacheresolver/src/main/scala/com/twitter/finagle/cacheresolver/ZookeeperStateMonitor.scala#L112 cols:10-37
• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-memcached/src/main/scala/com/twitter/finagle/memcached/ZookeeperStateMonitor.scala#L112 cols:10-37

  Pattern variables must start with a lower-case letter. (SLS 8.1.1.)

• https://github.com/apache/spark/blob/f449992009becc8f7c7f06cda522b9beaa1e263c/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala#L63 cols:11-27
• https://github.com/apache/spark/blob/f449992009becc8f7c7f06cda522b9beaa1e263c/core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala#L63 cols:11-27
• https://github.com/scalaz/scalaz/blob/4d2c84479a5d2c89ed7b9a2001055fdfb9749bc8/core/src/main/scala/scalaz/Maybe.scala#L246 cols:14-17
• https://github.com/scalaz/scalaz/blob/4d2c84479a5d2c89ed7b9a2001055fdfb9749bc8/core/src/main/scala/scalaz/std/Option.scala#L136 cols:14-17

  integer number too large

• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/scalap/src/scalap/Classfiles.scala#L13 cols:27-37
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/scalap/src/scalap/scalax/rules/scalasig/ClassFileParser.scala#L112 cols:39-49
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor/src/main/scala/akka/routing/MurmurHash.scala#L38 cols:42-52
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor/src/main/scala/akka/routing/MurmurHash.scala#L38 cols:42-52
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor/src/main/scala/akka/util/LineNumbers.scala#L216 cols:19-29
• https://github.com/akka/akka/blob/a7021827c3974762143920139a72f33064dd78aa/akka-actor/src/main/scala/akka/util/LineNumbers.scala#L216 cols:19-29
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/math/Complex.scala#L452 cols:55-65
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/math/Polynomial.scala#L404 cols:20-30
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/math/SafeLong.scala#L351 cols:20-39
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/Generator.scala#L245 cols:23-33
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/MersenneTwister32.scala#L94 cols:24-34
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/MersenneTwister64.scala#L95 cols:24-43
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/Utils.scala#L128 cols:13-23
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/Well19937a.scala#L83 cols:36-46
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/Well19937c.scala#L88 cols:36-46
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/Well44497a.scala#L73 cols:60-70
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/Well44497b.scala#L73 cols:60-70
• https://github.com/non/spire/blob/8aad360e5d94576a2f70dbe8113ff05563e3a192/core/shared/src/main/scala/spire/random/rng/Well512a.scala#L80 cols:92-102
• https://github.com/pocorall/scaloid/blob/a1cf54b0ed7e1ee20d688b2ec4f73104eb931157/scaloid-util/src/main/scala/org/scaloid/util/Styles.scala#L20 cols:22-32
• https://github.com/scala-ide/scala-ide/blob/4190bb7d1f8ad9ef1648e7e96fbcfcfeae823d20/org.scala-ide.sdt.core/src/org/scalaide/core/internal/jdt/model/ScalaClassFileDescriber.scala#L14 cols:27-37
• https://github.com/scala-ide/scala-ide/blob/4190bb7d1f8ad9ef1648e7e96fbcfcfeae823d20/org.scala-ide.sdt.debug.tests/src/org/scalaide/debug/internal/classfile/ClassfileParser.scala#L17 cols:30-40
• https://github.com/scala-ide/scala-ide/blob/4190bb7d1f8ad9ef1648e7e96fbcfcfeae823d20/org.scala-ide.sdt.debug/src/org/scalaide/debug/internal/classfile/ConstantPool.scala#L136 cols:32-42
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/ir/src/main/scala/org/scalajs/core/ir/InfoSerializers.scala#L24 cols:30-40
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/javalanglib/src/main/scala/java/lang/Integer.scala#L192 cols:17-27
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/javalib/src/main/scala/java/math/BigDecimal.scala#L1563 cols:20-39
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/javalib/src/main/scala/java/math/Conversion.scala#L362 cols:41-60
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/javalib/src/main/scala/java/math/Multiplication.scala#L188 cols:40-50
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/javalib/src/main/scala/java/math/Primality.scala#L108 cols:45-55
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/javalib/src/main/scala/java/util/UUID.scala#L51 cols:16-26
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/library-aux/src/main/scala/scala/runtime/Statics.scala#L10 cols:16-26
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/library/src/main/scala/scala/scalajs/runtime/Bits.scala#L149 cols:14-24
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/library/src/main/scala/scala/scalajs/runtime/RuntimeLong.scala#L377 cols:45-55
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/require-jdk8/org/scalajs/testsuite/javalib/lang/IntegerTestOnJDK8.scala#L33 cols:27-37
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/javalib/lang/DoubleTest.scala#L169 cols:17-36
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/javalib/lang/FloatTest.scala#L173 cols:17-27
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/javalib/lang/IntegerTest.scala#L22 cols:36-46
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/javalib/lang/LongTest.scala#L22 cols:34-53
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/javalib/util/UUIDTest.scala#L18 cols:28-47
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/jsinterop/RuntimeLongTest.scala#L38 cols:20-30
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/niobuffer/ByteBufferTest.scala#L202 cols:39-49
• https://github.com/scala-js/scala-js/blob/f6542f6ff883bc6e8eaeafa9fbe3bff2fee3272d/test-suite/js/src/test/scala/org/scalajs/testsuite/typedarray/DataViewTest.scala#L110 cols:38-48
• https://github.com/scala/pickling/blob/03bb0836600ad5c6892b7849f006f22f1f908417/core/src/main/scala/scala/pickling/binary/BinaryInput.scala#L162 cols:42-61
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/compiler/scala/tools/nsc/symtab/classfile/Pickler.scala#L487 cols:29-39
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/compiler/scala/tools/nsc/typechecker/SyntheticMethods.scala#L256 cols:65-75
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/library/scala/collection/concurrent/TrieMap.scala#L247 cols:33-43
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/library/scala/collection/mutable/AnyRefMap.scala#L88 cols:35-45
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/library/scala/collection/mutable/LongMap.scala#L84 cols:33-43
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/library/scala/util/MurmurHash.scala#L89 cols:37-47
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/library/scala/util/hashing/MurmurHash3.scala#L19 cols:14-24
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/library/scala/util/hashing/package.scala#L22 cols:19-29
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/reflect/scala/reflect/internal/ClassfileConstants.scala#L13 cols:27-37
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/reflect/scala/reflect/internal/Flags.scala#L470 cols:11-30
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/scalap/scala/tools/scalap/Classfiles.scala#L13 cols:27-37
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/scalap/scala/tools/scalap/scalax/rules/scalasig/ClassFileParser.scala#L100 cols:39-49
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/jvm/signum.scala#L16 cols:65-75
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/ctries-new/Wrap.scala#L8 cols:32-42
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/ctries-old/Wrap.scala#L8 cols:32-42
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/matchintasany.scala#L3 cols:11-30
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t1423.scala#L3 cols:11-30
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/scalacheck/concurrent-map.scala#L14 cols:32-42
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/junit/scala/tools/nsc/backend/jvm/DirectCompileTest.scala#L31 cols:62-72
• https://github.com/scalafx/scalafx/blob/bccf4961e6a18901c2b9d60ed4d731744743ec99/scalafx/src/test/scala/scalafx/scene/paint/ColorSpec.scala#L107 cols:19-29
• https://github.com/scalanlp/breeze/blob/07623108af76a8757f2ab913a5e4384c11abaa92/math/src/main/scala/breeze/collection/mutable/OpenAddressHashArray.scala#L130 cols:14-24
• https://github.com/scalanlp/breeze/blob/07623108af76a8757f2ab913a5e4384c11abaa92/math/src/test/scala/breeze/io/ByteConverterBigEndian$Test.scala#L165 cols:15-34
• https://github.com/scalanlp/breeze/blob/07623108af76a8757f2ab913a5e4384c11abaa92/math/src/test/scala/breeze/io/ByteConverterLittleEndian$Test.scala#L140 cols:15-34
• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-core/src/main/scala/com/twitter/finagle/util/InetAddressUtil.scala#L37 cols:18-28
• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-mysql/src/test/scala/com/twitter/finagle/mysql/unit/RequestTest.scala#L36 cols:17-27
• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-mysql/src/test/scala/com/twitter/finagle/mysql/unit/transport/BufferTest.scala#L45 cols:14-24
• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-thrift/src/main/scala/com/twitter/finagle/thrift/SeqIdFilter.scala#L17 cols:22-32
• https://github.com/twitter/scalding/blob/12eb0db02a97f43eedb3558ac0fb43bab6aff403/scalding-core/src/test/scala/com/twitter/scalding/typed/BijectedSourceSinkTest.scala#L25 cols:36-46
• https://github.com/twitter/scalding/blob/12eb0db02a97f43eedb3558ac0fb43bab6aff403/scalding-serialization/src/main/scala/com/twitter/scalding/serialization/Hasher.scala#L32 cols:21-31
• https://github.com/twitter/scalding/blob/12eb0db02a97f43eedb3558ac0fb43bab6aff403/scalding-serialization/src/main/scala/com/twitter/scalding/serialization/MurmurHashUtils.scala#L21 cols:21-31
• https://github.com/twitter/util/blob/0c9f3a63c6b5bb5456a104795e11888b871ba378/util-core/src/main/scala/com/twitter/util/U64.scala#L94 cols:17-36
• https://github.com/twitter/util/blob/0c9f3a63c6b5bb5456a104795e11888b871ba378/util-core/src/test/scala/com/twitter/io/TempFileTest.scala#L26 cols:76-86
• https://github.com/twitter/util/blob/0c9f3a63c6b5bb5456a104795e11888b871ba378/util-core/src/test/scala/com/twitter/util/NetUtilTest.scala#L57 cols:54-64
• https://github.com/twitter/util/blob/0c9f3a63c6b5bb5456a104795e11888b871ba378/util-core/src/test/scala/com/twitter/util/U64Test.scala#L26 cols:16-35
• https://github.com/twitter/util/blob/0c9f3a63c6b5bb5456a104795e11888b871ba378/util-hashing/src/main/scala/com/twitter/hashing/Hashable.scala#L90 cols:23-42

  ; expected but identifier found

• https://github.com/ornicar/lila/blob/5d9694e3e6095c49d4959dfcec32fafda04fdd48/modules/db/src/main/api/projection.scala#L31 cols:60-61
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t8325.scala#L7 cols:21-22

  early type members are not allowed any longer. Move them to the regular body: the semantics are the same.

• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/deprecate-early-type-defs.scala#L1 cols:24-36
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/shootout/meteor.scala#L441 cols:5-23

  ; expected but <: found

• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/pending/pos/virt.scala#L3 cols:18-20

  ; expected but [ found

• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/pos/t1785.scala#L6 cols:15-16

  } expected but right arrow found

• https://github.com/ensime/ensime-server/blob/6572e8fd0e86ee4363d6a3651301320e2f4aabd6/core/src/main/scala/org/ensime/config/package.scala#L6 cols:40-42
• https://github.com/ensime/ensime-server/blob/6572e8fd0e86ee4363d6a3651301320e2f4aabd6/util/src/main/scala/org/ensime/util/list.scala#L5 cols:40-42
• https://github.com/ensime/ensime-server/blob/6572e8fd0e86ee4363d6a3651301320e2f4aabd6/util/src/main/scala/org/ensime/util/map.scala#L5 cols:40-42
• https://github.com/ensime/ensime-server/blob/6572e8fd0e86ee4363d6a3651301320e2f4aabd6/util/src/test/scala/org/ensime/util/ListSpec.scala#L5 cols:40-42
• https://github.com/ensime/ensime-server/blob/6572e8fd0e86ee4363d6a3651301320e2f4aabd6/util/src/test/scala/org/ensime/util/MapSpec.scala#L5 cols:40-42
• https://github.com/twitter/scalding/blob/12eb0db02a97f43eedb3558ac0fb43bab6aff403/scalding-core/src/test/scala/com/twitter/scalding/macros/MacroDepHygiene.scala#L19 cols:41-43

  ) expected but [ found

• https://github.com/twitter/finagle/blob/385dba9dfe7a2a8195b8ed142c1b2c9691f8765f/finagle-core/src/test/scala/com/twitter/finagle/StackTest.scala#L172 cols:32-33

  right arrow expected but \n found

• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/src/compiler/scala/tools/nsc/symtab/classfile/ClassfileParser.scala#L254 cols:59-2

  { expected but \n found

• https://github.com/sbt/sbt/blob/3bc013f19b6bc2d6a4a2d4773187582c54750904/sbt/src/sbt-test/source-dependencies/qualified-access/A.scala#L3 cols:12-2
• https://github.com/scalanlp/breeze/blob/07623108af76a8757f2ab913a5e4384c11abaa92/macros/src/main/scala/scalaxy/debug/package.scala#L44 cols:15-2

  ) expected but : found

• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/codeInspection/caseClassParamInspection/CaseClassParamInspection.scala#L24 cols:31-32
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/debugger/smartStepInto/ScalaSmartStepIntoHandler.scala#L42 cols:19-20
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/lang/psi/implicits/ImplicitCollector.scala#L294 cols:39-40
• https://github.com/JetBrains/intellij-scala/blob/431b15e6c0e6a3ca1f3ed079813ad4c44c6c79e8/src/org/jetbrains/plugins/scala/lang/refactoring/changeSignature/ScalaChangeSignatureUsageProcessor.scala#L133 cols:18-19
• https://github.com/precog/platform/blob/9655622c4969a025ac198674d06b287fa5bbb8d1/yggdrasil/src/main/scala/com/precog/yggdrasil/table/cf/Util.scala#L80 cols:46-47
• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t8395.scala#L3 cols:17-18

  ; expected but ( found

• https://github.com/scalaz/scalaz/blob/4d2c84479a5d2c89ed7b9a2001055fdfb9749bc8/core/src/main/scala/scalaz/NonEmptyList.scala#L105 cols:6-7
• https://github.com/scalaz/scalaz/blob/4d2c84479a5d2c89ed7b9a2001055fdfb9749bc8/core/src/main/scala/scalaz/PLens.scala#L139 cols:10-11

  identifier expected but true found

• https://github.com/scala/scala/blob/fe336167e7a9f68c7ea6beb80e2cbb69cea95ff8/test/files/run/t1427.scala#L6 cols:49-53

  Unknown error

• https://github.com/scalafx/scalafx-ensemble/blob/d845915d8698b6f51f7869beac712b2752fec198/src/main/scala/scalafx/ensemble/example/controls/EnsembleColorPicker.scala org.scalameta.invariants.InvariantFailedException: invariant failed: when verifying buf.apply(curr.endOffset.+(1)).==('\"') found that buf.apply(curr.endOffset.+(1)) is not equal to '\"' where buf = [C@5c2dd398

[xeno-by]

Amazing! Thank you.

[olafurpg]

Here's more info on the running time (in nanoseconds):

+------+------+------+-----+------+------+------+
|   Max|   Min|   Sum| Mean|    Q1|    Q2|    Q3|
+------+------+------+-----+------+------+------+
|5.04E8|7.71E5|9.88E9|4.8E7|5.33E6|1.18E7|3.83E7|
+------+------+------+-----+------+------+------+

Unless there's a bug in my implementation (not unlikely), the 75th percentile of files are parsed in under 48ms and the median parse time is ~12ms.

Disclaimer: I am no means a profiling expert, I suspect a library like JMH is suited to give more accurate numbers.

[olafurpg]

Minimal examples for some of the most common bugs: https://gist.github.com/olafurpg/5c4055932ee2e3403275

[xeno-by]

Everything in the minimal examples gist is now fixed and merged. Trying to publish SNAPSHOT before the plane takes off.

[olafurpg]

Remaining bugs: https://gist.github.com/olafurpg/203ffbd16cd740acb996

[xeno-by]

I think that by now I've picked all the low-hanging fruit. The rest is either \n madness or (expr)... problems.

[xeno-by]

https://oss.sonatype.org/content/repositories/releases/org/scalameta/scalameta_2.11/0.0.5-M4/

[olafurpg]

Another false parse error from this file

"""!(arr.cast[Ptr[Byte]] + sizeof[Ptr[_]]).cast[Ptr[Int]] = length
              """.parse[Stat].get
<input>:1: error: end of file expected but = found
!(arr.cast[Ptr[Byte]] + sizeof[Ptr[_]]).cast[Ptr[Int]] = length
                                                       ^
  scala.meta.internal.parsers.Reporter$class.syntaxError(Reporter.scala:17)
  scala.meta.internal.parsers.Reporter$$anon$1.syntaxError(Reporter.scala:23)
  scala.meta.internal.parsers.Reporter$class.syntaxError(Reporter.scala:18)
  scala.meta.internal.parsers.Reporter$$anon$1.syntaxError(Reporter.scala:23)
  scala.meta.internal.parsers.ScalametaParser.syntaxErrorExpected(ScalametaParser.scala:413)
  scala.meta.internal.parsers.ScalametaParser.accept(ScalametaParser.scala:419)
  scala.meta.internal.parsers.ScalametaParser$$anonfun$parseStat$1.skipStatementSeparators$1(ScalametaParser.scala:70)
  scala.meta.internal.parsers.ScalametaParser$$anonfun$parseStat$1.apply(ScalametaParser.scala:76)
  scala.meta.internal.parsers.ScalametaParser$$anonfun$parseStat$1.apply(ScalametaParser.scala:67)
  scala.meta.internal.parsers.ScalametaParser.parseRule(ScalametaParser.scala:45)
  scala.meta.internal.parsers.ScalametaParser.parseStat(ScalametaParser.scala:67)
  scala.meta.parsers.Parse$$anonfun$parseStat$1.apply(Parse.scala:14)
  scala.meta.parsers.Parse$$anonfun$parseStat$1.apply(Parse.scala:14)
  scala.meta.internal.parsers.ScalametaParser$$anon$190.apply(ScalametaParser.scala:3597)
  scala.meta.parsers.Api$XtensionParseDialectInput.parse(Api.scala:21)
  scala.meta.parsers.Api$XtensionParseInputLike.parse(Api.scala:10)
  cmd5$.<init>(Main.scala:281)

Edit. Reported in https://github.com/olafurpg/scalafmt/issues/346

[olafurpg]

The remaining remnants to close this issue

URL	details
sbt/A.scala#L2	A.scala:3: error: { expected but \n found package b ^
akka/Logging.scala#L1071	Logging.scala:1072: error: ) expected but identifier found case a: Array[] ⇒ format(t, (a map (.asInstanceOf[AnyRef]): _*)) ^
finagle/StackTest.scala#L171	StackTest.scala:172: error: ) expected but [ found assert((params ++ params2)[TestParam] == TestParam(999)) ^
breeze/package.scala#L43	package.scala:44: error: { expected but \n found package debug ^
lila/projection.scala#L30	projection.scala:31: error: ; expected but identifier found (fields map ( -> Json.toJsFieldJsValueWrapper(1))): * ^
scala/t1785.scala#L5	t1785.scala:6: error: ; expected but [ found (new t1785)Int ^
scala/t2080.scala#L11	t2080.scala:12: error: illegal combination of modifiers: override and abstract for: trait T override trait T { ^
scala/t3368.scala#L3	t3368.scala:4: error: ; expected but xml start found def x = <![CDATA[hi & bye]]> <![CDATA[red & black]]> ^
scala/t430-feb09.scala#L32	t430-feb09.scala:33: error: `val' parameters may not be call-by-name case class H(s: String)(t: =>String) ^

[xeno-by]

Running the parser and the prettyprinter on millions lines of code was an amazing idea!

[tgodzik]

I think I've got a 3 more parser errors after running scalafmt on our codebase. I hope they're relevant. Otherwise ignore me.

<input>:80: error: => expected but : found
implicit def query[T <: (_, _): TypeInfo](implicit tab: Tabulator[Iterable[T]]): Tabulator[Query[T]] = new Tabulator[Query[T]] { 

<input>:99: error: malformed xml literal
case <tr>{ cells @ _* }</tr> =>

<input>:18: error: `val' parameters may not be call-by-name
case class Dao(override val profile: JdbcProfile, db: Database)(shutdown: => Unit) extends HasProfile

If anyone needs more details on this let me know, unfortunately I can't show the exact files.

[kpbochenek]

finagle/StackTest.scala#L171 - no errors with metals 0.8.1 akka/Logging.scala#L1071 - no errors with metals 0.8.1

scala/t1785.scala#L5 - no errors scala/t2080.scala#L11 - same error as from compiler, I think it is okay scala/t3368.scala#L3 - no errors scala/t430-feb09.scala#L32 - no errors lila/projection.scala#L30 - still an issue