Regresssion in short syntax method invocation introduced in 3.3.4

majk-p commented 3 days ago

Compiler version

The attached code compiled well up to 3.3.3 and stopped compiling with 3.3.4. Compilation also fails on latest 3.5.1.

Minimized code

Also available as a gist https://gist.github.com/majk-p/b510b46cb38ecbb9bc7dd29c30a1055f

//> using dep "org.typelevel::cats-effect:3.5.4"
//> using scala "3.3.3"

import cats.Functor
import cats.effect.std.UUIDGen
import cats.syntax.all.*

import java.util.UUID

final class MyId private (val id: String)

object MyId {

  def fromUUID[F[_]: Functor: UUIDGen]: F[MyId] =
    UUIDGen[F].randomUUID.map(fromUUID)
    // UUIDGen[F].randomUUID.map(MyId.fromUUID)     // this also doesn't compile
    // UUIDGen[F].randomUUID.map(fromUUID(_))       // this on the other hand compiles
    // UUIDGen[F].randomUUID.map(MyId.fromUUID(_))  // this also compiles

  private def fromUUID(id: UUID): MyId =
    MyId(id.toString())
}

Notice how this only affects the short syntax without explicit parentheses. Adding (_) solves the issue. Changing the second method name to anything non-ambiguous also fixes the example, this means following example also works:

object MyId {

  def fromUUID[F[_]: Functor: UUIDGen]: F[MyId] =
    UUIDGen[F].randomUUID.map(otherMethodName)

  private def otherMethodName(id: UUID): MyId =
    MyId(id.toString())
}

Output

[error] ./main.scala:15:39
[error] Ambiguous given instances: both method catsFlatMapForSortedMap in object Invariant and method catsFlatMapForMap in object Invariant match type cats.Functor[F] of a context parameter of method fromUUID in object MyId
[error]     UUIDGen[F].randomUUID.map(fromUUID)
[error]

Expectation

Compiles with no issues

Additional research

I found the great bisect tool in compiler sources and run it against my example code. Here's the output:

6f33c6128df2168f4e9fb3911491f466f6fe9f90 is the first bad commit
commit 6f33c6128df2168f4e9fb3911491f466f6fe9f90
Author: Wojciech Mazur <wmazur@virtuslab.com>
Date:   Fri Jun 28 18:20:54 2024 +0200

    error when reading class file with unknown newer jdk version

    [Cherry-picked f430e449869d9d6b6cf05373086f3d52b0a11805][modified]

 .../dotc/core/classfile/ClassfileConstants.scala   |  1 +
 .../dotc/core/classfile/ClassfileParser.scala      | 34 +++++++++++++---------
 2 files changed, 21 insertions(+), 14 deletions(-)
bisect found first bad commit
Previous HEAD position was 6f33c6128d error when reading class file with unknown newer jdk version
HEAD is now at e76de95ff8 Release 3.3.4

This is how I configured the bisect tool:

scala-cli project/scripts/bisect.scala -- --releases 3.3.2-RC1-bin-20230724-ce1ce99-NIGHTLY...3.3.5-RC1-bin-20240712-4eb7668-NIGHTLY compile https://gist.github.com/majk-p/b510b46cb38ecbb9bc7dd29c30a1055f

It looks like https://github.com/scala/scala3/pull/20862 is the PR that introduced the regression. CC: @WojciechMazur @bishabosha

WojciechMazur commented 3 days ago

Thank you for the bug report!

Bisect on main points to 0337efdc63095209d2de6f6fe57ea346def7e2b5 Last good release: 3.4.1-RC1-bin-20240210-6efcdba-NIGHTLY First bad release: 3.4.1-RC1-bin-20240212-c529a48-NIGHTLY

I'm preparing a self-contained minimization

WojciechMazur commented 3 days ago

Self contained minimization with the same error:

//> using options -Ykind-projector:underscores

import java.util.UUID

object MyId:
  def fromUUID[F[_]: Functor: UUIDGen]: F[String] =
    toFunctorOps(UUIDGen[F].randomUUID).map(fromUUID) // error
  private def fromUUID(id: UUID): String = ???

object UUIDGen:
  def apply[F[_]](implicit ev: UUIDGen[F]): UUIDGen[F] = ev
trait UUIDGen[F[_]]:
  def randomUUID: F[UUID]

trait FlatMap[F[_]] extends Functor[F]
trait Functor[F[_]] extends Invariant[F]
trait Invariant[F[_]]
object Invariant:
  implicit def catsFlatMapForMap[K]: FlatMap[Map[K, _]] = ???
  implicit def catsFlatMapForSortedMap[K]: FlatMap[scala.collection.SortedMap[K, _]] = ???

implicit def toFunctorOps[F[_], A](target: F[A])(implicit tc: Functor[F]): Ops[F, A] { type TypeClassType = Functor[F]} = 
  new Ops[F, A] { type TypeClassType = Functor[F] }

trait Ops[F[_], A] {
  type TypeClassType <: Functor[F]
  def map[B](f: A => B): F[B] = ???
}

The clue of the issue seems to be fact that Functor context bound parameter is being ignored, thus the issue can be further minimized to

type UUID = String
object MyId:
  def fromUUID[F[_]: Functor: UUIDGen]: F[String] =
    toFunctorOps(UUIDGen[F].randomUUID).map(fromUUID) // error
  private def fromUUID(id: UUID): String = ???

object UUIDGen:
  def apply[F[_]](implicit ev: UUIDGen[F]): UUIDGen[F] = ev
trait UUIDGen[F[_]]:
  def randomUUID: F[UUID]

trait Functor[F[_]]
implicit def toFunctorOps[F[_], A](target: F[A])(implicit tc: Functor[F]): Ops[F, A] { type TypeClassType = Functor[F]} = 
  new Ops[F, A] { type TypeClassType = Functor[F] }

trait Ops[F[_], A] {
  type TypeClassType <: Functor[F]
  def map[B](f: A => B): F[B] = ???
}

Failing with

[error] ./test_selfcontained.scala:4:53
[error] No given instance of type Functor[F] was found for a context parameter of method fromUUID in object MyId
[error] 
[error] where:    F is a type variable with constraint <: [R] =>> String => R
[error]     toFunctorOps(UUIDGen[F].randomUUID).map(fromUUID)
[error]                                                     ^

scala / scala3