python / typeshed

Collection of library stubs for Python, with static types
Other
4.38k stars 1.75k forks source link

PEP 612 (Parameter Specification variables) tracker #4827

Closed srittau closed 1 year ago

srittau commented 3 years ago

This issue is supposed to track when we can start to use parameter specification variables (PEP 612) in typeshed. Support is needed in released versions of:

srittau commented 3 years ago

@mrkmndz I assume pyre already supports these?

mrkmndz commented 3 years ago

Yup!

erictraut commented 3 years ago

Pyright has had full support for PEP 612 for a long time now.

srittau commented 3 years ago

@rchen152 Does pytype support PEP 612? If not, would you mind me creating a ticket that we can reference from here?

rchen152 commented 3 years ago

pytype does not yet support this. I opened https://github.com/google/pytype/issues/786.

srittau commented 3 years ago

Cc @sproshev

sproshev commented 3 years ago

Not yet planned :( Will post updates here.

sproshev commented 3 years ago

Planned: https://youtrack.jetbrains.com/issue/PY-47899

erictraut commented 3 years ago

Is there any update on this issue? Has anyone started to work on the support in mypy? Pytype?

I'm aware that full support for PEP 612 is not easy to implement, but perhaps some minimal support could be added that simply treats all ParamSpecs as Any? That would allow us to start using ParamSpec and Concatenate within typeshed without regressing the behavior for mypy users. This minimal support apparently was already implemented in pytype. It looks like @hauntsaninja made some progress on support in mypy in this PR, but there hasn't been any update in this tracking issue since Jan 2020.

Maybe we need to think about ways to support declarations that are conditioned on support for specific type checking features. Perhaps something like a _typing_features.pyi file that defines symbols like __PEP612__. Type checkers that support specific features could assume these symbols are True and use the type declarations that take advantage of these features. Type checkers that don't support the feature would assume False and fall back on alternate declarations that don't use these features.

JelleZijlstra commented 3 years ago

I think work on mypy support has stalled.

Another, more forceful, approach could be that we simply start using them in typeshed (perhaps with a liberal sprinkling of type ignores). It would then be individual type checkers' responsibilities to add support for new features, and the ecosystem can move forward without having to wait for the slowest type checker to update itself. We could start doing this say six months or a year after a PEP has been accepted.

srittau commented 3 years ago

Could we just cheat and derive ParamSpec from Any in typing_extensions, until type checkers add support? That said, I'm also fine to just start using ParamSpec and use # type: ignore. Maybe we could have a draft PR that implements ParamSpec in a file where it's useful to judge the fallout?

But in general I agree that we should be more aggressive about adding features, so as not to hold more up-to-date type checkers back.

JelleZijlstra commented 3 years ago

Maybe we could have a draft PR that implements ParamSpec in a file where it's useful to judge the fallout?

5476

srittau commented 3 years ago

ParamSpec can now be used in argument and return type positions, although # type: ignore is necessary. It's still untested whether it works as part of a Generic class.

srittau commented 3 years ago

mypy still seems to have problems with Concatenate in Callable, see #5682.

AlexWaygood commented 2 years ago

According to this and this, it seems PyCharm now supports ParamSpec 🎉

lancelote commented 2 years ago

Yeap, though there are some issues and limitations in PyCharm ParamSpec support atm. I organized the known problems in this meta ticket PY-51766. Feel free to report anything I've missed.

srittau commented 2 years ago

Now partly supported by mypy, no support for Concatenate yet.

srittau commented 2 years ago

I checkmarked pytype. While it doesn't support ParamSpec per se, it accepts it.

srittau commented 2 years ago

I think we can now use ParamSpec without limitations in typeshed.

AlexWaygood commented 2 years ago

I think we can now use ParamSpec without limitations in typeshed.

There's still a mypy bug I'm waiting on: https://github.com/python/typeshed/issues/7689#issuecomment-1111721328. I'll add it to the tracker.

mavidser commented 2 years ago

#12475 im mypy also seems to be a ParamSpec issue

Edit: realised a second too late that this was not the mypy repo

AlexWaygood commented 1 year ago

I think we can now use ParamSpec without limitations in typeshed.

There's still a mypy bug I'm waiting on: #7689 (comment). I'll add it to the tracker.

The mypy issue has now been closed!