Rethink `score()` and maybe make it not S3 anymore

[nikosbosse]

From Sam's review on #940:

[seabbs]

As I said in the comment I think this could be a good idea and potentially streamline the package. Happy to hear push back

[nikosbosse]

Haven't thought it through fully, but so far your suggestion sounds great to me