[WIP] PortalClient - MVP 01 - `next` rebase

[dotsdl]

Description

This PR features a new PortalClient client interface, functioning as a MVP demonstrator for the following design features:

• local client caching of COMPLETE procedure dataset records, with in-memory (transient) caching and filesystem (persistent) caching; designed around datasets being accessed far more frequently than they are added, and COMPLETE records not changing
• use of __getitem__ for BaseProcedureDataset subclasses, such as OptimizationDataset as the access pattern of choice for getting records from compute specs
• moving .data to ._data from top-level interface in Collection subclasses, treating it as an implementation detail and guiding users away from parsing it directly
• movement of other low-level methods from visible interface to _ methods
• use of progress bars via tqdm to clearly indicate server communication from an action, feedback to users on wait times
• minimal use of pandas, in particular as a container for complex objects such as OptimizationRecords, where a dict or list will do; pandas is a great tool, but can make the client cumbersome to use with low value-add in many cases

The approach taken here is informed by user feedback collected in late 2020 on the difficulty of using the current FractalClient. We hope to make the use of the client more obvious for users by virtue of its exposed methods, interaction patterns, and responsiveness, while also improving performance for repeated access of the same dataset(s).

This approach is meant to inspire discussion, and we are early enough in the process to alter course. Please do offer feedback!

Changelog description

Status

• [ ] Code base linted
• [ ] Ready to go

[lgtm-com[bot]]

This pull request introduces 9 alerts when merging b0c9a994355734d5296754d3a1bdc26f89244504 into 991b95c18b805dd16ea82566cbfadaa763cbcb7c - view on LGTM.com

new alerts:

• 7 for Unused import
• 1 for Module imports itself
• 1 for Implicit string concatenation in a list

[lgtm-com[bot]]

This pull request introduces 8 alerts when merging d2cffc3da9749845c4205927c4323c82bfc6394e into 991b95c18b805dd16ea82566cbfadaa763cbcb7c - view on LGTM.com

new alerts:

• 7 for Unused import
• 1 for Module imports itself