Pathway / capacity expansion optimisation

[brynpickering]

Fixes #125

Summary of changes in this pull request to date:

• Custom math to add investsteps dimension to all math component foreach lists
• National scale example model scenario to run a dummy pathway optimisation (model = calliope.examples.national_scale(scenario="pathways"))

TODO:

• [ ] Decide on the naming of things. investsteps is very much a placeholder.
• [ ] Build a better example model to be able to do sense checks.
• [x] Move the schema update to some kind of external plugin (that is, we should be able to add initial_flow_cap and any other input params to the schema on-the-fly).
• [ ] Extend capacity and investment cost tracking between investment steps to all capacity variables.
• [ ] Improve calculation of decommissioning step. Currently reverts to nearest investment step to its decommissioning year.
• [ ] Decide whether it matters when we annualise investment costs. Currently, costs are compared to each other in a non-annualised fashion in cost_flow_cap_bounding constraint and then annualised in the cost_investment global expression. I think this is fine.
• [ ] Make capacity vintages work properly. Currently all capacity in e.g. 2030 will use the 2030 technology efficiency, when it should rather only be the new capacity that uses that. Existing capacity should use its efficiency on commissioning. Does this mean we have to do the matrix "rolling" I've implemented in flow_cap_bounding and cost_flow_cap_bounding in every single constraint?! Probably.

Reviewer checklist:

• [ ] Test(s) added to cover contribution
• [ ] Documentation updated
• [ ] Changelog updated
• [ ] Coverage maintained or improved

[codecov[bot]]

Codecov Report

Attention: 9 lines in your changes are missing coverage. Please review.

Comparison is base (ade817d) 95.83% compared to head (bfc508b) 95.60%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #541 +/- ## ========================================== - Coverage 95.83% 95.60% -0.24% ========================================== Files 24 24 Lines 3604 3620 +16 Branches 787 724 -63 ========================================== + Hits 3454 3461 +7 - Misses 86 94 +8 - Partials 64 65 +1 ``` | [Files](https://app.codecov.io/gh/calliope-project/calliope/pull/541?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=calliope-project) | Coverage Δ | | |---|---|---| | [src/calliope/preprocess/time.py](https://app.codecov.io/gh/calliope-project/calliope/pull/541?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=calliope-project#diff-c3JjL2NhbGxpb3BlL3ByZXByb2Nlc3MvdGltZS5weQ==) | `94.33% <80.00%> (-1.74%)` | :arrow_down: | | [src/calliope/backend/helper\_functions.py](https://app.codecov.io/gh/calliope-project/calliope/pull/541?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=calliope-project#diff-c3JjL2NhbGxpb3BlL2JhY2tlbmQvaGVscGVyX2Z1bmN0aW9ucy5weQ==) | `94.89% <41.66%> (-2.87%)` | :arrow_down: |

[irm-codebase]

How are pathways activated in this branch? I am trying to run the pathways override via the following code, but so far I've had little luck in getting them to run.

model = calliope.Model(national_model_path, override_dict={"config.solve.solver": "gurobi"}, scenario="pathway_setup")

Which returns the following: ModelError: Attempted to load custom math that does not exist: ['pathways']

[brynpickering]

Can you try calliope.examples.national_scale(scenario="pathways")?

On Tue, 13 Feb 2024, 09:35 Ivan Ruiz Manuel, @.***> wrote:

How are pathways activated in this branch? I am trying to run the pathways override via the following code, but so far I've had little luck in getting them to run.

model = calliope.Model(national_model_path, override_dict={"config.solve.solver": "gurobi"}, scenario="pathway_setup")

Which returns the following: ModelError: Attempted to load custom math that does not exist: ['pathways']

— Reply to this email directly, view it on GitHub https://github.com/calliope-project/calliope/pull/541#issuecomment-1940918690, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEDB63VPQMTY5WY44T7TQ63YTMXVTAVCNFSM6AAAAABCIREDHKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNBQHEYTQNRZGA . You are receiving this because you authored the thread.Message ID: @.***>

[brynpickering]

Closing this in favour of pathways being developed in https://github.com/calliope-project/calliope-pathways