lsst-uk / somerville-operations

User issue reporting and tracking for the Somerville Cloud
0 stars 0 forks source link

Increase quotas for Gaia DMP #146

Closed Zarquan closed 5 months ago

Zarquan commented 5 months ago

In order to create a full Zeppelin/Spark deployment we need to increase the resource quotas.

GregBlow commented 5 months ago
(openstack-config) [stack@sv-admin-0 openstack-config]$ openstack quota show somerville-gaia-jade
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                | Value
                   |
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| backup-gigabytes     | -1
                   |
| backups              | -1
                   |
| cores                | 40
                   |
| fixed-ips            | -1
                   |
| floating-ips         | 50
                   |
| gigabytes            | 50000
                   |
| gigabytes_ceph-hdd   | -1
                   |
| gigabytes_ceph-ssd   | 1000
                   |
| groups               | 10
                   |
| injected-file-size   | 10240
                   |
| injected-files       | -1
                   |
| injected-path-size   | 255
                   |
| instances            | 10
                   |
| key-pairs            | -1
                   |
| location             | Munch({'cloud': '', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'ff3e2de6a0b844d581bcd4335c18d2a4', 'name': 'admin', 'domain_id': None, 'domain_name': 'Default'})}) |
| networks             | 100
                   |
| per-volume-gigabytes | -1
                   |
| ports                | 500
                   |
| project              | be227fe0300b4ce5b03f44264df615df
                   |
| project_name         | Somerville-Gaia-Jade
                   |
| properties           | 128
                   |
| ram                  | 131072
                   |
| rbac_policies        | 10
                   |
| routers              | 10
                   |
| secgroup-rules       | 100
                   |
| secgroups            | 10
                   |
| server-group-members | 10
                   |
| server-groups        | 10
                   |
| snapshots            | 20
                   |
| snapshots_ceph-hdd   | -1
                   |
| snapshots_ceph-ssd   | -1
                   |
| subnet_pools         | -1
                   |
| subnets              | 100
                   |
| volumes              | 20
                   |
| volumes_ceph-hdd     | -1
                   |
| volumes_ceph-ssd     | -1
                   |
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

Change consituted of no increase in instances, approximate quadrupling of vCPUs and approximate doubling of RAM. I don't see a problem with this based on current usage. @astrodb ?

GregBlow commented 5 months ago

note: floating-ips looks to be a factor of 10 too high. How many external facing IPs are you expecting to need please, @Zarquan , as I'd like to reduce this value while we're about this business.

astrodb commented 5 months ago

IPs aside, that all looks fine to me.

GregBlow commented 5 months ago

occurs that you might be describing quota in terms of increment rather than target value, which would be 20 instances, 210 vcpus, and 407GB RAM (would be set to 512 to make it a round number.

Can you confirm which please?

Zarquan commented 5 months ago

Request was for total target value, not increment. We only need 4 floating IP addresses. Thanks.

Zarquan commented 5 months ago

Actually, the request was based on replicating the same size of system we are testing on Cambridge Arcus. We might need a bit more if we want to experiment with setting up a Longhorn storage system on Somerville so bump the totals up a bit if we can to give us space to experiment:

DP-B21 commented 5 months ago

Hi, the quota changes have been applied:

(openstack-config) [stack@sv-admin-0 openstack-config]$ openstack quota show Somerville-Gaia-Jade
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                | Value
                        |
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| backup-gigabytes     | -1
                        |
| backups              | -1
                        |
| cores                | 180
                        |
| fixed-ips            | -1
                        |
| floating-ips         | 50
                        |
| gigabytes            | 50000
                        |
| gigabytes_ceph-hdd   | -1
                        |
| gigabytes_ceph-ssd   | 1000
                        |
| groups               | 10
                        |
| injected-file-size   | 10240
                        |
| injected-files       | -1
                        |
| injected-path-size   | 255
                        |
| instances            | 20
                        |
| key-pairs            | -1
                        |
| location             | Munch({'cloud': '', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'ff3e2de6a0b844d581bcd4335c18d2a4', 'name': 'admin', 'domain_id': None, 'domain_name': 'Default'})}) |
| networks             | 100
                        |
| per-volume-gigabytes | -1
                        |
| ports                | 500
                        |
| project              | be227fe0300b4ce5b03f44264df615df
                        |
| project_name         | Somerville-Gaia-Jade
                        |
| properties           | 128
                        |
| ram                  | 320000
                        |
| rbac_policies        | 10
                        |
| routers              | 10
                        |
| secgroup-rules       | 100
                        |
| secgroups            | 10
                        |
| server-group-members | 10
                        |
| server-groups        | 10
                        |
| snapshots            | 20
                        |
| snapshots_ceph-hdd   | -1
                        |
| snapshots_ceph-ssd   | -1
                        |
| subnet_pools         | -1
                        |
| subnets              | 100
                        |
| volumes              | 20
                        |
| volumes_ceph-hdd     | -1
                        |
| volumes_ceph-ssd     | -1
                        |
GregBlow commented 5 months ago

Hello @Zarquan , could you please test and verify.

GregBlow commented 5 months ago
(openstack-config) [stack@sv-admin-0 openstack-config]$ openstack quota show be227fe0300b4ce5b03f44264df615df
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                | Value
                                                                                            |
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| backup-gigabytes     | -1
                                                                                            |
| backups              | -1
                                                                                            |
| cores                | 180
                                                                                            |
| fixed-ips            | -1
                                                                                            |
| floating-ips         | 5
                                                                                            |
| gigabytes            | 50000
                                                                                            |
| gigabytes_ceph-hdd   | -1
                                                                                            |
| gigabytes_ceph-ssd   | 1000
                                                                                            |
| groups               | 10
                                                                                            |
| injected-file-size   | 10240
                                                                                            |
| injected-files       | -1
                                                                                            |
| injected-path-size   | 255
                                                                                            |
| instances            | 20
                                                                                            |
| key-pairs            | -1
                                                                                            |
| location             | Munch({'cloud': '', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'ff3e2de6a0b844d581bcd4335c18d2a4', 'name': 'admin', 'domain_id': None, 'domain_name': 'Default'})}) |
| networks             | 100
                                                                                            |
| per-volume-gigabytes | -1
                                                                                            |
| ports                | 500
                                                                                            |
| project              | be227fe0300b4ce5b03f44264df615df
                                                                                            |
| project_name         | Somerville-Gaia-Jade
                                                                                            |
| properties           | 128
                                                                                            |
| ram                  | 327680
                                                                                            |
| rbac_policies        | 10
                                                                                            |
| routers              | 10
                                                                                            |
| secgroup-rules       | 100
                                                                                            |
| secgroups            | 10
                                                                                            |
| server-group-members | 10
                                                                                            |
| server-groups        | 10
                                                                                            |
| snapshots            | 20
                                                                                            |
| snapshots_ceph-hdd   | -1
                                                                                            |
| snapshots_ceph-ssd   | -1
                                                                                            |
| subnet_pools         | -1
                                                                                            |
| subnets              | 100
                                                                                            |
| volumes              | 20
                                                                                            |
| volumes_ceph-hdd     | -1
                                                                                            |
| volumes_ceph-ssd     | -1
                                                                                            |
+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

Changed floating-ips value and rounded off RAM.

Zarquan commented 5 months ago

New quotas tested :+1: