Urban-Meteorology-Reading / WRF-SUEWS

WRF-SUEWS coupling project
https://wrf-suews.readthedocs.org
MIT License
5 stars 2 forks source link

QF application for WRF-SUEWS #44

Closed hamidrezaomidvar closed 4 years ago

hamidrezaomidvar commented 5 years ago

I am trying to use the high resolution data over London and population density data to run a case for London. This is to demonstrate the spatial variability of QF based on the population density variability. in the data, I can see that there are some parts of Central London with very high density such as 1400 per ha. Is this a normal value for that part?

Screenshot 2019-05-30 at 17 03 59

sunt05 commented 5 years ago

I think so.

@suegrimmond can we use the population data from Izzy to better set the population for WRF-SUEWS?

hamidrezaomidvar commented 5 years ago

The calculated QF associated with these population density values are super high and unrealistic. I am wondering if the unit of the values are not per ha. What do you think?

hamidrezaomidvar commented 5 years ago

Look at the QF in the area where we have the population density:

Screenshot 2019-05-31 at 15 36 16
suegrimmond commented 5 years ago

Yes SUEWS is expecting per ha.

https://suews-docs.readthedocs.io/en/latest/input_files/SUEWS_SiteInfo/SUEWS_AnthropogenicHeat.html?highlight=population%20density

Best wishes Sue

Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Hamidreza Omidvar notifications@github.com Sent: 31 May 2019 15:44 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

The calculated QF associated with these population density values are super high and unrealistic. I am wondering if the unit of the values are not per ha. What do you think?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXXYACJCALL6TADCBTDPYE2S5A5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODWVNGXA#issuecomment-497734492, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXW4E5GRMP7DEBO73ADPYE2S5ANCNFSM4HRGNEZA.

suegrimmond commented 5 years ago

Yes – that is just from the census data – It will need to be converted from OA to the grid – but that needs to happen either way.

Best wishes Sue

Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Ting Sun notifications@github.com Sent: 30 May 2019 17:08 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

I think so.

@suegrimmondhttps://github.com/suegrimmond can we use the population data from Izzy to better set the population for WRF-SUEWS?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXWE5NJ2TG2LOCX2DH3PX73VVA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODWSYAZQ#issuecomment-497385574, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXRTL3BDS62LT6VWIPTPX73VVANCNFSM4HRGNEZA.

sunt05 commented 5 years ago

Yes – that is just from the census data – It will need to be converted from OA to the grid – but that needs to happen either way. Best wishes Sue

OK, I'll ask Izzy for this. Thanks!

sunt05 commented 5 years ago

Look at the QF in the area where we have the population density:

Screenshot 2019-05-31 at 15 36 16

Is this the nighttime value? ~500 W m^{-2} might be possible for heavily populated area. might be interesting to get a histogram for this instant and see how other grids look like.

hamidrezaomidvar commented 5 years ago

The highest would go up to 800 during the day. The calculated values makes sense as long as the population values are correct. For example for the grid that KC station is located, population density from Helen's paper is around 204 which is what I used in our main runs. In this data set, the population density is 430 more than 2 times of this. Using very high population density makes QF very high, increases QE and QH as well. However since the purpose of these runs is just the demonstration of the coupled system ability, it should fine as long as we know that the values makes sense!

hamidrezaomidvar commented 5 years ago

I have a question. The current model for calculating QF uses the average of PopDensDayTime and PopNightTime. Therefore, the change in the population during the day and night is not fully captured. Is there anyway that we can take it into account since now we have night time and day time population density for the entire greater London?

suegrimmond commented 5 years ago

I think that would be very good to do. And we should make Ao’s modification at the same time (the change in T shape from V to U) Population

  1. Need to specify time when population profile is to be used
  2. WD/WE
  3. Work time

Can skype Best wishes Sue

Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Hamidreza Omidvar notifications@github.com Sent: 04 June 2019 15:28 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

I have a question. The current model for calculating QF uses the average of PopDensDayTime and PopNightTime. Therefore, the change in the population during the day and night is not fully captured. Is there anyway that we can take it into account since now we have night time and day time population density for the entire greater London?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXVMTOBGHKOH76ECWILPYZ3WBA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4X4VA#issuecomment-498695764, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXUXCKZRBQYDRMRFXQDPYZ3WBANCNFSM4HRGNEZA.

sunt05 commented 5 years ago

This a more SUEWS-QF issue. I have the impression that some related code has been commented in the QF model that could take the day/night variation into account.

Sent from my iPhone

On 4 Jun 2019, at 15:31, Sue Grimmond notifications@github.com wrote:

I think that would be very good to do. And we should make Ao’s modification at the same time (the change in T shape from V to U) Population

  1. Need to specify time when population profile is to be used
  2. WD/WE
  3. Work time

Can skype Best wishes Sue ============================================ Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Hamidreza Omidvar notifications@github.com Sent: 04 June 2019 15:28 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

I have a question. The current model for calculating QF uses the average of PopDensDayTime and PopNightTime. Therefore, the change in the population during the day and night is not fully captured. Is there anyway that we can take it into account since now we have night time and day time population density for the entire greater London?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXVMTOBGHKOH76ECWILPYZ3WBA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4X4VA#issuecomment-498695764, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXUXCKZRBQYDRMRFXQDPYZ3WBANCNFSM4HRGNEZA. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

hamidrezaomidvar commented 5 years ago

Ok I will take a look at this. WE and WD are already considered from the QF coefficients. Work time is also considered from the profile of human activity. I think that is why an average is used.

sunt05 commented 5 years ago

If I understand correctly, Ao’s modification seems to be incorporating LQF results via the QF_obs forcing. Translating LQF into FORTRAN might be somewhat laborious. As LQF is already in python under UMEP, a sensible way might be to connect it with SuPy. We only need to evaluate how closely LQF is bounded by QGIS.

Sent from my iPhone

On 4 Jun 2019, at 15:31, Sue Grimmond notifications@github.com wrote:

I think that would be very good to do. And we should make Ao’s modification at the same time (the change in T shape from V to U) Population

  1. Need to specify time when population profile is to be used
  2. WD/WE
  3. Work time

Can skype Best wishes Sue ============================================ Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Hamidreza Omidvar notifications@github.com Sent: 04 June 2019 15:28 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

I have a question. The current model for calculating QF uses the average of PopDensDayTime and PopNightTime. Therefore, the change in the population during the day and night is not fully captured. Is there anyway that we can take it into account since now we have night time and day time population density for the entire greater London?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXVMTOBGHKOH76ECWILPYZ3WBA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4X4VA#issuecomment-498695764, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXUXCKZRBQYDRMRFXQDPYZ3WBANCNFSM4HRGNEZA. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

suegrimmond commented 5 years ago

Yes this is SUEWS/QF Population density – will need to change wd/we Yes the profiles are how we need to do it We put the average to simplify – but it is not correct – and we were doing it coarsely – now we are not – so it should be (and can be fixed)

Best wishes Sue

Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Hamidreza Omidvar notifications@github.com Sent: 04 June 2019 15:41 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

Ok I will take a look at this. WE and WD are already considered from the QF coefficients. Work time is also considered from the profile of human activity. I think that is why an average is used.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXVUBFQALYO76OFFB2TPYZ5IRA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4ZJJQ#issuecomment-498701478, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXWU27VHYZEK7BD5P5LPYZ5IRANCNFSM4HRGNEZA.

suegrimmond commented 5 years ago

No – just changing the T realtion

Best wishes Sue

Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk W: http://micromet.reading.ac.uk/

From: Ting Sun notifications@github.com Sent: 04 June 2019 15:45 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com Cc: Sue Grimmond c.s.grimmond@reading.ac.uk; Mention mention@noreply.github.com Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

If I understand correctly, Ao’s modification seems to be incorporating LQF results via the QF_obs forcing. Translating LQF into FORTRAN might be somewhat laborious. As LQF is already in python under UMEP, a sensible way might be to connect it with SuPy. We only need to evaluate how closely LQF is bounded by QGIS.

Sent from my iPhone

On 4 Jun 2019, at 15:31, Sue Grimmond notifications@github.com<mailto:notifications@github.com> wrote:

I think that would be very good to do. And we should make Ao’s modification at the same time (the change in T shape from V to U) Population

  1. Need to specify time when population profile is to be used
  2. WD/WE
  3. Work time

Can skype Best wishes Sue

Prof Sue Grimmond Dept. of Meteorology, University of Reading, Reading, RG6 6BB T: 44 118 378 6248 – messages get emailed to me O:Met Building (#58 on map) rm:1U14 E: c.s.grimmond@reading.ac.ukmailto:c.s.grimmond@reading.ac.uk<mailto:c.s.grimmond@reading.ac.uk%3cmailto:c.s.grimmond@reading.ac.uk> W: http://micromet.reading.ac.uk/

From: Hamidreza Omidvar notifications@github.com<mailto:notifications@github.com> Sent: 04 June 2019 15:28 To: Urban-Meteorology-Reading/WRF-SUEWS WRF-SUEWS@noreply.github.com<mailto:WRF-SUEWS@noreply.github.com> Cc: Sue Grimmond c.s.grimmond@reading.ac.uk<mailto:c.s.grimmond@reading.ac.uk>; Mention mention@noreply.github.com<mailto:mention@noreply.github.com> Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

I have a question. The current model for calculating QF uses the average of PopDensDayTime and PopNightTime. Therefore, the change in the population during the day and night is not fully captured. Is there anyway that we can take it into account since now we have night time and day time population density for the entire greater London?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXVMTOBGHKOH76ECWILPYZ3WBA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4X4VA#issuecomment-498695764, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXUXCKZRBQYDRMRFXQDPYZ3WBANCNFSM4HRGNEZA. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXRR4OLXC5FEX3JSAXLPYZ5WJA5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW4ZV2Y#issuecomment-498703083, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXXYMXJCVVUDZ6FNNDDPYZ5WJANCNFSM4HRGNEZA.

hamidrezaomidvar commented 5 years ago

Here are the demonstration why using the averaged population density would lead to wrong distribution of QF. In the figure below, you see the Day time population density. As you can see, the population density in the city center is very hight. 1-Day

In the figure below, you can see the Night tie population density. As you can see, all the city center area gets empty and the surrounding have higher density.therefore, one would expect a lower QF in the city center in comparison to other parts during the night. 2-Night

Figure below is shows the average of Day and Night time population density. As you can see, because of the high value of density during the day in the city center, the average is also high in this area. 3-Avg

Now even if we use a profile to change the temporal value of QF, still in all time, the city center gives a higher value of QF while we know this is not correct (ignore outskirts area):

AH

hamidrezaomidvar commented 5 years ago

@sunt05 I have some idea how to fix this. Should I make another test branch for SUEWS repo and work on this?

suegrimmond commented 5 years ago

Yes we want to use the correct population by time -glad you agree. The profile helps with the time to switch

Best wishes Sue

Prof Sue Grimmond Meteorology, University of Reading


From: Hamidreza Omidvar notifications@github.com Sent: Wednesday, June 5, 2019 1:25:02 PM To: Urban-Meteorology-Reading/WRF-SUEWS Cc: Sue Grimmond; Mention Subject: Re: [Urban-Meteorology-Reading/WRF-SUEWS] QF application for WRF-SUEWS (#44)

Here are the demonstration why using the averaged population density would lead to wrong distribution of QF. In the figure below, you see the Day time population density. As you can see, the population density in the city center is very hight. [1-Day]https://user-images.githubusercontent.com/44125994/58954864-4428a480-8792-11e9-8e18-7b5e3bba909a.png

In the figure below, you can see the Night tie population density. As you can see, all the city center area gets empty and the surrounding have higher density.therefore, one would expect a lower QF in the city center in comparison to other parts during the night. [2-Night]https://user-images.githubusercontent.com/44125994/58954874-48ed5880-8792-11e9-89b1-8ad516a55841.png

Figure below is shows the average of Day and Night time population density. As you can see, because of the high value of density during the day in the city center, the average is also high in this area. [3-Avg]https://user-images.githubusercontent.com/44125994/58954883-4db20c80-8792-11e9-9195-74f7596c46d7.png

Now even if we use a profile to change the temporal value of QF, still in all time, the city center gives a higher value of QF while we know this is not correct (ignore outskirts area):

[AH]https://user-images.githubusercontent.com/44125994/58955868-e8abe600-8794-11e9-8e97-7b3e815584ff.gif

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/Urban-Meteorology-Reading/WRF-SUEWS/issues/44?email_source=notifications&email_token=AE2KZXRXFTJKLVUOP53CXVTPY6WB5A5CNFSM4HRGNEZKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODW7RCKQ#issuecomment-499061034, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AE2KZXVVCXJ5Z6D5VCOQ663PY6WB5ANCNFSM4HRGNEZA.

sunt05 commented 5 years ago

@sunt05 I have some idea how to fix this. Should I make another test branch for SUEWS repo and work on this?

Yes, that's what I would suggest: re a separate branch for the fix.

My concern is: should we freeze this coupled version to be consistent with 2018c? then add the possible fix to be part of 2019a?

as 2019a has several input/output changes, a fix onto 2018c means we need to do some laborious work again for 2019a. also, 2018c is already publicly released; such a fix might be somewhat confusing people.

I suggest we freeze this version but raise this problem as a known issue in the SUEWS repo and quickly finish this paper (I think we have enough to the paper per se). then we move on to the 2019a with this fix and update related projects (e.g., WRF-SUEWS, SuPy, etc.) as well.

sunt05 commented 5 years ago

Yes we want to use the correct population by time -glad you agree. The profile helps with the time to switch Best wishes Sue ------------------------- Prof Sue Grimmond Meteorology, University of Reading

@hamidrezaomidvar would Sue's suggestion be a workaround for this run using the current SUEWS (i.e., v2018c)?

hamidrezaomidvar commented 5 years ago

I mean for this paper if we want to show an application of QF, and to show how SUEWS is able to calculate the spatial and temporal distribution of QF, shouldn't we fix this first? I think definitely for fixing this, we should change SUEWS itself and not sure we could fix it in SuMin or so.

hamidrezaomidvar commented 5 years ago

@sunt05 Do you know if the parameter hr in SUEWS is from 0-23 or not? this is what is used as an input for SuMin as hour

sunt05 commented 5 years ago

I think so.