Generate persons and households seed

KyTriNguyenMonash commented 2 years ago

The seed data is obtained from Census and HTS data which were found in task #1. It should be representative of the modelling region and must contain all of the specified control variables. Another point to take into consideration is that the households seed should contain the weight field as PopulationSim will try to assign weight as close to initial weight as possible. Furthermore, the data set (HTS) might contain 3 or 5 years of households records, where each weights might be different. Therefore, you have to make sure your weight are added up to the total number of households for the reference year.

Tasks:

[x] Explore what attributes are currently available in the HTS.
[x] Create the persons seed that should have these minimum attributes: person id, age, gender, labour status and households id
[x] Create the households seed that should have these minimum attributes: households id, households size, households weight, car availability and zonal location.
[x] Verify that each households and person is unique and correlated between persons and households seed files.
[x] Create the driver script that will invoke this process using cmd arguments supplied by the user.

bobkatla commented 2 years ago

This is almost done. The example results can be found in the attached files. However I am not really sure about the last task. The driver script is ready but I am not sure what arguments should the user input in? h_test_seed.csv p_test_seed.csv

KyTriNguyenMonash commented 2 years ago

Can you please specify the exact data that is used to generate these seeds? Another small thing to consider here is format of some attribute like:

labor status: Can you further divide paid employed into full time or part time. Besides, I can't find unemployed people in the dataset. Is this correct?
age: can you make this into a specific number ?
carAvailablity: you can just leave this as yes or no for each households.

Other than that, I think the seeds files are fine atm, we can further validate the total number of households and persons after obtaining the control totals.

The driver script is needed so that me and other people can easily reproduce your process to create these dataset. Can you please upload what you do in a merge request so I can review and then we can develop this mono repo as you progress?

bobkatla commented 2 years ago

Hi Tri,

I have made the requested changes with a pull request, please check and if it's alright please merge.

Bob

KyTriNguyenMonash commented 2 years ago

Hi Bob,

It's not ready yet but enough for you to proceed on other tasks. Can you please start other tasks (3 or 4) and I will try to adjust and upload task 2 this week.

Regards,

Tri

On Mon, 27 Jun 2022 at 21:02, Duc Minh La @.***> wrote:

Hi Tri,

I have made the requested changes with a pull request, please check and if it's alright please merge.

Bob

— Reply to this email directly, view it on GitHub https://github.com/KyTriNguyenMonash/achilles/issues/3#issuecomment-1167209169, or unsubscribe https://github.com/notifications/unsubscribe-auth/AM4UUZDEMBEPPTB7JRF5PRTVRGC4TANCNFSM5ZFVQFOA . You are receiving this because you authored the thread.Message ID: @.***>

-- Ky Tri Nguyen Ph.D. Candidate, Intelligent Transport Systems

Institute of Transport Studies Department of Civil Engineering, Faculty of Engineering Monash University Room 112, Building 36 Clayton VIC 3800 Australia

KyTriNguyenMonash commented 2 years ago

@bobkatla can you please also share with me the data source and where to find them?

bobkatla commented 2 years ago

@KyTriNguyenMonash This is the link: https://drive.google.com/drive/folders/16-MSqeFtMXx843kdyICShRKSMSDlWKLQ?usp=sharing You should be able to access it, if any issue please let me know

KyTriNguyenMonash commented 2 years ago

Hi Bob,

I have uploaded a sample of what I want the work to look like. Please continue of other tasks and we will go back to fix this seed files if needed.

Regards,

Tri

On Wed, 29 Jun 2022 at 21:48, Duc Minh La @.***> wrote:

@KyTriNguyenMonash https://github.com/KyTriNguyenMonash This is the link: https://drive.google.com/drive/folders/16-MSqeFtMXx843kdyICShRKSMSDlWKLQ?usp=sharing You should be able to access it, if any issue please let me know

— Reply to this email directly, view it on GitHub https://github.com/KyTriNguyenMonash/achilles/issues/3#issuecomment-1169884216, or unsubscribe https://github.com/notifications/unsubscribe-auth/AM4UUZFN5YXT5JEIY2ASBK3VRQZZNANCNFSM5ZFVQFOA . You are receiving this because you were mentioned.Message ID: @.***>

-- Ky Tri Nguyen Ph.D. Candidate, Intelligent Transport Systems

Institute of Transport Studies Department of Civil Engineering, Faculty of Engineering Monash University Room 112, Building 36 Clayton VIC 3800 Australia

KyTriNguyenMonash / achilles

Generate persons and households seed #3

Tasks: