Open ProfAaronBaird opened 3 years ago
When filtering an EHR record, what data should be keep in the last N
years of history is more complicated than just drawing a line in the sand (e.g., on 28 September 2020
) and deleting everything before then.
It is clinically important to include chronic conditions (e.g., Diabetes diagnosed a decade previously), a list of active medications (even if originally prescribed before the filter date), a vaccination history (some vaccines require boosters every X
years), and so forth --- even if someone only wants detail from the last N
years.
So, the "years of history" feature can be thought of as a "clinically-aware filter" rather than merely just a "time filter." It is not going to drop important items from the record.
That makes sense and thanks for the quick reply. This might mostly be a documentation issue, then. It would be helpful to know, even if just briefly, what is and is not affected by this configuration setting. In particular, what is deemed important enough to keep and what isn't.
From: Jason Walonoski @.***> Sent: Tuesday, September 28, 2021, 3:35 PM To: synthetichealth/synthea Cc: Aaron M. Baird; Author Subject: Re: [synthetichealth/synthea] Question/Issue: Start and Stop Dates when Years of History set to 1 (#945)
When filtering an EHR record, what data should be keep in the last N years of history is more complicated than just drawing a line in the sand (e.g., on 28 September 2020) and deleting everything before then.
It is clinical important to include chronic conditions (e.g., Diabetes diagnosed a decade previously), a list of active medications (even if originally prescribed before the filter date), a vaccination history (some vaccines require boosters every X years), and so forth --- even if someone only wants detail from the last N years.
So, the "years of history" feature can be thought of as a "clinically-aware filter" rather than merely just a "time filter." It is not going to drop important items from the record.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsynthetichealth%2Fsynthea%2Fissues%2F945%23issuecomment-929563225&data=04%7C01%7Cabaird%40gsu.edu%7Ccfce137fe4c94f3f4a7908d982b71f4b%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684545285418032%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=MPZztzt6qtagkQ2IsLwsh9grT%2BhcpMg9MlPuKrNyTh8%3D&reserved=0, or unsubscribehttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FATBG72BFZXL3A74SJ5KCOKDUEIKH5ANCNFSM5E6DOMKQ&data=04%7C01%7Cabaird%40gsu.edu%7Ccfce137fe4c94f3f4a7908d982b71f4b%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684545285428030%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=k30LEcUUj6uRwK5XnZaSLqtzSzR5ElVCYhL9QHbOTTU%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7Cabaird%40gsu.edu%7Ccfce137fe4c94f3f4a7908d982b71f4b%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684545285438026%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=QyQ3%2FLTu6zu77NDYk4i0fyz9tgJxBBUiPlBOlvi2UMQ%3D&reserved=0 or Androidhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7Cabaird%40gsu.edu%7Ccfce137fe4c94f3f4a7908d982b71f4b%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684545285448017%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=o3GIl5H3GG1dONmUSJgMlaz9pCyVEE%2BgsO2bruG69L0%3D&reserved=0.
CAUTION: This email was sent from someone outside of the university. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Basically anything with an "active" clinical status that was set before the cut off date.
What is kept:
I might have been wrong about Immunization example.
You can see the code here: https://github.com/synthetichealth/synthea/blob/a3482c856d30410e438047845796095a827cca41/src/main/java/org/mitre/synthea/export/Exporter.java#L506-L582
That is very helpful and thanks for the information.
From: Jason Walonoski @.> Sent: Tuesday, September 28, 2021 6:33:26 PM To: synthetichealth/synthea @.> Cc: Aaron M. Baird @.>; Author @.> Subject: Re: [synthetichealth/synthea] Question/Issue: Start and Stop Dates when Years of History set to 1 (#945)
Basically anything with an "active" clinical status that was set before the cut off date.
What is kept:
I might have been wrong about Immunization example.
You can see the code here: https://github.com/synthetichealth/synthea/blob/a3482c856d30410e438047845796095a827cca41/src/main/java/org/mitre/synthea/export/Exporter.java#L506-L582https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsynthetichealth%2Fsynthea%2Fblob%2Fa3482c856d30410e438047845796095a827cca41%2Fsrc%2Fmain%2Fjava%2Forg%2Fmitre%2Fsynthea%2Fexport%2FExporter.java%23L506-L582&data=04%7C01%7Cabaird%40gsu.edu%7C4577d2f085f34f2b54f008d982cffdce%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684652111361359%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=y8wYTOMRjvE4pfOLNr%2FHnjF4UGvmM7LJ0lgurNN%2FM1g%3D&reserved=0
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fsynthetichealth%2Fsynthea%2Fissues%2F945%23issuecomment-929673161&data=04%7C01%7Cabaird%40gsu.edu%7C4577d2f085f34f2b54f008d982cffdce%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684652111371353%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=yPGrIRC7%2F6iixX2UegTx8BEMGr9Tl0tsSlj10p%2B1TCc%3D&reserved=0, or unsubscribehttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FATBG72FJVBNPLN6AGE7WNWDUEI7DNANCNFSM5E6DOMKQ&data=04%7C01%7Cabaird%40gsu.edu%7C4577d2f085f34f2b54f008d982cffdce%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684652111381348%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=tJzXIPg0KX2hZeittiqTUWsd4T255Ui50mb6EjSjKAE%3D&reserved=0. Triage notifications on the go with GitHub Mobile for iOShttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04%7C01%7Cabaird%40gsu.edu%7C4577d2f085f34f2b54f008d982cffdce%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684652111391343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=0KYXWT4UrREfwGLBUGnhnFLEyXX4rfZhdf6%2FW50Z1D8%3D&reserved=0 or Androidhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04%7C01%7Cabaird%40gsu.edu%7C4577d2f085f34f2b54f008d982cffdce%7C515ad73d8d5e4169895c9789dc742a70%7C0%7C0%7C637684652111391343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=uOI3VKBwkJsDwzYp0miWr2RjM5Rp%2FmOzQgjzdWgQXZQ%3D&reserved=0.
CAUTION: This email was sent from someone outside of the university. Do not click links or open attachments unless you recognize the sender and know the content is safe.
I may just be confused about the Years of History configuration setting vs. the purpose of encounter dates. But, I've set the exporter.years_of_history = 1 and also generate.only_alive_patients = true. After generating, in CSV, I looked through "encounters.csv". Many of the encounter (start and stop) dates are in many different years more than one year back (i.e., a lot of variation, sometimes back to 1965). My primary goal is to create all of the encounters for the synthetic patients for the last year. I can always just update the dates to be in the current year, but I thought I would see if this is a bug or perhaps a misunderstanding of the relationship between years of patient history and encounter data created.