search

GSA / data.gov

Main repository for the data.gov service
https://data.gov
Other
655 stars 102 forks source link

Speed up catalog page loading by modifying popular count mechanism #4708

Closed FuhuXia closed 5 months ago

FuhuXia commented 7 months ago

[UPDATE] It is the amount of tracking_summary DB calls that make the page load slow.

============================= Removing ckanext-harvest extension can speed up un-cached dataset listing pages by 10 times, from an average 8-10 seconds to less than 1 second. We can consider refactoring catalog-web to run without ckanext-harvest.

Preliminary testing on catalog-stage has proved the speed benefit. In the test we had to remove the metadata source link HTML block from the dataset page, and remove ckanext-geodatagov extension as well, therefore the collection UI is also lost. There might be other UI elements got lost that we need to identify and evaluate to add back.

The goal of this ticket it to complete the preliminary testing, and identify and add the missing elements back to the UI so that the end user's experience does not change before and after ckanext-harvest removal. That challenging part is how to provide harvesting related UI elements without ckanext-harvest extension.

Sketch

I can see there are two approaches:

  1. Add harvest routes in datagovtheme extension, this includes the necessary API endpoint /harvest/object/[harvest-object-id] and UI page /harvest/[harvest-source-name], and maybe some other harvest related API endpoint. PROs: can select which endpoint to support which not, to reduce the workload. CONs: quite some coding
  2. Create two versions of catalog-web, one with harvest one without, and config Nginx to serving all traffic to catalog-web, but all harvest routes to the catalog-web-with-harvest instances. PROs: minimal coding CONs: some nginx conf. four more catalog-web instances to add (2X in prod, 1 in staging, 1 in dev, taking a total of 3.4G RAM).
gujral-rei commented 6 months ago

team is leaning towards option#2 increase RAM by 20 GB will result in additional cost - to be reviewed

FuhuXia commented 5 months ago

Did the implementation on development but the speed does not improve as expected. It turned out ckanext-harvest was not the reason. It is the tracking info added by datagovcatalog that adds many queries to get tracking_summary for each datasets and each resources of each datasets...

Set CKANEXTDATAGOVCATALOGADD_PACKAGES_TRACKING_INFO to False and redeploy catalog staging proves the point: tracking hot icon are gone, page loading becomes fast.

FuhuXia commented 5 months ago

Tried three ways to serve the dataset listing page on my local and compare speed:

Turn off tracking: finishes loading in 1 sec. 100 DB queries. Tracking on package level only: finishes loading in 10 secs. 140 DB queries. Full Tracking (on package and resources) : finishes loading in 12 secs. 210 DB queries.

Analysis:

The extra queries with tracking turned on are queries to select tracking_summary by package_id and select tracking_summary by url. Surprisingly by package_id takes significantly longer than by url, even both fields are indexed and there are more url than pacakge_id. The 20 select tracking_summary by package_id queries counts for majority of the 10 secs loading time.

tracking_summary definition:

catalog=# \d tracking_summary
                    Table "public.tracking_summary"
    Column     |         Type          | Collation | Nullable | Default 
---------------+-----------------------+-----------+----------+---------
 url           | text                  |           | not null | 
 package_id    | text                  |           |          | 
 tracking_type | character varying(10) |           | not null | 
 count         | integer               |           | not null | 
 running_total | integer               |           | not null | 0
 recent_views  | integer               |           | not null | 0
 tracking_date | date                  |           |          | 
Indexes:
    "tracking_summary_date" btree (tracking_date)
    "tracking_summary_package_id" btree (package_id)
    "tracking_summary_url" btree (url)

catalog=# select count(distinct(package_id)) from tracking_summary;
 count  
--------
 301872
(1 row)

catalog=# select count(distinct(url)) from tracking_summary;
 count  
--------
 800411
(1 row)

Full logs with tracking turned on on both levels.

duration: ### ms indicates slow queries (if it takes longer than 100 ms) The 19 slow queries count for 4.7 secs, all select tracking_summary by package_id queries. 

full tracking

Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.465 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.465 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.466 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.467 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:03 linux postgres[268584]:         FROM system_info
Jun 12 10:11:03 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:03 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.468 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.821 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.822 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.822 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.822 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:03 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:03 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '5f4f1195-e770-4a2a-8f75-195cd98860ce'
Jun 12 10:11:03 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.824 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:03 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:03 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '5f4f1195-e770-4a2a-8f75-195cd98860ce'
Jun 12 10:11:03 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.826 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:03 linux postgres[268584]:         FROM package
Jun 12 10:11:03 linux postgres[268584]:         WHERE package.id = 'ec0bda95-dba5-46e7-8e91-eca17c361703'
Jun 12 10:11:03 linux postgres[268584]: 2024-06-12 10:11:03.863 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:03 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:03 linux postgres[268584]:         WHERE tracking_summary.package_id = 'ec0bda95-dba5-46e7-8e91-eca17c361703' ORDER BY tracking_date desc
Jun 12 10:11:03 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.065 EDT [268584] LOG:  duration: 201.745 ms
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.069 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.fisheries.noaa.gov/inport/item/48196' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.073 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://coast.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.075 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://coast.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.078 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://coast.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.081 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.earthdata.nasa.gov/learn/find-data/idn/gcmd-keywords' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.084 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.fisheries.noaa.gov/inportserve/waf/noaa/nos/ocm/dmp/pdf/48196.pdf' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.091 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'f8b1a6b3-a9bd-4f01-96ef-154082643353'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.094 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'f8b1a6b3-a9bd-4f01-96ef-154082643353'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.096 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:04 linux postgres[268584]:         FROM package
Jun 12 10:11:04 linux postgres[268584]:         WHERE package.id = 'f270f312-797d-4662-96af-5327c26081b8'
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.119 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.package_id = 'f270f312-797d-4662-96af-5327c26081b8' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.281 EDT [268584] LOG:  duration: 162.531 ms
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.284 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.austintexas.gov/api/views/3d7x-x4q8/rows.csv?accessType=DOWNLOAD' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.287 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.austintexas.gov/api/views/3d7x-x4q8/rows.rdf?accessType=DOWNLOAD' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.289 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.austintexas.gov/api/views/3d7x-x4q8/rows.json?accessType=DOWNLOAD' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.292 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.austintexas.gov/api/views/3d7x-x4q8/rows.xml?accessType=DOWNLOAD' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.298 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '82b85475-f85d-404a-b95b-89d1a42e9f6b'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.301 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '82b85475-f85d-404a-b95b-89d1a42e9f6b'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.303 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:04 linux postgres[268584]:         FROM package
Jun 12 10:11:04 linux postgres[268584]:         WHERE package.id = 'b324cfda-1786-4370-9951-312a558397df'
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.337 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.package_id = 'b324cfda-1786-4370-9951-312a558397df' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.584 EDT [268584] LOG:  duration: 247.497 ms
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.586 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://edg.epa.gov/data/Public/OLEM/KatrinaWaterSampling.zip' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.593 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '1149ee63-2fff-494e-82e5-9aace9d3b3bf'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.595 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '1149ee63-2fff-494e-82e5-9aace9d3b3bf'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.598 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:04 linux postgres[268584]:         FROM package
Jun 12 10:11:04 linux postgres[268584]:         WHERE package.id = '80dc0347-0ec4-4790-83ff-077f3868a92a'
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.634 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.package_id = '80dc0347-0ec4-4790-83ff-077f3868a92a' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.863 EDT [268584] LOG:  duration: 229.381 ms
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.866 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.cityofnewyork.us/api/geospatial/2de2-6x2h?method=export&format=KML' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.869 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.cityofnewyork.us/api/geospatial/2de2-6x2h?method=export&format=KMZ' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.871 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.cityofnewyork.us/api/geospatial/2de2-6x2h?method=export&format=Shapefile' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.874 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.cityofnewyork.us/api/geospatial/2de2-6x2h?method=export&format=Original' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.876 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.cityofnewyork.us/api/views/cqsj-cfgu/rows.json?accessType=DOWNLOAD' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.879 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.cityofnewyork.us/api/views/cqsj-cfgu/rows.csv?accessType=DOWNLOAD' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.886 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'ae156ef5-7869-4748-9ad2-f103cf02a218'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.889 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:04 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:04 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'ae156ef5-7869-4748-9ad2-f103cf02a218'
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.891 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:04 linux postgres[268584]:         FROM package
Jun 12 10:11:04 linux postgres[268584]:         WHERE package.id = '78271eba-e3f2-4019-802c-bee22e7b6010'
Jun 12 10:11:04 linux postgres[268584]: 2024-06-12 10:11:04.929 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:04 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:04 linux postgres[268584]:         WHERE tracking_summary.package_id = '78271eba-e3f2-4019-802c-bee22e7b6010' ORDER BY tracking_date desc
Jun 12 10:11:04 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.236 EDT [268584] LOG:  duration: 306.429 ms
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.238 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://hazards.fema.gov' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.241 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://hazards.fema.gov' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.249 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:05 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:05 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'ae156ef5-7869-4748-9ad2-f103cf02a218'
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.253 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:05 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:05 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'ae156ef5-7869-4748-9ad2-f103cf02a218'
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.256 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:05 linux postgres[268584]:         FROM package
Jun 12 10:11:05 linux postgres[268584]:         WHERE package.id = '388c7b80-bd5f-47a5-bba3-17e184270d7e'
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.292 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.package_id = '388c7b80-bd5f-47a5-bba3-17e184270d7e' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.383 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.450 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.453 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.455 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.458 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.460 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.463 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.471 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:05 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:05 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'a2ea361e-1350-4df1-8d61-4c326b3394ae'
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.473 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:05 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:05 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'a2ea361e-1350-4df1-8d61-4c326b3394ae'
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.475 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:05 linux postgres[268584]:         FROM package
Jun 12 10:11:05 linux postgres[268584]:         WHERE package.id = 'cac85170-f003-4743-b33c-f0720a3f815b'
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.509 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.package_id = 'cac85170-f003-4743-b33c-f0720a3f815b' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.837 EDT [268584] LOG:  duration: 327.462 ms
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.839 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'https://doi.org/10.5069/G9SB43XC' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.842 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://Not Available' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.844 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'http://ncalm.cive.uh.edu/' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.846 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'https://nsf.gov/' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.849 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.url = 'https://opentopography.org' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.855 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:05 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:05 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'f4ca4614-8901-409b-8553-2e994ad10023'
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.858 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:05 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:05 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'f4ca4614-8901-409b-8553-2e994ad10023'
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.860 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:05 linux postgres[268584]:         FROM package
Jun 12 10:11:05 linux postgres[268584]:         WHERE package.id = '5dc5d01f-0943-4abc-a41d-e4801b59a979'
Jun 12 10:11:05 linux postgres[268584]: 2024-06-12 10:11:05.900 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:05 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:05 linux postgres[268584]:         WHERE tracking_summary.package_id = '5dc5d01f-0943-4abc-a41d-e4801b59a979' ORDER BY tracking_date desc
Jun 12 10:11:05 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.208 EDT [268584] LOG:  duration: 307.280 ms
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.210 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'https://scholar.google.com/scholar?q=10.5067%2FGNSS%2FGNSS_HIGHRATE_D_001' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.213 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'ftp://cddis.nasa.gov/gnss/data/highrate' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.215 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'https://cddis.nasa.gov/Data_and_Derived_Products/GNSS/high-rate_data.html' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.217 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://dx.doi.org/10.5067/GNSS/GNSS_HIGHRATE_D_001' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.224 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:06 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:06 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'ae156ef5-7869-4748-9ad2-f103cf02a218'
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.226 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:06 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:06 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'ae156ef5-7869-4748-9ad2-f103cf02a218'
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.229 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:06 linux postgres[268584]:         FROM package
Jun 12 10:11:06 linux postgres[268584]:         WHERE package.id = 'a79a803f-2121-434b-b769-24446511ec0e'
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.260 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.package_id = 'a79a803f-2121-434b-b769-24446511ec0e' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.648 EDT [268584] LOG:  duration: 387.972 ms
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.650 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.653 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.655 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.658 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.660 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.663 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.666 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fema.gov/msc' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.673 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:06 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:06 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'ebd95b25-74d8-4811-bbec-019f16073486'
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.675 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:06 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:06 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'ebd95b25-74d8-4811-bbec-019f16073486'
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.678 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:06 linux postgres[268584]:         FROM package
Jun 12 10:11:06 linux postgres[268584]:         WHERE package.id = '791bafce-62d0-42dc-be1e-87e100e1be0f'
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.747 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.package_id = '791bafce-62d0-42dc-be1e-87e100e1be0f' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.944 EDT [268584] LOG:  duration: 197.410 ms
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.947 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:06 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:06 linux postgres[268584]:         WHERE tracking_summary.url = 'https://federallabs.org/technology/secure-configuration-evaluation-remediation-and-reporting-tool-cerrt-software-for' ORDER BY tracking_date desc
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.953 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:06 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:06 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '16980d1c-5e8f-4188-b962-42446f2d3f63'
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.956 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:06 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:06 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '16980d1c-5e8f-4188-b962-42446f2d3f63'
Jun 12 10:11:06 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:06 linux postgres[268584]: 2024-06-12 10:11:06.958 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:06 linux postgres[268584]:         FROM package
Jun 12 10:11:06 linux postgres[268584]:         WHERE package.id = 'cb110193-354f-4fc9-b41b-ecfc01970afc'
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.006 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:07 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:07 linux postgres[268584]:         WHERE tracking_summary.package_id = 'cb110193-354f-4fc9-b41b-ecfc01970afc' ORDER BY tracking_date desc
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.105 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:07 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:07 linux postgres[268584]:         WHERE tracking_summary.url = 'http://api.census.gov/data/2016/ase/csa' ORDER BY tracking_date desc
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.124 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:07 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:07 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '143529f7-2eef-4a07-b227-93ac9e84fad8'
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.126 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:07 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:07 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '143529f7-2eef-4a07-b227-93ac9e84fad8'
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.129 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:07 linux postgres[268584]:         FROM package
Jun 12 10:11:07 linux postgres[268584]:         WHERE package.id = '777a5dfc-b6de-4b9d-a226-e8b77b374715'
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.168 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:07 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:07 linux postgres[268584]:         WHERE tracking_summary.package_id = '777a5dfc-b6de-4b9d-a226-e8b77b374715' ORDER BY tracking_date desc
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.453 EDT [268584] LOG:  duration: 285.310 ms
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.456 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:07 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:07 linux postgres[268584]:         WHERE tracking_summary.url = 'https://irma.nps.gov/DataStore/DownloadFile/647850?Reference=2279013' ORDER BY tracking_date desc
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.462 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:07 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:07 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '217e855b-cd64-4ebc-958b-abbbb0f57ac2'
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.465 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:07 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:07 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '217e855b-cd64-4ebc-958b-abbbb0f57ac2'
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.468 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:07 linux postgres[268584]:         FROM package
Jun 12 10:11:07 linux postgres[268584]:         WHERE package.id = '6b856947-7346-43c1-b725-cc5a1a56a486'
Jun 12 10:11:07 linux postgres[268584]: 2024-06-12 10:11:07.507 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:07 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:07 linux postgres[268584]:         WHERE tracking_summary.package_id = '6b856947-7346-43c1-b725-cc5a1a56a486' ORDER BY tracking_date desc
Jun 12 10:11:07 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.017 EDT [268584] LOG:  duration: 511.045 ms
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.020 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://nces.ed.gov/nationsreportcard/niesdata' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.022 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2018158' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.030 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '352b4532-793d-4075-a03f-05b778a3c43a'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.033 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '352b4532-793d-4075-a03f-05b778a3c43a'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.035 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:08 linux postgres[268584]:         FROM package
Jun 12 10:11:08 linux postgres[268584]:         WHERE package.id = '558fdd71-bd55-46d6-951a-6c085992b05c'
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.140 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.package_id = '558fdd71-bd55-46d6-951a-6c085992b05c' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.317 EDT [268584] LOG:  duration: 177.957 ms
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.320 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_Data_Dictionary.csv' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.323 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_Activities_Log.csv' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.325 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_MegaTable.xlsx' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.339 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/Inter%20Data_0.zip' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.342 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/HS%20Data_0.zip' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.344 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/CS%20Data_0.zip' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.347 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_Cotton_Charts_Report.pdf' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.349 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_Manual_Plant_Height.xlsx' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.351 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_Hamby_In-Field_Image.JPG' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.354 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'https://data.nal.usda.gov/system/files/F013_2015_MetaNotes.pdf' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.360 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '352b4532-793d-4075-a03f-05b778a3c43a'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.363 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '352b4532-793d-4075-a03f-05b778a3c43a'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.365 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:08 linux postgres[268584]:         FROM package
Jun 12 10:11:08 linux postgres[268584]:         WHERE package.id = '06a1e6e4-fbe3-4c3d-ac7f-55d00ccac238'
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.401 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.package_id = '06a1e6e4-fbe3-4c3d-ac7f-55d00ccac238' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.535 EDT [268584] LOG:  duration: 133.824 ms
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.537 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.fns.usda.gov/sites/default/files/fdd/SP66-2014s.pdf' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.544 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '29846409-fa62-4648-a3b9-12d071a2a5b2'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.546 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '29846409-fa62-4648-a3b9-12d071a2a5b2'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.549 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:08 linux postgres[268584]:         FROM package
Jun 12 10:11:08 linux postgres[268584]:         WHERE package.id = 'b828dcb0-482b-4f7f-890f-49b64d0088ed'
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.588 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.package_id = 'b828dcb0-482b-4f7f-890f-49b64d0088ed' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.774 EDT [268584] LOG:  duration: 186.291 ms
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.776 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.pasda.psu.edu/data//padoh/padoh_airports_2002.zip' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.779 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.url = 'http://www.pasda.psu.edu/data//padoh/padoh_airports_2002.zip' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.785 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '16980d1c-5e8f-4188-b962-42446f2d3f63'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.788 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '16980d1c-5e8f-4188-b962-42446f2d3f63'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.790 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:08 linux postgres[268584]:         FROM package
Jun 12 10:11:08 linux postgres[268584]:         WHERE package.id = '8559dcd0-bc8d-47a2-b9b4-38e634620042'
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.822 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:08 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:08 linux postgres[268584]:         WHERE tracking_summary.package_id = '8559dcd0-bc8d-47a2-b9b4-38e634620042' ORDER BY tracking_date desc
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.965 EDT [268584] LOG:  duration: 143.358 ms
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.972 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'f8b1a6b3-a9bd-4f01-96ef-154082643353'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.975 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:08 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:08 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'f8b1a6b3-a9bd-4f01-96ef-154082643353'
Jun 12 10:11:08 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:08 linux postgres[268584]: 2024-06-12 10:11:08.977 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:08 linux postgres[268584]:         FROM package
Jun 12 10:11:08 linux postgres[268584]:         WHERE package.id = '3ecb62ee-bbb3-4f70-8d29-a1f228fcd50b'
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.028 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:09 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:09 linux postgres[268584]:         WHERE tracking_summary.package_id = '3ecb62ee-bbb3-4f70-8d29-a1f228fcd50b' ORDER BY tracking_date desc
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.402 EDT [268584] LOG:  duration: 374.863 ms
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.405 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:09 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:09 linux postgres[268584]:         WHERE tracking_summary.url = 'https://austin.maps.arcgis.com/home/item.html?id=04776ad19f324acd81643737523de7fe' ORDER BY tracking_date desc
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.411 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:09 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:09 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = 'f4ca4614-8901-409b-8553-2e994ad10023'
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.414 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:09 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:09 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = 'f4ca4614-8901-409b-8553-2e994ad10023'
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.417 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:09 linux postgres[268584]:         FROM package
Jun 12 10:11:09 linux postgres[268584]:         WHERE package.id = 'c05f2c6c-2f6e-4caa-94e6-fcbf53401b15'
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.461 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:09 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:09 linux postgres[268584]:         WHERE tracking_summary.package_id = 'c05f2c6c-2f6e-4caa-94e6-fcbf53401b15' ORDER BY tracking_date desc
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.626 EDT [268584] LOG:  duration: 165.048 ms
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.628 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:09 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:09 linux postgres[268584]:         WHERE tracking_summary.url = 'https://scholar.google.com/scholar?q=10.5067%2FSeaBASS%2FLEO%2FDATA001' ORDER BY tracking_date desc
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.631 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:09 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:09 linux postgres[268584]:         WHERE tracking_summary.url = 'https://seabass.gsfc.nasa.gov/experiment/LEO/' ORDER BY tracking_date desc
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.637 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:09 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:09 linux postgres[268584]:         WHERE group_extra.key = 'organization_type' AND group_extra.group_id = '5f4f1195-e770-4a2a-8f75-195cd98860ce'
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.640 EDT [268584] LOG:  statement: SELECT group_extra.value AS group_extra_value
Jun 12 10:11:09 linux postgres[268584]:         FROM group_extra
Jun 12 10:11:09 linux postgres[268584]:         WHERE group_extra.key = 'terms_of_use' AND group_extra.state = 'active' AND group_extra.group_id = '5f4f1195-e770-4a2a-8f75-195cd98860ce'
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.642 EDT [268584] LOG:  statement: SELECT package.id AS package_id, package.name AS package_name, package.title AS package_title, package.version AS package_version, package.url AS package_url, package.author AS package_author, package.author_email AS package_author_email, package.maintainer AS package_maintainer, package.maintainer_email AS package_maintainer_email, package.notes AS package_notes, package.license_id AS package_license_id, package.type AS package_type, package.owner_org AS package_owner_org, package.creator_user_id AS package_creator_user_id, package.metadata_created AS package_metadata_created, package.metadata_modified AS package_metadata_modified, package.private AS package_private, package.state AS package_state, package.plugin_data AS package_plugin_data
Jun 12 10:11:09 linux postgres[268584]:         FROM package
Jun 12 10:11:09 linux postgres[268584]:         WHERE package.id = 'f8f1b10e-b2a4-41e5-89b3-65d62ed8f39c'
Jun 12 10:11:09 linux postgres[268584]: 2024-06-12 10:11:09.682 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:09 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:09 linux postgres[268584]:         WHERE tracking_summary.package_id = 'f8f1b10e-b2a4-41e5-89b3-65d62ed8f39c' ORDER BY tracking_date desc
Jun 12 10:11:09 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.058 EDT [268584] LOG:  duration: 376.235 ms
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.059 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.nauticalcharts.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.060 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'http://pacioos.org' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.060 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.nauticalcharts.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.061 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.nauticalcharts.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.062 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'http://pacioos.org' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.062 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'http://geo.pacioos.hawaii.edu/geoserver/PACIOOS/wai_ocs_all_soundings/ows?service=WFS&version=1.0.0&request=GetCapabilities' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.063 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'https://www.nauticalcharts.noaa.gov' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.063 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'http://pacioos.org' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.064 EDT [268584] LOG:  statement: SELECT tracking_summary.url AS tracking_summary_url, tracking_summary.package_id AS tracking_summary_package_id, tracking_summary.tracking_type AS tracking_summary_tracking_type, tracking_summary.count AS tracking_summary_count, tracking_summary.running_total AS tracking_summary_running_total, tracking_summary.recent_views AS tracking_summary_recent_views, tracking_summary.tracking_date AS tracking_summary_tracking_date
Jun 12 10:11:10 linux postgres[268584]:         FROM tracking_summary
Jun 12 10:11:10 linux postgres[268584]:         WHERE tracking_summary.url = 'http://geo.pacioos.hawaii.edu/geoserver/PACIOOS/wai_ocs_all_soundings/ows?service=WMS&version=1.3.0&request=GetCapabilities' ORDER BY tracking_date desc
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.066 EDT [268584] LOG:  statement: SELECT "group".name AS group_name, "group".title AS group_title
Jun 12 10:11:10 linux postgres[268584]:         FROM "group"
Jun 12 10:11:10 linux postgres[268584]:         WHERE "group".name IN ('local', 'climate5434', 'older-adults-health-data', 'energy9485', 'noaa-gov', 'census-gov', 'doi-gov', 'nasa-gov', 'fema-gov', 'pennsylvania-geospatial-data-clearinghouse', 'edac-unm-edu', 'epa-gov', 'ca-gov', 'city-of-new-york', 'doe-gov', 'usda-gov', 'hhs-gov', 'state-of-alaska', 'lake-county-illinois', 'doc-gov', 'city-of-austin', 'state-of-washington', 'dot-gov', 'state-of-maryland', 'va-gov', 'fgdc-gov', 'ssa-gov', 'national-institute-of-standards-and-technology', 'city-of-chicago', 'state-of-connecticut', 'state-of-new-york', 'dhs-gov', 'centers-for-disease-control-and-prevention', 'ed-gov', 'city-of-san-francisco', 'usaid-gov', 'opentopography', 'cook-county-of-illinois', 'city-of-tempe', 'dol-gov', 'state-gov', 'state-of-oregon', 'montgomery-county-of-maryland', 'state-of-oklahoma', 'city-of-los-angeles', 'allegheny-county-city-of-pittsburgh-western-pa-regional-data-center', 'king-county-washington', 'city-of-ferndale-michigan', 'city-of-seattle', 'sba-gov', 'city-of-baton-rouge', 'treasury-gov', 'mcc-gov', 'city-of-providence')
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.336 EDT [268584] LOG:  statement: ROLLBACK
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.355 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.355 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.355 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.355 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268584]:         FROM system_info
Jun 12 10:11:10 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.356 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.356 EDT [268589] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.356 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.356 EDT [268587] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.356 EDT [268587] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.356 EDT [268589] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.356 EDT [268586] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.356 EDT [268587] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.356 EDT [268589] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.356 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.357 EDT [268587] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268587]:         FROM system_info
Jun 12 10:11:10 linux postgres[268587]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268587]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.357 EDT [268589] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268589]:         FROM system_info
Jun 12 10:11:10 linux postgres[268589]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268589]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.357 EDT [268586] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268586]:         FROM system_info
Jun 12 10:11:10 linux postgres[268586]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268586]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.357 EDT [268587] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.357 EDT [268589] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.357 EDT [268586] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.360 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.360 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.360 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.361 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268584]:         FROM system_info
Jun 12 10:11:10 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.361 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.375 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.375 EDT [268587] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.375 EDT [268589] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.375 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.375 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.375 EDT [268589] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.375 EDT [268587] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.375 EDT [268587] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.375 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.375 EDT [268589] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.375 EDT [268586] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.375 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.376 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268584]:         FROM system_info
Jun 12 10:11:10 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.376 EDT [268587] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268587]:         FROM system_info
Jun 12 10:11:10 linux postgres[268587]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268587]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.376 EDT [268586] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268586]:         FROM system_info
Jun 12 10:11:10 linux postgres[268586]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268586]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.376 EDT [268589] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268589]:         FROM system_info
Jun 12 10:11:10 linux postgres[268589]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268589]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.376 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.376 EDT [268587] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.376 EDT [268586] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.376 EDT [268589] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.380 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.380 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.380 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.380 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.380 EDT [268586] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.380 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.381 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268584]:         FROM system_info
Jun 12 10:11:10 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.381 EDT [268586] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268586]:         FROM system_info
Jun 12 10:11:10 linux postgres[268586]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268586]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.381 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.381 EDT [268586] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.384 EDT [268589] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.384 EDT [268587] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.384 EDT [268589] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.384 EDT [268587] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.384 EDT [268589] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.384 EDT [268587] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.385 EDT [268587] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268587]:         FROM system_info
Jun 12 10:11:10 linux postgres[268587]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268587]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.385 EDT [268589] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268589]:         FROM system_info
Jun 12 10:11:10 linux postgres[268589]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268589]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.385 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268587]: 2024-06-12 10:11:10.385 EDT [268587] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.385 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268589]: 2024-06-12 10:11:10.385 EDT [268589] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.385 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.385 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.385 EDT [268586] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.385 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.386 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268584]:         FROM system_info
Jun 12 10:11:10 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.386 EDT [268586] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268586]:         FROM system_info
Jun 12 10:11:10 linux postgres[268586]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268586]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.386 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.386 EDT [268586] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.389 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.389 EDT [268584] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.390 EDT [268584] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.390 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.390 EDT [268584] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268584]:         FROM system_info
Jun 12 10:11:10 linux postgres[268584]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268584]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.390 EDT [268586] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.390 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268584]: 2024-06-12 10:11:10.390 EDT [268584] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.390 EDT [268586] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268586]:         FROM system_info
Jun 12 10:11:10 linux postgres[268586]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268586]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.391 EDT [268586] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.522 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.522 EDT [268586] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.523 EDT [268586] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.523 EDT [268586] LOG:  statement: SELECT system_info.id AS system_info_id, system_info.key AS system_info_key, system_info.value AS system_info_value, system_info.state AS system_info_state
Jun 12 10:11:10 linux postgres[268586]:         FROM system_info
Jun 12 10:11:10 linux postgres[268586]:         WHERE system_info.key = 'ckan.config_update'
Jun 12 10:11:10 linux postgres[268586]:          LIMIT 1
Jun 12 10:11:10 linux postgres[268586]: 2024-06-12 10:11:10.523 EDT [268586] LOG:  statement: COMMIT
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.533 EDT [268751] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.533 EDT [268751] LOG:  statement: SELECT t.oid, typarray
Jun 12 10:11:10 linux postgres[268751]:         FROM pg_type t JOIN pg_namespace ns
Jun 12 10:11:10 linux postgres[268751]:             ON typnamespace = ns.oid
Jun 12 10:11:10 linux postgres[268751]:         WHERE typname = 'hstore';
Jun 12 10:11:10 linux postgres[268751]:         
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.535 EDT [268751] LOG:  statement: ROLLBACK
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.535 EDT [268751] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.535 EDT [268751] LOG:  statement: select pg_catalog.version()
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.535 EDT [268751] LOG:  statement: select current_schema()
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.535 EDT [268751] LOG:  statement: show transaction isolation level
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.535 EDT [268751] LOG:  statement: show standard_conforming_strings
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.536 EDT [268751] LOG:  statement: ROLLBACK
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.536 EDT [268751] LOG:  statement: BEGIN
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.536 EDT [268751] LOG:  statement: SELECT 1
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.536 EDT [268751] LOG:  statement: INSERT INTO tracking_raw
Jun 12 10:11:10 linux postgres[268751]:                              (user_key, url, tracking_type)
Jun 12 10:11:10 linux postgres[268751]:                              VALUES ('882c80ec05af84b721bad58b9c3e71bbd0d71ef3', '/dataset', 'page')
Jun 12 10:11:10 linux postgres[268751]: 2024-06-12 10:11:10.552 EDT [268751] LOG:  statement: COMMIT
jbrown-xentity commented 5 months ago

I think in the short term, it might be worth turning that off to get a more performant website. In the medium term I believe we could replicate the functionality without having to rely on so many DB calls. Why couldn't we run a job to put these into SOLR, and have SOLR do the sorting correctly? That is what it is good for... Say we had a weekly job that updated the objects in SOLR with the latest hit counts. But this is deep CKAN work/magic, and would take time to implement. @btylerburton @hkdctol do you think losing the ordering by most popular is worth the performance boost?

FuhuXia commented 5 months ago

By adding more composite indexes, we can reduce the slow select tracking_summary by package_id queries from hundred-ms to sub ms execution time. From 1030.726 ms to 0.179 ms in the following example.

Before index:

--------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=355.57..355.57 rows=1 width=126) (actual time=1030.678..1030.680 rows=1 loops=1)
   Buffers: shared hit=28 read=45
   ->  Sort  (cost=355.57..355.79 rows=89 width=126) (actual time=1030.676..1030.677 rows=1 loops=1)
         Sort Key: tracking_date DESC
         Sort Method: top-N heapsort  Memory: 25kB
         Buffers: shared hit=28 read=45
         ->  Bitmap Heap Scan on tracking_summary  (cost=5.12..355.12 rows=89 width=126) (actual time=0.139..1030.432 rows=70 loops=1)
               Recheck Cond: (package_id = '5d6997e1-13bd-430b-988b-0b4865f461b6'::text)
               Heap Blocks: exact=70
               Buffers: shared hit=28 read=45
               ->  Bitmap Index Scan on tracking_summary_package_id  (cost=0.00..5.10 rows=89 width=0) (actual time=0.077..0.077 rows=70 loops=1)
                     Index Cond: (package_id = '5d6997e1-13bd-430b-988b-0b4865f461b6'::text)
                     Buffers: shared hit=3
 Planning Time: 0.208 ms
 Execution Time: 1030.726 ms

After index:

------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Limit  (cost=0.56..4.61 rows=1 width=126) (actual time=0.145..0.147 rows=1 loops=1)
   Buffers: shared hit=1 read=4
   ->  Index Scan using idx_tracking_summary_package_id_date on tracking_summary  (cost=0.56..361.67 rows=89 width=126) (actual time=0.143..0.143 rows=1 loops=1)
         Index Cond: (package_id = '02aa8df4-e1e6-406a-9519-e336b3d02f84'::text)
         Buffers: shared hit=1 read=4
 Planning:
   Buffers: shared hit=21 read=1
 Planning Time: 0.560 ms
 Execution Time: 0.179 ms
(9 rows)

Index to add:

CREATE INDEX idx_package_id_tracking_date ON tracking_summary(package_id, tracking_date DESC);
CREATE INDEX idx_url_tracking_date ON tracking_summary(url, tracking_date DESC);
FuhuXia commented 5 months ago

The above index improvement makes local catalog page load fast, no visible difference with or without tracking turned on. That is improvement of 12 sec loading time to less than 1 sec.

Now testing on cloud.gov environment. With the bigger database latency, the speed improvement is expected to be less drastic. We might need to combine the 1) index and 2) pacakge-level tracking only to achieve good result.

FuhuXia commented 5 months ago

Turned on slow query log on catalog-db in staging space. All page loading related query execution time is within a decent range. So slow query is not the cause. I suspect it is the amount of queries and DB latency across different AWS zone.

Right now we are taking another approach, loading the page without popular count then plug in popular count info with an AJAX call, which looks promising.

FuhuXia commented 5 months ago

AJAX recent view change deployed. Tested catalog page loading speed before and after, this is the data showing the improvement.

Page 1-10 loading time changes from avg 6.13 s to 1.58 s:

BEFORE AFTER
5.65 1.08
5.77 1.25
5.59 1.45
7.06 1.15
5.63 2.06
5.71 2.74
6.88 0.991
6.42 1.3
5.76 2.28
6.83 1.46

Page 150 - 159 loading time changes from avg 7.04 s to 1.72 s:

BEFORE AFTER
6.55 1.4
6.88 1.16
8.19 2.18
6.28 1.2
5.29 1.19
5.43 1.62
10.54 2.16
7.22 2.64
7.64 1.28
6.33 2.32
gujral-rei commented 5 months ago

The pages are loading very fast! Significant performance improvement.

btylerburton commented 5 months ago

+1 to what Mohan said. The site is blazing 🚀 now!

FuhuXia commented 5 months ago

Another side benefit: catalog-web CPU/mem usage drops lot. Will post some historical data comparison.

=================

Grabbed last 5 samples from GitHub catalog-web scaling action data, and compared with 5 samples of last week at the same time. The CPU usage dropped from 142.86% to 57.74%

CPU usage from 5 GH action data around 14:00 Friday on 2024-06-21 and 2024-06-14

BEFORE AFTER
149.42 42.34
154.84 59.26
154.64 64.96
109.46 80.86
145.92 41.3
FuhuXia commented 3 months ago

catalog-web instance count has been reduced to 3 for the past 6 weeks. The stats show it performs well.