search

LibraryOfCongress / api.congress.gov

congress.gov API
601 stars 38 forks source link

(committee-report): `updateDate` format and some dates differ between the list and details responses #214

Closed ryparker closed 2 weeks ago

ryparker commented 3 months ago

The committee-report API list response's updateDate is in a format the differs from the details response. Also there are some dates that do not match between the two responses.

For example: hrpt416 (118th) list API: 2024-03-18 22:23:46+00:00 hrpt416 (118th) detail API: 2024-03-18T12:56:12Z

Request list API

curl --location 'https://api.congress.gov/v3/committee-report/118?format=json&api_key=<API_KEY>'

List response:

{
    "pagination": {
        "count": 657,
        "next": "https://api.congress.gov/v3/committee-report/118?offset=20&limit=20&format=json"
    },
    "reports": [
        {
            "chamber": "House",
            "citation": "H. Rept. 118-430",
            "congress": 118,
            "number": 430,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-22 08:05:32+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/430?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-429",
            "congress": 118,
            "number": 429,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-22 08:05:39+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/429?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-428",
            "congress": 118,
            "number": 428,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-20 20:26:14+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/428?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-427",
            "congress": 118,
            "number": 427,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-20 08:05:24+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/427?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-426",
            "congress": 118,
            "number": 426,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 20:26:12+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/426?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-425",
            "congress": 118,
            "number": 425,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-19 19:56:13+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/425?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-424",
            "congress": 118,
            "number": 424,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-19 17:41:15+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/424?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-423",
            "congress": 118,
            "number": 423,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-19 15:26:13+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/423?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-422",
            "congress": 118,
            "number": 422,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-19 16:56:16+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/422?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-421",
            "congress": 118,
            "number": 421,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 12:56:12+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/421?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-420",
            "congress": 118,
            "number": 420,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 20:26:12+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/420?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-419",
            "congress": 118,
            "number": 419,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-12 21:26:15+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/419?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-418",
            "congress": 118,
            "number": 418,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 12:56:12+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/418?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-417",
            "congress": 118,
            "number": 417,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-12 23:26:17+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/417?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-416",
            "congress": 118,
            "number": 416,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 22:23:46+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/416?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-416",
            "congress": 118,
            "number": 416,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 12:56:12+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/416?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-415",
            "congress": 118,
            "number": 415,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-08 23:26:13+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/415?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-414",
            "congress": 118,
            "number": 414,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 22:23:54+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/414?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-414",
            "congress": 118,
            "number": 414,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-08 23:26:13+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/414?format=json"
        },
        {
            "chamber": "House",
            "citation": "H. Rept. 118-413",
            "congress": 118,
            "number": 413,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-08 23:26:13+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/413?format=json"
        }
    ],
    "request": {
        "congress": "118",
        "contentType": "application/json",
        "format": "json"
    }
}

Notice the list API's updateDate for hrept 416 is 2024-03-18 22:23:46+00:00:

 {
            "chamber": "House",
            "citation": "H. Rept. 118-416",
            "congress": 118,
            "number": 416,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-03-18 22:23:46+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/416?format=json"
        },

Request details of hrept 416

curl --location 'https://api.congress.gov/v3/committee-report/118/hrpt/416?format=json&api_key=<API_KEY'

Details response:

{
    "committeeReports": [
        {
            "associatedBill": [
                {
                    "congress": 118,
                    "number": "2925",
                    "type": "HR",
                    "url": "https://api.congress.gov/v3/bill/118/hr/2925?format=json"
                }
            ],
            "chamber": "House",
            "citation": "H. Rept. 118-416",
            "committees": [
                {
                    "name": "Natural Resources Committee",
                    "systemCode": "hsii00",
                    "url": "https://api.congress.gov/v3/committee/house/hsii00?format=json"
                }
            ],
            "congress": 118,
            "isConferenceReport": false,
            "issueDate": "2024-03-07T05:00:00Z",
            "number": 416,
            "part": 1,
            "reportType": "H.Rept.",
            "sessionNumber": 2,
            "text": {
                "count": 2,
                "url": "https://api.congress.gov/v3/committee-report/118/hrpt/416/text?format=json"
            },
            "title": "MINING REGULATORY CLARITY ACT OF 2024",
            "type": "HRPT",
            "updateDate": "2024-03-18T12:56:12Z"
        }
    ],
    "request": {
        "congress": "118",
        "contentType": "application/json",
        "format": "json",
        "reportNumber": "416",
        "reportType": "hrpt"
    }
}

list api: 2024-03-18 22:23:46+00:00 details api:2024-03-18T12:56:12Z

I had expected the date format and time to be the same.

rbram commented 3 months ago

Hello. We have created a ticket for this.

apreiter18 commented 3 weeks ago

Hello @ryparker - can you confirm or correct if update date dates now match between the list and detail levels? FYI - the format is a different piece of this puzzle but we have a ticket in the queue to streamline this, too. Thanks!

ryparker commented 2 weeks ago

It looks like the updateDate formats and times still differ.

List API: 2024-06-17 20:36:10+00:00 Details API: 2024-06-17T20:41:11Z

list api for congress 118 (same curl as OP):

{
    "pagination": {
        "count": 807,
        "next": "https://api.congress.gov/v3/committee-report/118?offset=20&limit=20&format=json"
    },
    "reports": [
        {
            "chamber": "House",
            "citation": "H. Rept. 118-554",
            "congress": 118,
            "number": 554,
            "part": 1,
            "type": "HRPT",
            "updateDate": "2024-06-17 20:36:10+00:00",
            "url": "https://api.congress.gov/v3/committee-report/118/HRPT/554?format=json"
        },
...

Details for HRPT 554 of 118th

{
    "committeeReports": [
        {
            "associatedBill": [
                {
                    "congress": 118,
                    "number": "8771",
                    "type": "HR",
                    "url": "https://api.congress.gov/v3/bill/118/hr/8771?format=json"
                }
            ],
            "chamber": "House",
            "citation": "H. Rept. 118-554",
            "committees": [
                {
                    "name": "Appropriations Committee",
                    "systemCode": "hsap00",
                    "url": "https://api.congress.gov/v3/committee/house/hsap00?format=json"
                }
            ],
            "congress": 118,
            "isConferenceReport": false,
            "issueDate": "2024-06-14T04:00:00Z",
            "number": 554,
            "part": 1,
            "reportType": "H.Rept.",
            "sessionNumber": 2,
            "text": {
                "count": 2,
                "url": "https://api.congress.gov/v3/committee-report/118/hrpt/554/text?format=json"
            },
            "title": "STATE, FOREIGN OPERATIONS, AND RELATED PROGRAMS APPROPRIATIONS BILL, 2025",
            "type": "HRPT",
            "updateDate": "2024-06-17T20:41:11Z"
        }
    ],
    "request": {
        "congress": "118",
        "contentType": "application/json",
        "format": "json",
        "reportNumber": "554",
        "reportType": "hrpt"
    }
}
apreiter18 commented 2 weeks ago

@ryparker Hi Ryan - strange! When I look at the list level here is what I see for 118 HRept 554: image

and then for the detail level for the same report: image

I am wondering if there was a recent update to this one and the list level displayed the updated <updateDate> element before the detail level? If so, I will keep an eye out for other examples of this.

We hope to have the <updateDate> formats adjusted this summer, too, so that they all display in the same format.

ryparker commented 2 weeks ago

Oh this is interesting. I may have called the list API just before an update, and called the details API just after the update. I see that 2024-06-17 20:56:10+00:00 was only 9 minutes ago and my previous comment was about 21 minutes ago, so there must be some operation running on the data right now.

ryparker commented 2 weeks ago

I'll test again this evening.

apreiter18 commented 2 weeks ago

Thanks @ryparker - if you notice anything that requires us to investigate, please let us know and we will take a look!

ryparker commented 2 weeks ago

Looks like the updateDate values (not format) are matching up.