barbh1307 / merge_DLA_LESO_data

Merge the data from the DLA LESO Public Information (https://www.dla.mil/DispositionServices/Offers/Reutilization/LawEnforcement/PublicInformation/) site to build a dataset so the information can be monitored and compared from quarter to quarter.
GNU General Public License v3.0
0 stars 0 forks source link

Exploring Defense Logistics Agency Law Enforcement Support Office Public Data

The goal of this repository is to create a dataset from DLA LESO public data that can be integrated with other policing practices datasets.

LESO stands for Law Enforcement Support Office. It is a branch of the Defense Logistics Agency (a.k.a. DLA). The purpose of the office is to manage the transfer of excess military material to law enforcement agencies in U.S. states and territories for a program known as the '1033 Program.' It is codified in 10 U.S.C. § 2576a. More information on this program can be found in the Overview of the Program section of this document.

The data source for this project is the DLA LESO Public Information website. This repository uses two files published quarterly on that site. LESO Property Transferred to Participating Agencies (DISP_AllStatesAndTerritories_yyyymmdd.xlsx) is the inventory of all excess military material transfered to law enforcement agencies as of the most recent quarter. LESO Information for Shipments (Transfers) and Cancellations of Property (DISP_Shipments_Cancellations_yyyymmdd_to_yyyymmdd.xlsx) contains all the requests/shipments and cancellations made during the most recent quarter. See Notes on the Data section of this document for important notes about the data.

There are three kinds of Python notebooks in this repository. Notebooks in the CheckOriginalFiles folder perform checks to ensure the latest quarterly files match previous versions of the data files. Notebooks in MergeOriginalFiles folder merge the data files in such a way that the original data could be recreated. Notebooks in ExploreOriginalFiles folder do simple explorations of the original data.

This repository contains a zipped file containing merged data:

30 Oct 2021    18905882    military_equipment_distributions_to_law_enforcement_agencies_us.zip
               SHA256      E0F09E493370BFC7F7C9227DC3981F20B4E9F70BDE7BBE05E5FAD3909A7372B7

Citation: Hawes, B. (2021, October). Merged Data from DLA LESO Public Data. Retrieved [to be filled in] from [link to this repository]

How to use the notebooks

Step 1

Other Projects Using DLA LESO Public Data

This project is forked from OpenTwinCities police-militarization-data-analysis repository.

An interesting kaggle dataset that has its own version of this data is JohnM's Police Violence & Racial Equity Part 2 of 3.

Overview of the Program

The following information is from DLA LESO FAQ unless otherwise specified.

The Defense Logistics Agency (DLA) Law Enforcement Support Office (LESO) 1033 Program comes from the National Defense Authorization Act (NDAA). The 2016 version of this act, also known as FY16 NDAA, requires programs that transfer excess military supplies to law enforcement agencies to make certain data about those transfers public. '1033' referes to the section of FY97 NDAA where the modern version of these types of transfers originated. The exact wording for what data is to be made public is defined in 10 U.S.C. § 2576a. This is one way that law enforcement agencies in the U.S. and its territories can acquire military equipment, but there are others that are outside the scope of this repository.

Public Data Requirements

10 U.S.C. § 2576a requires publishing of a current inventory of all items transferred through the 1033 Program. It appears that this inventory can be found under LESO Property Transferred to Participating Agencies section of the DLA LESO Public Information website. For data analysis, be aware that, though the file has records going back to 1980, materials appear and disappear from the file outside the previous quarter. This may be related to the way controlled and non-controlled materials are handled (see Notes on the Data).

Another bit of data that is required to be made public are pending requests for transfers. The LESO Information for Shipments (Transfers) and Cancellations of Property section of the DLA LESO Public Information website has a file that contains quarterly information regarding requests, also known as shipments, and cancellations. This file has data only from the current quarter. Eventually this repository would like to build a dataset where requests, cancellations and transfers are connected or traceable.

There are other requirements for publishing data about this program, like all law enforcement agencies should make protocols for the appropriate use, supervision and evaluation of effectiveness of controlled property (including auditing and accountability policies) public, but that public data outside the current scope of this repository.

Notes on the Data

The DLA LESO 1033 Program distinguishes between 'controlled' and 'non-controlled' materials. Controlled materials are defined as having 'DEMIL Codes' of {B,C,D,E,F,G,Q3} in the DoD Manual 4160.21-M. This is more specific that the definition in 10 U.S.C. § 2576a(f).

Controlled materials must be returned to the DLA when a law enforcement agency no longer has need of them. Non-controlled materials become the property of the law enforcement agency after one year from the date of transfer. These changes appear to be implicitly handled by additional or missing records from quarter to quarter in the LESO Property Transferred to Participating Agencies (DISP_AllStatesAndTerritiories_yyyymmdd.xlsx) file.

The DLA LESO 1033 Program distributes excess military materials to agencies whose primary purpose is the enforcement of laws particularly those related to drugs, terrorism and border patrol. Goverment bodies at the federal, state and local level are included, as are agencies in U.S. territories. The FAQ states:

Every law enforcement agency is now vetted through the National Crime Information Center database, ensuring the Originating Agency Identifier number is associated to the agency requesting enrollment into the program. An ORI number is distributed via the FBI Criminal Justice Information Services.

The Originating Agency Identifier (ORI) information for participating agencies is not included on the DLA LESO Public Information website data. However, having the ORI associated with the participating agency would be valuable for transparency as well as be a definitive way to track policing agencies across crime reporting datasets. This repository will eventually incorporate the ORI into DLA LESO public data. A file called 'Agency Participation Data' from the FBI Crime Explorer website contains ORIs for agencies in the U.S. states and territories. More information about this number can be found at the FBI Criminal Justice Information Services website.

An alternate source for the XLSX files can be found at the DLA's Reading Room.

Timeline of NDAA as related to the DLA LESO 1033 Program

The program for transferring excess military supplies to law enforcement agencies as we know it today originated in the FY90-91 NDAA. Some important highlights, as found on the DLA LESO FAQ are listed here: