QuickPay-Operational-Performance / Data-and-code

Data and code for econometric analysis
0 stars 0 forks source link

Trends for cost and fixed price contracts #11

Closed vibhuti6 closed 4 years ago

vibhuti6 commented 4 years ago

Filters used:

Past Trends Infrastructure contracts
psc_code_C1 psc_code_N0
psc_code_J0 psc_code_Y1
psc_code_Z2 psc_code_C2
psc_code_H2 psc_code_H3
psc_code_F1 psc_code_J9
psc_code_K0 psc_code_Z1
psc_code_F0 psc_code_H9
psc_code_H1 psc_code_F9

psc_code_B5

vob2 commented 4 years ago

Would it be too much work to look at the project delays as % of the originally forecasted completion date?

Would it be possible to present some measure of variability around these averages. E.g., confidence bands or box plots? The variation for some of the graphs is really huge and I wonder if this is due to a few outliers.

vibhuti6 commented 4 years ago

Hi Vlad, I will try to add the measures that you suggested, and get back to you on this issue. Thanks.

vibhuti6 commented 4 years ago

Hi Vlad, I believe the large variation in these graphs comes from very few contracts being assigned cost pricing instead of fixed price for the same task. See the graph that I plotted for all the 4-letter PSC codes in this sample.

num_contracts

I also obtained the box plots as below. Note that the following graphs only take into account first two letters of a PSC code.

fiscal_year_fp_boxplot fiscal_year_cost_boxplot psc_code_fp_boxplot psc_code_cost_boxplot

vibhuti6 commented 4 years ago

And here are the graphs for percentage delays.

Percentage delay Infrastructure contracts
percentage_delays_psc_code_C2 percentage_delays_psc_code_Z2
percentage_delays_psc_code_J0 percentage_delays_psc_code_Y1
percentage_delays_psc_code_K0 percentage_delays_psc_code_H3
percentage_delays_psc_code_H1 percentage_delays_psc_code_J9
percentage_delays_psc_code_F1 percentage_delays_psc_code_H2
percentage_delays_psc_code_Z1 percentage_delays_psc_code_N0
percentage_delays_psc_code_H9 percentage_delays_psc_code_F9
percentage_delays_psc_code_B5 percentage_delays_psc_code_F0

percentage_delays_psc_code_C1

vob2 commented 4 years ago

Hi Vlad, I believe the large variation in these graphs comes from very few contracts being assigned cost pricing instead of fixed price for the same task. See the graph that I plotted for all the 4-letter PSC codes in this sample.

num_contracts

I also obtained the box plots as below. Note that the following graphs only take into account first two letters of a PSC code.

fiscal_year_fp_boxplot fiscal_year_cost_boxplot psc_code_fp_boxplot psc_code_cost_boxplot

Thanks, Vibhuti! I see. So, if I understood correctly, for a particular PSC code the use of contracts is imbalanced. It is either primarily fixed price or primarily cost plus and rarely both. Then, either we would have to aggregate across PSC codes, which is probably not going to work or not use fixed vs cost plus as the differentiation between treatment and control. I guess this is more ammunition for looking at small vs non-small business instead as we already decided to do.

vibhuti6 commented 4 years ago

Yes, that's correct. Also, note that in these graphs I have aggregated different types of fixed price and cost contracts into one group each. They each have several categories, see the screenshot below.

Screen Shot 2020-03-02 at 5 24 58 PM

So my sense is that it may be more difficult to find a suitable match if we look closely. For example, finding a contract under "fixed price award fee" and another under "cost plus award fee" for the same PSC code.