Add Integration Tests

[codecov-io]

Codecov Report

Merging #24 into master will not change coverage. The diff coverage is n/a.

@@          Coverage Diff           @@
##           master     #24   +/-   ##
======================================
  Coverage    93.8%   93.8%           
======================================
  Files          12      12           
  Lines         210     210           
======================================
  Hits          197     197           
  Misses         13      13

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 0b0a86f...03ba04b. Read the comment docs.

[oxinabox]

What do you think about the idea putting the integration tests in with the reference tests?

E.g.

@testset "BuzzFeedNews (whole repos)" begin

    @testset "Pres Camp" begin
        registration_code = generate(GitHub(), "https://github.com/BuzzFeedNews/presidential-campaign-contributions")

        @testset "Integration Test" begin 
            eval(parse(registration_code)) # evaluate the new code
            @test length(collect(readdir(datadep"Presidential Campaign Contributions"))) > 0
        end

        @test_reference "references/buzzfeed pres-camp.txt" registration_code # See if new code is same as old
    end 

    @test_reference "references/buzzfeed primates.txt" generate(GitHub(), "BuzzFeedNews/2015-07-primates")
end

Advantages I see is:

• it keeps it localized to anything that changed.
• It means it is easy to test the newly generated code against running correctly (integration tests) & matching old code (reference tests)
• Right now only the reference results have integration tests. Which means if the reference tests fail the integration test results are meaningly (maybe even misleading) since they are running on the old code.

[SebastinSanty]

Yes, right. That'll be great. I'll make the modifications.

[SebastinSanty]

@oxinabox Any comment on this? I have changed it according to your suggestion. Also I am not very sure about how to set environment variables in AppVeyor, as it is not covered much in their documentation. Should I rather define the env var in all the files than in the CI yml file?

[oxinabox]

What you've done looks right https://www.appveyor.com/docs/build-configuration/#custom-environment-variables

[oxinabox]

I have just pushed a commit to your branch which I think fixes A.V config

[oxinabox]

The A.V failure is the usual one I think