Infrastructure as code - Githubissues

ghost commented 6 years ago

References:

I don't think it is possible to have a "dev ops" environment without some kind of Configuration Management Tool. They make it possible to configure an environment through scripts. The big advantage of a tool like this is that new virtual machine or container instances can be easily created or updated. The most common solutions here I think are Ansible, Puppet, Chef and Salt.

It is probably best to pick one tool and have practical scripting exercises how to an enviroment can be configured programmatically.

monperrus commented 6 years ago

Hi Göran,

Thanks for your suggestion.

Among Ansible, Puppet, Chef and Salt, what's the one with the best documentation, in particular getting started and tutorials pages to your opinion?

monperrus commented 5 years ago

Terminology: infrastructure as code (IaC) #22

monperrus commented 5 years ago

Reading material: GitOps: A Path to More Self-Service IT https://cacm.acm.org/magazines/2018/9/230599-gitops/fulltext

"Use Cases for GitOps. DNS is an obvious place to start, as are VM creation, container maintenance and orchestration, firewall rules, website updates, blog posts, email aliases and mailing lists, and just about any virtual infrastructure or one with a configuration file or API."

MatsJonsson commented 5 years ago

We've done this with Ansible and Salt in a couple of big projects, only to end up with huge amounts of stuff just to get the actual stuff working.

Terraform

The move to Terraform and Hashicorp Configuration Language (HCL) made life a lot easier https://www.terraform.io/.

bittermandel commented 5 years ago

We're running Salt extensively on thousands of nodes. It's working great for us and gives us great power in controlling our "standard" environments

alanmcg commented 5 years ago

I have seen this implemented with puppet, both badly and very well, in different organisations.

monperrus commented 5 years ago

How good is your puppet? an empirically defined and validated quality model for puppet https://pure.tudelft.nl/portal/files/37386939/how_good_is_your_puppet.pdf

bbaudry commented 5 years ago

Molecule is a tool for testing ansible scripts https://molecule.readthedocs.io/en/stable/#

monperrus commented 5 years ago

Using Testinfra with Ansible to verify server state https://opensource.com/article/19/5/using-testinfra-ansible-verify-server-state

monperrus commented 4 years ago

Python library to create AWS CloudFormation descriptions https://github.com/cloudtools/troposphere

monperrus commented 4 years ago

Pulumi - Infrastructure as Code https://www.pulumi.com/

bbaudry commented 4 years ago

The 'as Code' Activities: Development Anti-patterns for Infrastructure as Code http://arxiv.org/abs/2006.00177

bbaudry commented 3 years ago

Automating web applications proxying, DNS registration and TLS termination with ansible

https://bpetit.nce.re/2018/03/automating-web-applications-proxying-dns-registration-and-tls-termination-with-ansible/

bbaudry commented 3 years ago

kustomize lets you customize raw, template-free YAML files for multiple purposes

monperrus commented 3 years ago

Free version of Morris' book on infrastructure as code: https://us-east-1.linodeobjects.com/marketing-assets/Infrastructure_as_Code_2E-ER_Linode.pdf

monperrus commented 2 years ago

See accepted papers at CONFLANG, workshop on the design, the theory, the practice and the future evolution of configuration languages.

https://2021.splashcon.org/home/conflang-2021#event-overview

monperrus commented 2 years ago

Luke Hoban on Infrastructure as Code IEEE Software

monperrus commented 2 years ago

Dozer: Migrating Shell Commands to Ansible Modules via Execution Profiling and Synthesis. (arXiv:2203.12065v1 [cs.SE])

monperrus commented 2 years ago

CUE: Configure Unify Execute "Validate, define, and use dynamic and text-based data" https://cuelang.org/

monperrus commented 2 years ago

Dhall is a programmable configuration language that you can think of as: JSON + functions + types + imports https://dhall-lang.org/

matsskoglund commented 2 years ago

Tool for vulnerability scanning of Infrastructure as Code https://www.checkov.io/

monperrus commented 2 years ago

Modus is a language for building Docker/OCI container images, it uses logic programming to express interactions among build parameters, specify complex build workflows, automatically parallelise and cache builds, help to reduce image size, and simplify maintenance. https://modus-continens.com/

Paper: "Modus: a Datalog dialect for building container images."

cc/ @mechtaev @barr

mechtaev commented 2 years ago

Nickel's purpose is to automate the generation of static configuration files - think JSON, YAML, XML, or your favorite data representation language - that are then fed to another system. It is designed to have a simple, well-understood core: it is in essence JSON with functions. https://nickel-lang.org/

This is relevant to Dhall.

mechtaev commented 2 years ago

Earthly is a CI/CD framework that allows you to develop pipelines locally and run them anywhere. Earthly leverages containers for the execution of pipelines. This makes them self-contained, repeatable, portable and parallel.

monperrus commented 2 years ago

HashiCorp Packer Packer is a free and open source tool for creating golden images for multiple platforms from a single source configuration. https://www.packer.io

monperrus commented 2 years ago

GLITCH: an Intermediate-Representation-Based Security Analysis for Infrastructure as Code Scripts http://arxiv.org/pdf/2205.14371