chore/nixify terra by r17x · Pull Request #10 · evilfactorylabs/area13

r17x · 2022-12-27T07:17:20Z

chore: update git ignores
feat: use flake and terranix
chore: pre-commit
- handle *.nix files in commit
- handle *.tf files in commit
terraform configuration over nix and generated config.tf.json

Commands Based on `flake.nix`

nix build
- generate config.tf.json from *.nix modules that configured in import modules
nix run .#build
- cp result to config.tf.json
nix run .#apply
- under the hood it's run terraform init && terraform apply and generated (when nothing) config.tf.json
nix run .#destroy
- under the hood it's run terraform init && terraform destroy and generated (when nothing) config.tf.json
nix develop (pure shell environment) - You don't need to setup anymore (see devShells in flake.nix)
- nix develop -C $SHELL - if you want to impure shell environment - which is mean area13 environment + your computer environment.

this changes not breaking our workflow: * nix-shell refer to shell.nix * nix develop refer to flake.nix#devShells * TODO: rewrite *.tf to .nix

r17x · 2022-12-27T07:20:24Z

shell.nix

+  )
+  {
+    src = ./.;
+  }).shellNix


if you want to changes shell, please update in flake.nix at attribute devShell that run same function as before in shell.nix (mkShell).

r17x · 2022-12-27T12:05:33Z

@faultables could you continue this branch ?

faultables · 2022-12-28T02:29:12Z

@faultables could you continue this branch ?

gw pelajari tentang terranix dulu since both hcl and nix offer declarative configuration but with their own dsl

faultables · 2022-12-28T02:41:43Z

tantangannya ini kita pakai atlantis yg technically cuma buat jalanin terraform apply di server-side. problemnya atlantis ga kenal terranix. tp i guess pre workflow hooks bisa membantu

r17x · 2022-12-28T03:14:12Z

@faultables berarti kita commit aja hasil generated dari terranix, outputnya itu config.tf.json dimana udah dikumpulin semua.

do_vpc.nix
do_XXX.nix
   |------> config.tf.json

r17x · 2022-12-28T03:15:46Z

flake.nix

+
+          # nix flake check
+          checks = {
+            pre-commit-check = pre-commit-hooks.lib.${system}.run {


Example pre-commit @faultables

r17x · 2022-12-28T03:25:44Z

config.tf.json

@@ -0,0 +1 @@
+{}


Here's a file will be used for terraform apply @faultables

{} bakalan terisi berdasarkan modules = [] pada flake.nix:31:33 @faultables

nah eventually harus jalanin nix build ini somewhere kan (local/CI/atlantis server)

@faultables development mode generated config.tf.json trus push ke repository ini.

atlantis referensinya kerepo ini. so, terraform apply jadi possible diatlantis.

faultables · 2022-12-28T04:02:55Z

ok gimme a sec

faultables · 2022-12-28T04:13:14Z

r17x · 2022-12-28T04:15:23Z

@faultables yes, in /nix/store and area13/config.tf.json.

faultables · 2022-12-28T04:18:23Z

itu dia gan unless kita ga buat symlink. jadi harus:

a) run nix-build(1) di local
b) run di CI—migrate si atlantis
c) ajarin atlantis terranix

r17x · 2022-12-28T04:22:14Z

c) itu mksdnya gimana @faultables

pkg atlantis ada nih

faultables · 2022-12-28T04:30:07Z

flow yg sekarang itu seperti ini

faultables · 2022-12-28T04:37:00Z

klo rewrite *.tf ke *.nix pakai terranix, berarti si terraform harus ngerti apa yang mau dia lakuin kan, nah dalam kasus ini, source of truth nya adalah file config.tf.json

untuk generate config.tf.json ini harus jalanin nix build, klo config.tf.json di generate di local, ini paling gampang, tapi ada extra step yang harus dilakukan di local. dan juga versioning config.tf.json via git plus via nix agak redundant

klo di CI, ini kita bisa ga perlu pakai atlantis, dan /nix/store/xxx-config.tf.json bisa di store sebagai artifact atau mungkin release. extra step nya bikin github actions

klo jalanin nix-build nya di server tempat atlantis jalan, ini cuma butuh setup si server tersebut bisa pakai flake, dan setup prehook untuk atlantis sebelum dia melakukan pekerjaannya (e.g jalanin terranix ... sebelum doi terraform plan)

faultables · 2022-12-28T05:02:53Z

gw coba ajarin atlantis buat pakai terranix

faultables · 2022-12-28T05:10:26Z

atlantis plan

faultables · 2022-12-28T05:19:15Z

atlantis plan

anakmagang · 2022-12-28T05:37:21Z

Ran Plan for dir: . workspace: area13

/root/.nix-profile/bin:/nix/var/nix/profiles/default/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/etc/atlantis/.atlantis/bin
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty


No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

▶️ To apply this plan, comment:
- atlantis apply -w area13
🚮 To delete this plan click here
🔁 To plan this project again, comment:
- atlantis plan -w area13

⏩ To apply all unapplied plans from this pull request, comment:
- atlantis apply
🚮 To delete all plans and locks for the PR, comment:
- atlantis unlock

faultables · 2022-12-28T05:39:06Z

@faultables gak perlu pakai -o harusya

defaultnya bakal generate result kan dan no sure terraform tau itu

r17x · 2022-12-28T05:43:51Z

@faultables check comment ini #10 (comment)

anakmagang · 2022-12-28T05:52:04Z

Ran Plan for dir: . workspace: area13

Plan Error

Show Output

running "export PATH=/root/.nix-profile/bin:/nix/var/nix/profiles/default/bin:$PATH; nix build; nix run .#build" in "/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13": exit status 1: running "export PATH=/root/.nix-profile/bin:/nix/var/nix/profiles/default/bin:$PATH; nix build; nix run .#build" in "/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13": 
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
error: syntax error, unexpected ')', expecting ';'

       at /nix/store/67jnjzj1b4c18arq6wxjp8h0c26gncfb-source/flake.nix:118:12:

          117|             defaultApp = self.apps.${system}.apply;
          118|           });
             |            ^
          119|         }
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
error: syntax error, unexpected ')', expecting ';'

       at /nix/store/67jnjzj1b4c18arq6wxjp8h0c26gncfb-source/flake.nix:118:12:

          117|             defaultApp = self.apps.${system}.apply;
          118|           });
             |            ^
          119|         }

anakmagang · 2022-12-28T05:56:43Z

Ran Plan for dir: . workspace: area13

warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
this derivation will be built:
  /nix/store/cwvgwc1jfwxfgxg5ki450j0ir0wpl656-apply.drv
building '/nix/store/cwvgwc1jfwxfgxg5ki450j0ir0wpl656-apply.drv'...


No changes. Your infrastructure matches the configuration.

Terraform has compared your real infrastructure against your configuration
and found no differences, so no changes are needed.

▶️ To apply this plan, comment:
- atlantis apply -w area13
🚮 To delete this plan click here
🔁 To plan this project again, comment:
- atlantis plan -w area13

⏩ To apply all unapplied plans from this pull request, comment:
- atlantis apply
🚮 To delete all plans and locks for the PR, comment:
- atlantis unlock

anakmagang · 2022-12-28T06:03:58Z

Ran Plan for dir: . workspace: area13

Plan Error

Show Output

running "/usr/bin/terraform init -input=false" in "/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13": exit status 1
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
this derivation will be built:
  /nix/store/88wbh2i8mv3k7wv2n3nr215j5cn4f20n-config.tf.json.drv
building '/nix/store/88wbh2i8mv3k7wv2n3nr215j5cn4f20n-config.tf.json.drv'...
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
this derivation will be built:
  /nix/store/2wr04q69pq6qdb0kdgfks6cd60f56vba-apply.drv
building '/nix/store/2wr04q69pq6qdb0kdgfks6cd60f56vba-apply.drv'...

There are some problems with the configuration, described below.

The Terraform configuration must be valid before initialization so that
Terraform can determine which modules and providers need to be installed.
╷
│ Error: Duplicate resource "digitalocean_vpc" configuration
│ 
│   on do_vpc.tf line 1:
│    1: resource "digitalocean_vpc" "default_sgp" {
│ 
│ A digitalocean_vpc resource named "default_sgp" was already declared at
│ config.tf.json:4,22-23. Resource names must be unique per type in each
│ module.
╵

anakmagang · 2022-12-28T06:05:14Z

Ran Plan for dir: . workspace: area13

Show Output

warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
this derivation will be built:
  /nix/store/607rwwzq15wjmqrvc5z9np3xcghwgr0y-config.tf.json.drv
building '/nix/store/607rwwzq15wjmqrvc5z9np3xcghwgr0y-config.tf.json.drv'...
warning: Git tree '/etc/atlantis/.atlantis/repos/evilfactorylabs/area13/10/area13' is dirty
this derivation will be built:
  /nix/store/5wlq1bl5lrm4vprhm7xz9nim3lwmbjq2-apply.drv
building '/nix/store/5wlq1bl5lrm4vprhm7xz9nim3lwmbjq2-apply.drv'...


Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
+ create

Terraform will perform the following actions:

  # digitalocean_vpc.dummy_sgp will be created
+ resource "digitalocean_vpc" "dummy_sgp" {
      + created_at = (known after apply)
      + default    = (known after apply)
      + id         = (known after apply)
      + ip_range   = "10.105.69.0/20"
      + name       = "dummy-sgp"
      + region     = "sgp1"
      + urn        = (known after apply)
    }

Plan: 1 to add, 0 to change, 0 to destroy.

▶️ To apply this plan, comment:
- atlantis apply -w area13
🚮 To delete this plan click here
🔁 To plan this project again, comment:
- atlantis plan -w area13

Plan: 1 to add, 0 to change, 0 to destroy.

⏩ To apply all unapplied plans from this pull request, comment:
- atlantis apply
🚮 To delete all plans and locks for the PR, comment:
- atlantis unlock

faultables · 2022-12-28T06:05:46Z

not bad

r17x · 2022-12-28T06:06:17Z

@faultables command init pada atlatis.yaml itu ngelakukan apa sih under the hoodnya?

faultables · 2022-12-28T06:10:23Z

gw pengen strukturnya direktorinya kek gini:

.
├── digitalocean
├── digitalocean.nix
├── linode
├── linode.nix
├── aws
├── aws.nix
├── xhamster
├── github
└── shell.nix

jadi di flake.nix nya kek gini misalnya:

modules = [ ./variables.nix ./outputs.nix ./digitalocean.nix ./linode.nix ./aws.nix ];

r17x · 2022-12-28T06:12:34Z

Replied for #10 (comment) @faultables

Bisa aja

faultables · 2022-12-28T06:15:10Z

@faultables command init pada atlatis.yaml itu ngelakukan apa sih under the hoodnya?

terraform init harusnya

faultables · 2022-12-28T06:15:24Z

Replied for #10 (comment) @faultables

Bisa aja

nice

faultables · 2022-12-28T06:20:27Z

jan lupa rebase banyak commit messages keramat

r17x · 2022-12-28T06:20:50Z

@faultables

terraform init harusnya

LOL kita bisa bikin over nix dan hanya jalanin nix run aja.

nice

sisa masukin filePath nya (seperti digambar)

faultables · 2022-12-28T06:24:10Z

@faultables

terraform init harusnya

LOL kita bisa bikin over nix dan hanya jalanin nix run aja.

ga sesimple itu kek nya ada manage lock state or something

nice

sisa masukin filePath nya (seperti digambar)

gw ga tau cara kek

import dns as do_dns from './digitalocean/dns.nix'
import vpc as do_vpc from './digitalocean/vpc.nix'

r17x · 2022-12-28T06:26:22Z

@faultables

gw ga tau cara kek

Kenapa harus dibuat dns as do_dns ?

ekspektasi di config.tf.json hasilnya kek gimana?

faultables · 2022-12-28T07:50:23Z

@faultables

gw ga tau cara kek

Kenapa harus dibuat dns as do_dns ?

ekspektasi di config.tf.json hasilnya kek gimana?

klo misalnya nix handle collision (e.g bisa define sebagai dict yg mana digitalocean.dns dan linode.dns adalah 2 hal yang berbeda) ga pakai "import alias" pun ga masalah

r17x · 2022-12-28T10:31:12Z

contoh digitalocean dan linode dong ? @faultables

faultables · 2022-12-28T15:10:16Z

itu yg pakai prefix do_ dan linode_

faultables · 2023-09-17T08:45:59Z

ini blocker nya apa ya? karena ini nge-block #11

faultables · 2023-09-17T09:01:25Z

atlantis unlock

anakmagang · 2023-09-17T09:01:28Z

All Atlantis locks for this PR have been unlocked and plans discarded

r17x assigned faultables Dec 27, 2022

r17x mentioned this pull request Dec 27, 2022

Look a the sky! #8

Open

r17x added 2 commits December 27, 2022 14:18

chore: update git ignores

4c0ec2d

feat: use flake and terranix

49d7eb2

this changes not breaking our workflow: * nix-shell refer to shell.nix * nix develop refer to flake.nix#devShells * TODO: rewrite *.tf to .nix

r17x force-pushed the chore/nixify-terra branch from 6516001 to 49d7eb2 Compare December 27, 2022 07:19

r17x commented Dec 27, 2022

View reviewed changes

r17x requested a review from faultables December 27, 2022 07:41

chore: add nix flake check for check source

af9d13f

chore: enable pre-commit when run nix-shell or nix develop

d738118

chore: commit config.tf.json

4ddad67

r17x commented Dec 28, 2022

View reviewed changes

r17x added 2 commits December 28, 2022 10:32

chore: fix terraform pre-commit attributes

c35b459

chore: add validate terraform config

bcf7ac8

faultables added 2 commits December 28, 2022 12:10

refactor: nixify do_vpc

0fa3aad

chore: update atlantis

f70a7d5

feat: just testing

8449ae6

faultables added 2 commits December 28, 2022 12:51

feat: yes

8240f55

feat: change something

eeeb3b5

fix: my bad

6917421

feat: create dummy vpc

60b183b

fix: duplicates

d159a64

anakmagang mentioned this pull request Sep 17, 2023

move evilfactorylabs.social #11

Merged

Conversation

r17x commented Dec 27, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Commands Based on flake.nix

Uh oh!

r17x Dec 27, 2022

Choose a reason for hiding this comment

Uh oh!

r17x commented Dec 27, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

r17x commented Dec 28, 2022

Uh oh!

r17x Dec 28, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

r17x Dec 28, 2022

Choose a reason for hiding this comment

Uh oh!

r17x Dec 28, 2022

Choose a reason for hiding this comment

Uh oh!

faultables Dec 28, 2022

Choose a reason for hiding this comment

Uh oh!

r17x Dec 28, 2022

Choose a reason for hiding this comment

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

r17x commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

r17x commented Dec 28, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

anakmagang commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

r17x commented Dec 28, 2022

Uh oh!

anakmagang commented Dec 28, 2022

Uh oh!

anakmagang commented Dec 28, 2022

Uh oh!

anakmagang commented Dec 28, 2022

Uh oh!

anakmagang commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

r17x commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

r17x commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

Uh oh!

faultables commented Dec 28, 2022

r17x commented Dec 27, 2022 •

edited

Loading

Commands Based on `flake.nix`

r17x Dec 28, 2022 •

edited

Loading

r17x commented Dec 28, 2022 •

edited

Loading

r17x commented Dec 28, 2022 •

edited

Loading

r17x commented Dec 28, 2022 •

edited

Loading