rayui / scooby Goto Github PK

agent config creates a file with contents:

dtoverlay=disable-wifi
dtoverlay=disable-bt

this seems to break pi3.

should probably be changed in the shared base image so is present for all agents

something slayerish

use github artefact storage?

could save a few hundred megabytes

Master node is currently set to wait on boot

To get current network on boot setting: sudo raspi-config nonint get_boot_wait
To enable waiting for network on boot: sudo raspi-config nonint do_boot_wait 0

It causes boot time to increase significantly. Investigate if it is possible to disable and still work

Create /etc/scooby/conf

populate with environment variables from local .env file
source from there

exclude all secrets

After all features complete, update and review README

• add instructions for how to use as template
• add instructions for how to update from template
• explain what packer token is
• update build section
  • building with default values creates a only master k3s node
  • it has no k3s deployments
  • you cannot ssh in to it
• artefact storage
• s3 uploader
• gotchas
  • rtl8151
  • serve dhcp to external network
  • cloud-init goes silent for about 4 minutes on first boot
  • smarter devices
• correct missing variable in agent config block code example
• check for spelling mistakes
• check for spelling grammar
• check for spelling tone and brevity

Is it needed?
If not, remove it from server config

Provide a way to set up the cluster such

• master node has one nic
• all cluster nodes are on the same subnet
• a router is connected to the subnet
• external traffic is routed to the cluster via the router not the master node

• Manifests
• Udev
• Local dnsmasq conf
• /usr/local/bin

keep safe somewhere!

it's done in a bad way rn and probably doesn't work
move to boot config script
and agent config script

new file in each /etc/scooby/agets/agent folder?

if statement. change env.SECRET to secrets.SECRET

Add script to /usr/local/bin to add agent from agent description file in /etc/scooby/agents at runtime

e.g.
master node with pihole
master and agent node with nginx and lighttpd
master node and two agent nodes with prometheus and grafana

Now almost all config is put into the server and client configurations on build, it should be possible to remove the need to serve cloud-init config via http and instead serve it from the client's own boot directory

Security issue

Don't copy agent image as a separate file
Instead, extend disk image by 2G, dd base boot and root partitions at start of new empty space. These will serve as the agent base
Apply server changes to original partitions (at start of disk)

This ticket is complete when it is known

• whether root fs can be mounted as overlay
• if we can share root image with agents

on completion:

• create ticket to mount server root fs as overlay partition, share it with agents and remove agent partitions

note:
overlayfs is a kernel service

rsync --info=progress2 is too noisy for github actions
investigate output options and implement or remove progress

add placeholder README files with examples
will also help add correct directory structure to help get started

Bring back S3 uploads for server image

If AWS secret keys are set, upload image to bucket

make part of gh workflow yaml only

If agents hit swap things get really hairy! add support for optional swap partition

Build on push to branch for better commit history

still works! shouldn't work!

LC_EXTERNAL_DNS -> LC_PRIMARY_DNS
LC_INTERNAL_DNS -> LC_SECONDARY_DNS