Deployed Architecture¶

This is what is running today on the Tower Services cluster. Open the URLs below in a browser. You do not need to install anything.

These are examples of apps that have already been deployed. The cluster is for anyone who wants to share an app — see Tower Services and Add your own service.

How jobs work, and why the cluster uses Airflow, stays on Tower Services.

Open the apps¶

All public pages go through one website (Nginx). The path after the host name chooses the app.

Each app writes output under data/<app-name>/ (for example data/drone/, data/diy-lulc/). FileBrowser shows that tree.

What happens after you start a job¶

1. You work in that app’s page (/drone, /diy-lulc, …).
2. The app (not your browser) starts a job on Airflow.
3. The app checks status until the job is success or failed.
4. On success it writes files under data/<app-name>/.
5. You open FileBrowser (/file) and download that folder.

flowchart TB
  Browser[Your browser] --> Nginx[Cluster website]
  Nginx -->|"/drone"| Drone[Drone]
  Nginx -->|"/airflow"| Airflow[Airflow job runner]
  Nginx -->|"/bio-master"| BioMaster[CEM]
  Nginx -->|"/diy-lulc"| Lulc[DIY LULC]
  Nginx -->|"/file"| FB[FileBrowser]
  Drone -->|"start job and wait"| Airflow
  Lulc -->|"start job and wait"| Airflow
  Airflow -->|success| Data["data/app-name"]
  Data --> FB
  Browser -.->|download| FB

sequenceDiagram
  participant You
  participant Website as Cluster website
  participant App as The app
  participant Airflow as Job runner
  participant Data as data/app-name
  participant FB as FileBrowser
  You->>Website: /drone or /diy-lulc or /file
  Website->>App: send you to that app
  You->>App: start a job
  App->>Airflow: start job
  loop wait until success or failed
    App->>Airflow: is it done?
  end
  Airflow-->>App: success
  App->>Data: write files
  You->>FB: download data/app-name

Your browser never calls Airflow. The path is: website → the app → Airflow. Same idea as Tower Services — How a job runs.

Services and source code¶

How to install each app is in that repo’s README. Cluster-wide rules (mounts, STAC, checklist) are in Cluster Docker Services after you have read Tower Services.

To add or update a service on this host, or to fix proxy / Nginx / Airflow path issues: Deploy, update, and troubleshoot.

Shared host pieces (operators)¶