Scaling

For running large workflows, you'll typically need to scale the controller to match.

Horizontally Scaling

You cannot horizontally scale the controller.

You can scale the controller vertically:

If you have many workflows, increase --workflow-workers and --workflow-ttl-workers.
Increase both --qps and --burst.

You will need to increase the controller's memory and CPU.

Rather than running a single installation in your cluster, run one per namespace using the --namespaced flag.

Within a cluster can use instance ID to run N Argo instances within a cluster.

Create one namespace for each Argo, e.g. argo-i1, argo-i2:.

Edit workflow-controller-configmap.yaml for each namespace to set an instance ID.

apiVersion: v1
kind: ConfigMap
metadata:
  name: workflow-controller-configmap
data:
    instanceID: i1

v2.9 and after

You may need to pass the instance ID to the CLI:

argo --instanceid i1 submit my-wf.yaml

You do not need to have one instance ID per namespace, you could have many or few.