Compute Resources

A computation, Reproducible Run or Cloud Workstation, launched from the capsule runs as a Docker container that occupies a compute slot in an EC2 instance on AWS. The instance type is determined as the base on the starter environment that you choose, such as a general machine or one with GPU support.

After you select the starter environment, you can select compute resources to change the number of slots you wish to allocate for your computation. ‌The default compute resource depends on the machine type of the starter environment.

Setting Compute Resources

  1. From the Environment editor, click on Select Compute Resources.

  2. Select the allocation type.

  3. Select the compute slot.

  4. Click on Save.

Methods of Allocating Compute Resources

A Compute capsule allocates compute resources in two ways:

  • Flex

  • Dedicated

Flex Machine

This method attempts to allocate selected compute resource (slot) on a running worker machine such as EC2 instance, in the fleet of workers for each computation. If none of them have enough available slots, a new machine is added to the fleet in order to meet the need. This allows low-intensity computations to run on the same EC2 instances to reduce the cost by avoiding turning on an additional instance.

When all slots become empty, for example, no computation on the EC2 instance, the EC2 instance will shut down automatically after one hour, or for a time specified in the deployment plan. To allocate the resources more efficiently, the system will shut down a cloud workstation session after two hours, for a time specified in the deployment plan of session idleness (CPU <2%) to free the compute slot.

If you select a more powerful compute resource for a capsule, it requires more available compute slots to launch a computation instantly. It may increase the chance of activating a new EC2 instance which could increase both cost and waiting time.

Dedicated Machine

As its name implies, the computation will occupy a new EC2 instance. Use this method when you have a computation with high compute demand or need a specific configuration for the EC2 instance. Keep in mind that it takes approximately two minutes to start up a new instance and the more powerful machine you choose, the higher the hourly cost (Refer to AWS EC2 pricing website for more details). You also have the option to choose the spot instance to reduce cost.

The EC2 instance will shut down directly after the computation is complete that is, the machine will shut down immediately after the reproducible run ends or the cloud workstation session is closed. Same as the Standard method, the system will shut down a cloud workstation session after the session is idle (CPU <2%) for two hours (or for a time specified in the deployment plan) and terminate the machine.

User Interface Feedback

When a dedicated machine/resource is no longer available, the feedback displays on the screen.

Last updated