Context

When working with large data imports, you may need to process files that are several gigabytes in size. Understanding the storage limitations for jobs is important to ensure your import processes can complete successfully without running into disk space issues.

Answer

Jobs are not subject to specific storage limits imposed by the platform itself. Instead, job storage is limited only by the disk size of the node where the job is running.

If you need to process large files (such as a 40GB database import), you can increase the available storage by adjusting the disk size of the relevant node group:

1. Navigate to the Infrastructure menu in your dashboard

2. Locate the node group where your job will be running

3. Increase the disk size for that node group to accommodate your large file

This approach allows you to scale your storage capacity based on your specific job requirements, ensuring that even very large imports can be processed successfully.