Endpoint Limits

This page describes the typical file size limits and transfer speeds for bringing data to the platform and exporting it, by data source.

Note that these may be different depending on the user's internet connection, file type, region, your native cloud provider and other factors and should only be used as a guideline.

There is an 8GB limit for CSV exports. Larger downloads can be achieved in alternative file formats.

GCP

The native cloud provider for the platform is GCP; these are the transfer limits.

Connector

Transfer file size

Transfer speed

Azure Blob Storage

Up to 200GB

6 - 48MB/s

GCS

Up to 200GB

up to 400MB/s

S3

Up to 200GB

6 - 48MB/s

*Users may also decide to use the file upload capability that is offered alongside the endpoint option. Note that files no larger than 7GB can be uploaded using this method.

Space Types

The platform is provided with the default Space Types outlined below deployed as standard.

Name

Master Nodes

Worker Nodes

Batch Analytics

1

3

Intensive Analytics

1

6

 It is not currently possible to import 3rd party software into a Space for additional analysis (e.g., tableau, excel, additional python libraries, etc.).

The following components and configurations are used to support the default Space Types in GCP.

Component

Configuration

Cloud Service

Dataproc

Cloud Service Image (most recently utilized)

2.0

Master Node Configuration

Machine Type: n1-standard-8

Machine Memory: 30Gb

Machine CPUs: 8

Worker Node Configuration

Machine Type: n1-standard-8

Machine Memory: 30Gb

Machine CPUs: 8