Raw Data Upload & Download

There are two pages in Suite where you can upload data. In each of these pages, there are four ways in which you can upload data. (File upload, Cloud upload, URL upload, and CLI upload)

Where to Upload Data

Upload Data to Your Account

1. Click on the Data tab under the Account menu.

2. Click the Upload Data button at the top right.

3. Choose one of File, Cloud, URL, or CLI methods to upload data.

In this case, the uploaded raw data is stored in the Dataset you select, and will not be added to a particular project.

Upload Data and Add Data to a Project Simultaneously

1. Click on the Project tab under the Account menu

2. Click the desired project to go to the project page.

3. Click the Upload Data button in the left project sidebar.

4. Choose one of File, Cloud, URL, or CLI methods to upload data.

In this case, the uploaded raw data is stored in the Dataset you select, and will also be added to the project you select.

How to Upload Data

There are 4 ways to upload data to the Suite.

File Upload

1. Select Data Type Choose from Image or Video. ❗ For video, the sequence of frames parsed from a single video (.png, .jpg, bmp) must be stored in one folder. (Uploading .mp4 video files directly is only supported in Cloud upload)

2. Select Files Select the files to upload either by clicking the upload box or by drag & drop. ❗ Each file must be less than 10MB, and only PNG, JPG, and BMP files are supported. ❗For video data, you can upload at maximum 199,188 frames (image sequences) at one time.

3. Select Dataset Uploaded data is stored in a Dataset. Select a Dataset or create a new one.

4. Select Project (Optional) Select a project to add the uploaded data to. This step is optional.

Cloud Upload

In order to use the Cloud Upload, you must first integrate your Cloud Storage into your account. Please follow the Manual.

Related manual:

1. Select Data Type

  • Choose the data type. Cloud Upload also supports uploading of .mp4 video files.

2. Select Cloud Storage

  • Select Cloud Storage that is integrated to your account.

3. Select Folder

  • Select the folder in your cloud storage that contains the data you want to upload.

4. Select Data Storage Method

  • Choose how you want to save your data. You have two options:

    • Superb AI Storage

    • Your Own Storage

Superb AI Storage

Your Own Storage

What it means

A copy of your data will be stored in one of our storage servers.

Your data will remain within the cloud storage you've integrated to your account.

Data Access

• Suite will serve the copy of the data • CDN services enable faster data access.

• Suite will serve the original data using read-only access.

Note

• File Upload and CSV Upload uses this type of data storage.

• Your cloud storage billing may increase for increases data reads. • i.e.) AWS S3 - reading 100,000 images that are around 300KB in size, 20-times each will incur about $70 of storage fees. • AWS S3 PricingGCP Storage Pricing

5. Select Dataset

  • Uploaded data is stored in a Dataset. Select a Dataset or create a new one.

6. Select Project (Optional)

  • Select a project to add the uploaded data to.

URL Upload

URL upload only supports uploading image data.

1. Select Upload Type

  • Choose between URL and CSV modes.

2. Add URLs

  • URL mode

    Enter your Data Key and the URL of the raw image location.

  • CSV mode

    Upload a CSV file that contains the list of with the image URLs.

3. Select Dataset

  • Uploaded data is stored in a Dataset. Select a Dataset or create a new one.

4. Select Project (Optional)

  • Select a project to add the uploaded data to.

CLI Upload

1. Installing the Command-Line Interface (CLI)

  • Enter the following command to install the CLI.

pip install spb-cli
spb --version

2. Access Key

  • Enter your account name and access key to authenticate.

spb configure
Suite Account Name : <*your_account_name*>
Access Key : *<your_access_key>*
spb configure --list

3. Upload Data

  • Upload your raw data, or raw data and label JSON files together using the following commands.

    • Upload Raw Data

      cd *folder-with-files*
      spb upload dataset
      Project Name: *<my-project>*
      Dataset Name: *<my-dataset>*
    • Upload Raw Data and Label Together

      cd *folder-with-files*
      spb upload dataset --include-label
      Project Name: *<my-project>*
      Dataset Name: *<my-dataset>*

Supported File Formats

The supported file formats are:

  • Image data

    • .png, .jpg, .bmp files

  • Video data

    • Sequence image data: .png, .jpg, .bmp files

    • Video data: mp4 file (available only in Cloud Upload, file size is limited to 100MB/5 minutes or less)

Download the Raw Data

You can download the raw data added to a project.

1. Click the Raw Data Download tab in the project sidebar.

2. Click the Update button next to the Download button.

3. When ready, the Download button will be activated.

4. Click the Download button to start the download, or click on the link icon to copy the download link to the clipboard.

❗ Raw data download is not supported if you've uploaded your raw data using the Your Own Storage option in Cloud Upload.

Any other questions? E-mail us at [email protected]