DataSpace
  • DataSpace
  • Platform
    • Overview
    • Workspaces
    • User Roles
    • Transformation
      • Code
      • Preview
      • Logs
      • Plot
      • Ingest
    • Builds
    • Schedules
    • Secrets Store
  • Infrastructure
    • Overview
Powered by GitBook
On this page
  1. Platform
  2. Transformation

Ingest

PreviousPlotNextBuilds

Last updated 11 months ago

Data Space does not provide a mechanism to upload data. Therefore, the ingest needs to come from an external URL such as, for example, Google Drive.

Google Drive

import pandas as pd
import os

url = 'https://drive.google.com/uc?id={os.environ['CSV_FILE_ID']}'

def transform():    
    df = pd.read_csv(url)
    return df

Typically a file URL will contain an access token. It is advised not to hard code the key into the string but rather use the to inject a key during the build.

secrets store