Getting Started

Summary

This is a step-by-step guide for how to create an Airbyte source in Python to read data from an HTTP API. We'll be using the Exchange Rates API as an example since it is simple and demonstrates a lot of the capabilities of the CDK.

Requirements

    Python >= 3.7
    Docker
    NodeJS (only used to generate the connector). We'll remove the NodeJS dependency soon.
All the commands below assume that python points to a version of python >=3.7.0. On some systems, python points to a Python2 installation and python3 points to Python3. If this is the case on your machine, substitute all python commands in this guide with python3.

Checklist

    Step 1: Create the source using the template
    Step 2: Install dependencies for the new source
    Step 3: Define the inputs needed by your connector
    Step 4: Implement connection checking
    Step 5: Declare the schema of your streams
    Step 6: Implement functionality for reading your streams
    Step 7: Use the connector in Airbyte
    Step 8: Write unit tests or integration tests
Each step of the Creating a Source checklist is explained in more detail in the following steps. We also mention how you can submit the connector to be included with the general Airbyte release at the end of the tutorial.
Last modified 4mo ago