Installing and running

macOS and Linux

The recommended way of running Conduit on a local machine is using the latest version which you can install by running the following command:

curl https://conduit.io/install.sh | bash

Run

Once installed, you can start Conduit by running:

conduit

Windows

Below we'll walk through getting Conduit installed and running on your Windows OS.

Download

First, download the latest Conduit release for your platform.

Let's say you downloaded conduit_0.13.0_Windows_x86_64.zip.

Unzip the archive

tar -xf conduit_0.13.0_Windows_x86_64.zip

Run

In the directory in which you expanded the archive. Execute the Conduit binary:

conduit.exe run

Docker

We distribute Docker images to ease the use of Conduit in a containerized environment. To see details about how our images are built please feel free to take a look at the Dockerfile here. Conduit's Docker images are hosted on GitHub.

Run

After you install Docker, you can pull the Conduit image by running the following command:

docker pull conduit.docker.scarf.sh/conduitio/conduit

Then, you can run Conduit by running:

docker run -it -p 8080:8080 conduit.docker.scarf.sh/conduitio/conduit

The command aboves runs Conduit with no pipelines. To run Conduit with a custom pipeline file you can mount it as a volume into the container:

docker run -it -p 8080:8080 \
  -v /path/to/pipeline.yaml:/app/pipelines/pipeline.yaml \
  conduit.docker.scarf.sh/conduitio/conduit

tip

If you're using Docker, check out Watchtower. After we push an update, Watchtower will keep your Conduit container updated by gracefully shutting down your existing container and restarting it with the same options used when initially deployed.

Building from source

Before you can build Conduit from source, you need to have the latest version of Go installed. The Go website has comprehensive instructions on how to get the language installed on your machine. Once installed, you can follow the rest of the instructions.

1. Start by downloading the source code from the latest stable release on the Conduit Releases Page. Alternatively, you can run this command to automatically download the latest stable source to your current directory:

$ TAG=v0.13.0; curl -o conduit.tar.gz -L https://github.com/ConduitIO/conduit/archive/refs/tags/$TAG.tar.gz

A file called conduit.tgz will be in your current directory. The next step is to expand the source:

$ tar zxvf conduit.tgz

Then change directories to the appropriate folder. Keep in mind that the folder name might be different between releases since it's tied to the latest git sha for the commit.

$ cd conduit-0.13.0

Now build the project:

$ make

You will have a new binary built for your architecture and machine. All that's left is to run it!

./conduit run

You should now be able to interact with Conduit through the CLI or its HTTP API on port 8080:

             ....
         .::::::::::.
       .:::::‘‘‘‘:::::.
      .::::        ::::.
 .::::::::          ::::::::.
 `::::::::          ::::::::‘
      `::::        ::::‘
       `:::::....:::::‘
         `::::::::::‘        Conduit v0.13.0 linux/amd64
             ‘‘‘‘
2025-01-10T09:40:07+00:00 INF All 0 tables opened in 0s component=badger.DB
2025-01-10T09:40:07+00:00 INF Discard stats nextEmptySlot: 0 component=badger.DB
2025-01-10T09:40:07+00:00 INF Set nextTxnTs to 0 component=badger.DB
2025-01-10T09:40:07+00:00 INF loading processor plugins from directory /app/processors ... component=plugin.processor.standalone.Registry
2025-01-10T09:40:07+00:00 WRN could not read processor plugin directory error="open /app/processors: no such file or directory" component=plugin.processor.standalone.Registry
2025-01-10T09:40:07+00:00 INF standalone processor plugins initialized component=plugin.processor.standalone.Registry count=0 plugin_path=/app/processors
2025-01-10T09:40:07+00:00 INF builtin processor plugins initialized component=plugin.processor.builtin.Registry count=17
2025-01-10T09:40:07+00:00 INF processors initialized component=processor.Service count=0
2025-01-10T09:40:07+00:00 INF connector utilities started address=[::]:33955
2025-01-10T09:40:07+00:00 INF connector utilities started on [::]:33955
2025-01-10T09:40:07+00:00 INF builtin connector plugins initialized component=plugin.connector.builtin.Registry count=6
2025-01-10T09:40:07+00:00 WRN could not read connector plugin directory error="open /app/connectors: no such file or directory" component=plugin.connector.standalone.Registry
2025-01-10T09:40:07+00:00 INF standalone connector plugins initialized component=plugin.connector.standalone.Registry count=0 plugin_path=/app/connectors
2025-01-10T09:40:07+00:00 INF connectors initialized component=connector.Service count=0
2025-01-10T09:40:07+00:00 INF pipelines initialized component=pipeline.Service count=0
2025-01-10T09:40:07+00:00 INF pipeline configs provisioned component=provisioning.Service created=[] deleted=[] pipelines_path=/app/pipelines
2025-01-10T09:40:07+00:00 INF grpc API started address=[::]:8084
2025-01-10T09:40:07+00:00 INF http API started address=[::]:8080
2025-01-10T09:40:07+00:00 INF
2025-01-10T09:40:07+00:00 INF click here to navigate to explore the HTTP API: http://localhost:8080/openapi
2025-01-10T09:40:07+00:00 INF

Next Steps

Now that you have Conduit installed you can learn [how to get started]÷(/docs/getting-started). You can also explore some other topics, such as:

• Pipelines
• Connectors
• Processors