Introduction
β
This guide shows how to connect your Streambased deployment to Confluent cCloud Kafka deployments. In addition to following this guide we encourage you to review the documentation at: https://streambased-io.github.io/streambased/index.html and the Streambased webpage: https://streambased.io/. Feel free to reachout at info@streambased.io with any questions.
Note: We suggest running Streambased in a docker environment. Ensure that your environment has docker and docker-compose installed and is able to run containers with the amd64 platform. If you do not wish to use docker, bare metal steps can be found here: https://streambased-io.github.io/streambased/tutorial.html
β
Step 1: Download Streambased
β
![](https://cdn.prod.website-files.com/66098d655e9084457b00d675/665f3bdcd51104824c4004f4_Picture1-2.png)
β
β
Unpack the zip and navigate to the βccloudβ directory. This will be the base directory for our installation. Run the following command to setup the environment:
β
./bin/setup.sh
β
Step 2: Grab your Confluent Cloud config
β
The easiest way to record your Confluent Cloud is from the Confluent Cloud web UI. Log in and navigate to your cluster, then click Clients -> Java
You should see the following listed configs:
β
β
![](https://cdn.prod.website-files.com/66098d655e9084457b00d675/6662f5c7f295bc9f602b8af1_Picture2-2.png)
β
Streambased required the following configs, make a note of these:
β
bootstrap.servers
sasl.jaas.config
schema.registry.url
basic.auth.user.info
β
Note: These configs should represent a user that has read and describe permissions on all topics you wish to access using Streambased. In addition to this the configs should have read/write permissions on the following Streambased internal topics:
β
_streambased_markers
_streambased_ranges
_streambased_config
β
Step 3: Configure Streambased
β
A template for Streambased config has already been created in the demo. To use your own configurations weβll first configure Streambased acceleration, change serverConfig/indexer.properties
β
indexed.topics # -> comma separated list of topics you wish to accelerate with Streambased
schema.registry.schema.registry.url -> confluent config schema.registry.url
schema.registry.basic.auth.user.info -> confluent config basic.auth.user.info
consumer.bootstrap.servers -> confluent config bootstrap.servers
consumer.sasl.jaas.config -> confluent config sasl.jaas.config
β
Next letβs configure the Streambased Server, change serverConfig/catalog/kafka.properties
β
kafka.nodes -> confluent config bootstrap.servers
kafka.confluent-schema-registry-url -> confluent config schema.registry.url
kafka.confluent-schema-registry-basic-auth-user-info -> confluent config basic.auth.user.info
β
Finally, change serverConfig/client.properties
β
bootstrap.servers -> confluent config bootstrap.servers
sasl.jaas.config -> confluent config sasl.jaas.config
β
Step 4: Start Streambased
β
All thatβs left to do is to start the Streambased services:
β
docker-compose up -d
β
Now you can connect to all of your Kafka data with JDBC. For instructions on how to do this check out our guides for Superset, DBT, Tableau and Jupyter
β