Commands
Confluent
brew install confluentinc/tap/cli
confluent version
confluent login
confluent login --save
confluent environment list
confluent environment use env-q2rmnp
confluent kafka cluster list
# cluster id = lkc-zmjxkd
confluent kafka cluster use lkc-zmjxkd
confluent api-key list
confluent api-key create --resource lkc-zmjxkd
confluent api-key store <api_key> <api_secret> --resource lkc-zmjxkd
confluent api-key use <api_key> --resource lkc-zmjxkd
# topic
confluent kafka topic list
confluent kafka topic create test-topic
# produce
confluent kafka topic produce test-topic
# consume
confluent kafka topic consume clickstream
confluent kafka topic consume clickstream --group test-group
confluent kafka topic consume --from-beginning test-topic
Create producer or consumer config
# If you're ready to set up a producer or consumer, you can generate a configuration for the client using the CLI.
confluent kafka client-config create <LANGUAGE> --api-key <API_KEY> --api-secret <API_SECRET>
# output below
# Required connection configs for Kafka producer, consumer, and admin
bootstrap.servers=pkc-abcdef.us-east-2.aws.confluent.cloud:9092
security.protocol=SASL_SSL
sasl.mechanisms=PLAIN
sasl.username=API_KEY
sasl.password=API_SECRET
# Best practice for higher availability in librdkafka clients prior to 1.7
session.timeout.ms=45000
# Required connection configs for Confluent Cloud Schema Registry
#schema.registry.url=https://psrc-l622j.us-east-2.aws.confluent.cloud
#basic.auth.credentials.source=USER_INFO
#basic.auth.user.info={{ SR_API_KEY }}:{{ SR_API_SECRET }}
Confluent Local
confluent local kafka start
confluent local kafka topic create test-topic
confluent local services status
| Command | Description |
|---|---|
| confluent local services connect | Manage Connect. |
| confluent local services control-center | Manage Control Center. |
| confluent local services kafka | Manage Apache Kafka®. |
| confluent local services kafka-rest | Manage Kafka REST. |
| confluent local services kraft-controller | Manage KRaft Controller. |
| confluent local services ksql-server | Manage ksqlDB Server. |
| confluent local services list | List all Confluent Platform services. |
| confluent local services schema-registry | Manage Schema Registry. |
| confluent local services start | Start all Confluent Platform services. |
| confluent local services status | Check the status of all Confluent Platform services. |
| confluent local services stop | Stop all Confluent Platform services. |
| confluent local services top | View resource usage for all Confluent Platform services. |
| confluent local services zookeeper | Manage Apache ZooKeeper™. |
Install the Confluent CLI | Confluent Documentation
Tutorial: Use Confluent CLI with Confluent Cloud | Confluent Documentation
confluent local services | Confluent Documentation
Confluent Platform
Using docker
git clone https://github.com/confluentinc/cp-all-in-one.git
cd cp-all-in-one
git checkout 8.1.1-post
cd cp-all-in-one
docker-compose up -d
✔ Network cp-all-in-one_default Created 0.0s
✔ Container flink-jobmanager Started 0.5s
✔ Container broker Started 0.5s
✔ Container prometheus Started 0.5s
✔ Container flink-taskmanager Started 0.5s
✔ Container flink-sql-client Started 0.5s
✔ Container alertmanager Started 0.5s
✔ Container schema-registry Started 0.5s
✔ Container connect Started 0.6s
✔ Container rest-proxy Started 0.6s
✔ Container ksqldb-server Started 0.6s
✔ Container control-center Started 0.7s
docker compose ps
Quick Start for Confluent Platform | Confluent Documentation
Using command line
# Confluent Platform
curl -O https://packages.confluent.io/archive/8.1/confluent-8.1.1.zip
# Confluent Platform using only Confluent Community components
curl -O https://packages.confluent.io/archive/8.1/confluent-community-8.1.1.zip
unzip confluent-8.1.1.zip
export CONFLUENT_HOME=~/confluent-8.1.1
export PATH=$PATH:$CONFLUENT_HOME/bin
confluent --help
Install Confluent Platform using ZIP and TAR Archives | Confluent Documentation
System Requirements
| Component and Service | Default Port | Internal Only? |
|---|---|---|
| KRaft Controller | ||
| - peer-to-peer communication | 9093 | Yes |
| - Jolokia* | 7770 | No |
| Kafka Broker | ||
| - Interbroker listener | 9091 | Yes |
| - External listener | 9092 | No |
| - Metadata Service (MDS) | 8090 | No |
| - Confluent Server REST API | 8090 | No |
| - Jolokia* | 7771 | No |
| (Standalone) REST Proxy | 8082 | No |
| Confluent Control Center | 9021 | No |
| Kafka Connect | ||
| - REST API | 8083 | No |
| - Jolokia* | 7773 | No |
| ksqlDB Server | ||
| - REST API | 8088 | No |
| - Jolokia* | 7774 | No |
| Schema Registry | ||
| - REST API | 8081 | No |
| - Jolokia* | 7772 | No |
* Reserve the Jolokia ports only when you deploy Confluent Platform using Ansible.
Confluent Platform System Requirements | Confluent Documentation