Confluent Cloud Documentation
Confluent Cloud | Confluent Documentation
- Overview
- Get Started
- Manage Kafka Clusters
- Overview
- Cluster Types
- Manage Configuration Settings
- Cloud Providers and Regions
- Resilience
- Copy Data with Cluster Linking
- Copy Data with Replicator
- Resize a Dedicated Cluster
- Multi-Tenancy and Client Quotas for Dedicated Clusters
- Create Cluster Using Terraform
- Create Cluster Using Pulumi
- Connect Confluent Platform and Cloud Environments
- Overview
- Connect Self-Managed Gateway to Cloud
- Connect Self-Managed Control Center to Cloud
- Connect Self-Managed Clients to Cloud
- Connect Self-Managed Connect to Cloud
- Connect Self-Managed REST Proxy to Cloud
- Connect Self-Managed ksqlDB to Cloud
- Connect Self-Managed MQTT to Cloud
- Connect Self-Managed Schema Registry to Cloud
- Connect Self-Managed Streams to Cloud
- Example: Autogenerate Self-Managed Component Configs for Cloud
- Migrate with kcp
- FAQ
- Build Streaming Applications
- Build Kafka Streams Applications
- Overview
- Quick Start
- Metrics
- Monitor Applications
- Upgrade Guide
- ksqlDB
- Create Stream Processing Apps with ksqlDB
- Quick Start
- Enable ksqlDB Integration with Schema Registry
- ksqlDB Cluster API Quick Start
- Monitor ksqlDB
- Manage ksqlDB by using the CLI
- Manage Connectors With ksqlDB
- Develop ksqlDB Applications
- Pull Queries
- Grant Role-Based Access
- Migrate ksqlDB Applications on Confluent Cloud
- Build AI with Confluent Intelligence
- Manage Topics
- Manage and Monitor resource with USM
- Govern Data Streams
- Connect to External Services
- Overview
- Install Connectors
- ActiveMQ Source
- AlloyDB Sink
- Amazon CloudWatch Logs Source
- Amazon CloudWatch Metrics Sink
- Amazon DynamoDB CDC Source
- Amazon DynamoDB Sink
- Amazon Kinesis Source
- Amazon Redshift Sink
- Amazon S3 Sink
- Amazon S3 Source
- Amazon SQS Source
- AWS Lambda Sink
- Azure Blob Storage Sink
- Azure Blob Storage Source
- Azure Cognitive Search Sink
- Azure Cosmos DB Sink
- Azure Cosmos DB Sink V2
- Azure Cosmos DB Source
- Azure Cosmos DB Source V2
- Azure Data Lake Storage Gen2 Sink
- Azure Event Hubs Source
- Azure Functions Sink
- Azure Log Analytics Sink
- Azure Service Bus Source
- Azure Synapse Analytics Sink
- ClickHouse Sink
- Couchbase Source
- Couchbase Sink
- Databricks Delta Lake Sink
- Datadog Metrics Sink
- Datagen Source (development and testing)
- Elasticsearch Service Sink
- GitHub Source
- Google BigQuery Sink [Deprecated]
- Google BigQuery Sink V2
- Google Cloud BigTable Sink
- Google Cloud Dataproc Sink [Deprecated]
- Google Cloud Functions Gen 2 Sink
- Google Cloud Functions Sink [Deprecated]
- Google Cloud Pub/Sub Source
- Google Cloud Spanner Sink
- Google Cloud Storage Sink
- Google Cloud Storage Source
- HTTP Sink
- HTTP Sink V2
- HTTP Source
- HTTP Source V2
- IBM MQ Source
- InfluxDB 2 Sink
- InfluxDB 2 Source
- InfluxDB 3 Sink
- Jira Source
- MariaDB CDC Source
- Microsoft SQL Server CDC Source (Debezium) [Deprecated]
- Microsoft SQL Server CDC Source V2 (Debezium)
- Microsoft SQL Server Sink (JDBC)
- Microsoft SQL Server Source (JDBC)
- MongoDB Atlas Sink
- MongoDB Atlas Source
- MQTT Sink
- MQTT Source
- MySQL CDC Source (Debezium) [Deprecated]
- MySQL CDC Source V2 (Debezium)
- MySQL Sink (JDBC)
- MySQL Source (JDBC)
- Neo4j Sink
- New Relic Metrics Sink
- OpenSearch Sink
- Oracle XStream CDC Source
- Oracle CDC Source
- Oracle Database Sink (JDBC)
- Oracle Database Source (JDBC)
- PagerDuty Sink [Deprecated]
- Pinecone Sink
- PostgreSQL CDC Source (Debezium) [Deprecated]
- PostgreSQL CDC Source V2 (Debezium)
- PostgreSQL Sink (JDBC)
- PostgreSQL Source (JDBC)
- RabbitMQ Sink
- RabbitMQ Source
- Redis Sink
- Redis Kafka Sink
- Redis Kafka Source
- Salesforce Bulk API 2.0 Sink
- Salesforce Bulk API 2.0 Source
- Salesforce Bulk API Source
- Salesforce CDC Source
- Salesforce Platform Event Sink
- Salesforce Platform Event Source
- Salesforce PushTopic Source
- Salesforce SObject Sink
- ServiceNow Sink
- ServiceNow Source [Legacy]
- ServiceNow Source V2
- SFTP Sink
- SFTP Source
- Snowflake Sink
- Snowflake Source
- Solace Sink
- Splunk Sink
- Zendesk Source
- Confluent Hub
- Install Custom Plugins and Custom Connectors
- Manage CSFLE
- Manage Provider Integration
- Networking and DNS
- Overview
- AWS Egress PrivateLink Endpoints for First-Party Services
- AWS Egress PrivateLink Endpoints for Self-Managed Services
- AWS Egress PrivateLink Endpoints for Amazon RDS
- Azure Egress Private Link Endpoints for First-Party Services
- Azure Egress Private Link Endpoints for Self-Managed Services
- Google Cloud Private Service Connect Endpoints for First-Party Services
- Connect API Usage
- Manage Public Egress IP Addresses
- Sample Connector Output
- Configure Single Message Transforms
- Configure Custom SMTs
- View Connector Events
- Interpret Connector Statuses
- Manage Service Accounts
- Configure RBAC
- View Errors in the Dead Letter Queue
- Connector Limits
- Manage Offsets
- Transforms List
- Overview
- Cast
- Drop
- DropHeaders
- EventRouter
- ExtractField
- ExtractTopic
- Filter (Kafka)
- Filter (Confluent)
- Flatten (Kafka)
- Flatten (Confluent)
- FromXML
- GzipDecompress
- HeaderFrom
- HeaderToValue
- HoistField
- InsertField
- InsertHeader
- KeyToValue
- MaskField
- MessageTimestampRouter
- RegexRouter
- ReplaceField (Kafka)
- ReplaceField (Confluent)
- SetSchemaMetadata
- TimestampConverter
- TimestampRouter
- TombstoneHandler
- TopicRegexRouter
- ValueToKey
- Reference
- Integrate with Confluent Cloud
- Process Data with Flink
- Overview
- Get Started
- Concepts
- Overview
- Autopilot
- Batch and Stream Processing
- Billing
- Comparison with Apache Flink
- Compute Pools
- Delivery Guarantees and Latency
- Determinism
- Private Networking
- Schema and Statement Evolution
- Snapshot Queries
- Statements
- Statement CFU Metrics
- Tables and Topics
- Time and Watermarks
- User-defined Functions
- How-To Guides
- Overview
- Aggregate a Stream in a Tumbling Window
- Combine Streams and Track Most Recent Records
- Compare Current and Previous Values in a Stream
- Convert the Serialization Format of a Topic
- Create a UDF
- Deduplicate Rows in a Table
- Generate Custom Sample Data
- Handle Multiple Event Types
- Log Debug Messages in UDFs
- Mask Fields in a Table
- Process Schemaless Events
- Profile a Query
- Resolve Statement Issues
- Scan and Summarize Tables
- Run a Snapshot Query
- Transform a Topic
- View Time Series Data
- Operate and Deploy
- Flink Reference
- Overview
- SQL Syntax
- DDL Statements
- Statements Overview
- ALTER AGENT
- ALTER CONNECTION
- ALTER MODEL
- ALTER TABLE
- ALTER TOOL
- ALTER VIEW
- CREATE AGENT
- CREATE CONNECTION
- CREATE FUNCTION
- CREATE MODEL
- CREATE TABLE
- CREATE TOOL
- CREATE VIEW
- DESCRIBE
- DROP AGENT
- DROP CONNECTION
- DROP MODEL
- DROP TABLE
- DROP TOOL
- DROP VIEW
- HINTS
- EXPLAIN
- RESET
- SET
- SHOW
- USE CATALOG
- USE database_name
- DML Statements
- Functions
- Data Types
- Data Type Mappings
- Time Zone
- Keywords
- Information Schema
- Example Streams
- Supported Cloud Regions
- SQL Examples
- Table API
- CLI Reference
- Get Help
- FAQ
- Manage Networking
- Confluent Cloud Networking Overview
- Networking on AWS
- AWS Networking Overview
- Public Networking on AWS
- Confluent Cloud Network on AWS
- PrivateLink on AWS
- PrivateLink Overview
- Inbound PrivateLink for Dedicated Clusters
- Inbound PrivateLink for Serverless Products
- Outbound PrivateLink for Dedicated Clusters
- Outbound PrivateLink for Serverless Products
- Confluent Cloud, available through the AWS Marketplace or directly from Confluent, supports outbound AWS PrivateLink connections using Egress PrivateLink Endpoints. Egress PrivateLink Endpoints are AWS interface VPC Endpoints, and they enable Confluent Cloud Enterprise clusters to access supported AWS services and other endpoint services powered by AWS PrivateLink. Examples of the services are AWS S3, a SaaS service, or a PrivateLink service that you create yourself.
- VPC Peering on AWS
- Transit Gateway on AWS
- Private Network Interface on AWS
- Networking on Azure
- Networking on Google Cloud
- Connectivity for Confluent Resources
- Use the Confluent Cloud Console with Private Networking
- Test Connectivity
- Networking FAQ
- Log and Monitor
- Manage Security
- Overview
- Manage Authentication
- Overview
- Manage User Identities
- Manage Workload Identities
- Overview
- Manage Workload Identities
- Manage Service Accounts and API Keys
- Manage OAuth/OIDC Identity Providers
- Manage mTLS Identity Providers
- Control Access
- Encrypt and Protect Data
- Overview
- Manage Data in Transit With TLS
- Encrypt Using Self-Managed Encryption Keys
- Overview
- Use Self-Managed Encryption Keys on AWS
- Use Self-Managed Encryption Keys on Azure
- Use Self-Managed Encryption Keys on Google Cloud
- Manage Key Policies
- Use Self-Managed Encryption Keys with Tableflow
- Use Pre-BYOK-API-V1 Self-Managed Encryption Keys
- Use Confluent CLI for Self-Managed Encryption Keys
- Use BYOK API for Self-Managed Encryption Keys
- Revoke Access to Data at Rest
- Best Practices
- Troubleshoot Key Policy Issues
- Encrypt Using Client-Side Field Level Encryption
- Encrypt Using Client-Side Payload Encryption
- Monitor Activity
- Concepts
- Audit Log Event Categories
- Understand Audit Log Records
- Audit Log Event Schema
- Auditable Event Methods
- Access Transparency
- Connector
- Custom Connector Plugin
- Flink
- Flink Authentication and Authorization
- IP Filter Authorization
- Kafka Cluster Authentication and Authorization
- Kafka Cluster Management and Operations
- ksqlDB Cluster Authentication and Authorization
- Networking
- Notifications Service
- OAuth/OIDC Identity Provider and Identity Pool
- Organization
- Role-based Access Control (RBAC)
- Schema Registry Authentication and Authorization
- Schema Registry Management and Operations
- Tableflow Data Plane
- Tableflow Control Plane
- Access and Consume Audit Log Records
- Access Transparency
- Retain Audit Logs
- Best Practices
- Troubleshoot
- Access Management Tutorial
- Manage Billing
- Overview
- Marketplace Consumption Metrics
- Use AWS Pay As You Go
- Use AWS Commits
- Use Azure Pay As You Go
- Use Azure Commits
- Use Jio Commits
- Use Professional Services on Azure
- Use Google Cloud Pay As You Go
- Use Google Cloud Commits
- Use Professional Services on Google Cloud
- Marketplace Organization Suspension and Deactivation
- FAQ
- Manage Service Quotas
- APIs
- Confluent CLI
- Release Notes & FAQ
- Support
- Glossary