A Terraform plugin for managing Apache Kafka.
Download and extract the latest
release to
your terraform plugin directory (typically ~/.terraform.d/plugins/)
- Install go
- Clone repository to:
$GOPATH/src/github.com/Mongey/terraform-provider-kafkamkdir -p $GOPATH/src/github.com/Mongey/terraform-provider-kafka; cd $GOPATH/src/github.com/Mongey/ git clone https://github.com/Mongey/terraform-provider-kafka.git
- Build the provider
make build - Run the tests
make test - Start a TLS enabled kafka-cluster
docker-compose up - Run the acceptance tests
make testacc
Example provider with TLS client authentication.
provider "kafka" {
bootstrap_servers = ["localhost:9092"]
ca_cert = file("../secrets/snakeoil-ca-1.crt")
client_cert = file("../secrets/kafkacat-ca1-signed.pem")
client_key = file("../secrets/kafkacat-raw-private-key.pem")
tls_enabled = true
}| Property | Description | Default |
|---|---|---|
bootstrap_servers |
A list of host:port addresses that will be used to discover the full set of alive brokers | Required |
ca_cert |
The CA certificate or path to a CA certificate file to validate the server's certificate. | "" |
client_cert |
The client certificate or path to a file containing the client certificate -- Use for Client authentication to Kafka. | "" |
client_key |
The private key or path to a file containing the private key that the client certificate was issued for. | "" |
client_key_passphrase |
The passphrase for the private key that the certificate was issued for. | "" |
tls_enabled |
Enable communication with the Kafka Cluster over TLS. | true |
skip_tls_verify |
Skip TLS verification. | false |
sasl_username |
Username for SASL authentication. | "" |
sasl_password |
Password for SASL authentication. | "" |
sasl_mechanism |
Mechanism for SASL authentication. Allowed values are plain, scram-sha512 and scram-sha256 | plain |
A resource for managing Kafka topics. Increases partition count without destroying the topic.
provider "kafka" {
bootstrap_servers = ["localhost:9092"]
}
resource "kafka_topic" "logs" {
name = "systemd_logs"
replication_factor = 2
partitions = 100
config = {
"segment.ms" = "20000"
"cleanup.policy" = "compact"
}
}| Property | Description |
|---|---|
name |
The name of the topic |
partitions |
The number of partitions the topic should have |
replication_factor |
The number of replicas the topic should have |
config |
A map of string K/V attributes |
You can import topics with the following
terraform import kafka_topic.logs systemd_logsA resource for managing Kafka ACLs.
provider "kafka" {
bootstrap_servers = ["localhost:9092"]
ca_cert = file("../secrets/snakeoil-ca-1.crt")
client_cert = file("../secrets/kafkacat-ca1-signed.pem")
client_key = file("../secrets/kafkacat-raw-private-key.pem")
}
resource "kafka_acl" "test" {
resource_name = "syslog"
resource_type = "Topic"
acl_principal = "User:Alice"
acl_host = "*"
acl_operation = "Write"
acl_permission_type = "Deny"
}| Property | Description | Valid values |
|---|---|---|
acl_host |
Host from which principal listed in acl_principal will have access | * |
acl_operation |
Operation that is being allowed or denied | Unknown, Any, All, Read, Write, Create, Delete, Alter, Describe, ClusterAction, DescribeConfigs, AlterConfigs, IdempotentWrite |
acl_permission_type |
Type of permission | Unknown, Any, Allow, Deny |
acl_principal |
Principal that is being allowed or denied | * |
resource_name |
The name of the resource | * |
resource_type |
The type of resource | Unknown, Any, Topic, Group, Cluster, TransactionalID |
resource_pattern_type_filter |
Prefixed, Any, Match, Literal |
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent