Skip to content
This repository has been archived by the owner on May 2, 2023. It is now read-only.

Kafka connec to push to event hubs #878

Open
chinwobble opened this issue Oct 22, 2020 · 0 comments
Open

Kafka connec to push to event hubs #878

chinwobble opened this issue Oct 22, 2020 · 0 comments

Comments

@chinwobble
Copy link

I am trying to connect kafka connect to event hubs based on information in this guide.
https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-tutorial

I've tried to connect but I get the error;

Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment

Here is my docker-compose.yml file:

---
version: "2"
services:
  default-config:
    image: confluentinc/cp-kafka-connect:latest
    stdin_open: true
    tty: true
    environment:
      CONNECT_BOOTSTRAP_SERVERS: my-namespace.servicebus.windows.net:9093
      CONNECT_GROUP_ID: "connect-cluster-group"
      CONNECT_CONFIG_STORAGE_TOPIC: "connect-cluster-config"
      CONNECT_OFFSET_STORAGE_TOPIC: "connect-cluster-offsets"
      CONNECT_STATUS_STORAGE_TOPIC: "connect-cluster-status"
      # internal topic replication factors - auto 3x replication in Azure Storage
      CONFIG_STORAGE_REPLICATION_FACTOR: 1
      OFFSET_STORAGE_REPLICATION_FACTOR: 1
      STATUS_STORAGE_REPLICATION_FACTOR: 1
      
      REST_ADVERTISED_HOST_NAME: CONNECT
      OFFSET_FLUSH_INTERVAL_MS: 10000
      CONNECT_KEY_CONVERTER: "org.apache.kafka.connect.json.JsonConverter"
      CONNECT_VALUE_CONVERTER: "org.apache.kafka.connect.json.JsonConverter"
      CONNECT_INTERNAL_KEY_CONVERTER: "org.apache.kafka.connect.json.JsonConverter"
      CONNECT_INTERNAL_VALUE_CONVERTER: "org.apache.kafka.connect.json.JsonConverter"
      CONNECT_REST_ADVERTISED_HOST_NAME: "default-config"
      # required EH Kafka security settings
      CONNECT_SECURITY.PROTOCOL: "SASL_SSL"
      CONNECT_SASL_MECHANISM: "PLAIN"
      CONNECT_SASL_JAAS_CONFIG: $CONN_STRING

      CONNECT_PRODUCER_SECURITY_PROTOCOL: "SASL_SSL"
      CONNECT_PRODUCER_SASL_MECHANISM: "PLAIN"

      CONNECT_PRODUCER_SASL_JAAS_CONFIG: $CONN_STRING

      CONNECT_CONSUMER_SECURITY_PROTOCOL: "SASL_SSL"
      CONNECT_CONSUMER_SASL_MECHANISM: "PLAIN"

      CONNECT_CONSUMER_SASL_JAAS_CONFIG: $CONN_STRING
      CONNECT_REST_ADVERTISED_HOST_NAME: "localhost"
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant