Debezium 如何使用 Kafka Connect 正确注册 SqlServer 连接

本文介绍了Debezium 如何使用 Kafka Connect 正确注册 SqlServer 连接器 - 连接被拒绝的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！

问题描述

问题:

如何使用 Kafka Connect 正确注册 SqlServer 连接器以连接到独立的 SQL Server 实例?注意:我没有在 Docker 中运行 SQL Server.

How do I correctly register the SqlServer connector with Kafka Connect to connect to a standalone SQL Server Instance? Note: I am NOT running SQL Server in Docker.

错误:

错误:由:com.microsoft.sqlserver.jdbc.SQLServerException引起:TCP/IP 连接到主机 127.0.0.1，端口 1433 失败.错误:连接被拒绝(Connection denied).验证连接特性.确保 SQL Server 的实例正在运行主机并在端口接受 TCP/IP 连接.确保 TCP与端口的连接未被防火墙阻止.".

Error: Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The TCP/IP connection to the host 127.0.0.1, port 1433 has failed. Error: "Connection refused (Connection refused). Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".

问题排查:

在 dbo.Posts 表上启用 CDC(见下文)
在 SQL Server 配置管理器的 SQL Server 网络配置中验证 TCP/IP 已启用并将所有地址设置为已启用并在端口 1433 上处于活动状态
禁用 Windows 防火墙
在 SQL Server 配置管理器中启用 SQL Server 浏览器
验证我可以远程登录以下内容:(127.0.0.1 1433; localhost 1433; lt-ls231 1433)

上下文:

我正在尝试使用 Docker 在 Windows 10 上设置 Debezium.我可以毫无问题地在 Powershell 中成功运行以下命令:

I am attempting to setup Debezium on Windows 10 using Docker. I can successfully run the following commands in Powershell without problem:

docker run -it --rm --name zookeeper -p 2181:2181 -p 2888:2888 -p 3888:3888 debezium/zookeeper:1.1 

docker run -it --rm --name kafka -p 9092:9092 --link zookeeper:zookeeper debezium/kafka:1.1 

docker run -it --rm --name connect -p 8083:8083 -e GROUP_ID=1 -e CONFIG_STORAGE_TOPIC=my_connect_configs -e  OFFSET_STORAGE_TOPIC=my_connect_offsets -e  STATUS_STORAGE_TOPIC=my_connect_statuses --link zookeeper:zookeeper --link kafka:kafka debezium/connect:1.1

当我尝试使用 Kafka-Connect connect 注册 SQL Server 连接时出现错误(见上文)，我运行以下命令:

I get an error (see above) when I attempt to register the SQL Server connection with Kafka-Connect connect, I run the following command:

Invoke-RestMethod -Method Post -Uri 'http://localhost:8083/connectors/' -Headers @{'Accept' = 'application/json'; 'Content-Type' = 'application/json'} -Body '{"name": "mssqlserver-localhost-testDb-connector",  "config": {"connector.class": "io.debezium.connector.sqlserver.SqlServerConnector", "database.hostname": "127.0.0.1", "database.port": "1433", "database.user": "svc_kafka", "database.password": "password", "database.dbname": "Posts", "database.server.name": "LT-LS231", "table.whitelist": "dbo.Posts", "database.history.kafka.bootstrap.servers": "kafka:9092", "database.history.kafka.topic": "dbhistory.LT-LS231" }}'

格式化后的JSON如下:

The formatted JSON is as follows:

Invoke-RestMethod -Method Post -Uri 'http://localhost:8083/connectors/' -Headers @{'Accept' = 'application/json'; 'Content-Type' = 'application/json'} -Body '

{  
    "name": "mssqlserver-localhost-testDb-connector",  
    "config": {
        "connector.class": "io.debezium.connector.sqlserver.SqlServerConnector", 
        "database.hostname": "127.0.0.1", 
        "database.port": "1433", 
        "database.user": "svc_kafka", 
        "database.password": "password", 
        "database.dbname": "Posts", 
        "database.server.name": "LT-LS231", 
        "table.whitelist": "dbo.Posts", 
        "database.history.kafka.bootstrap.servers": "kafka:9092", 
        "database.history.kafka.topic": "dbhistory.LT-LS231" 
  }
}'

这是根据 Debezium 网站上提供的 JSON 建模的:https://debezium.io/documentation/reference/1.1/connectors/sqlserver.html#sqlserver-deploying-a-connector

This is modeled after the JSON provided on Debezium's site: https://debezium.io/documentation/reference/1.1/connectors/sqlserver.html#sqlserver-deploying-a-connector

Debezium 如何使用 Kafka Connect 正确注册 SqlServer 连接

问题描述

推荐答案

相关文档推荐