Skip to content

Codis-proxy Session closed by error: EOF #1751

Description

@boomballa

背景:使用redis-migrate-tool向codis+pika的架构同步数据,同步模式为全量+增量,源端为redis cluster 4.0,目标端为coids-proxy地址,目前可以正常同步,但是到增量阶段大概8小时左右,就会出现session close的错误,导致同步进程Crash,redis-migrate-tool日志没有任何报错,在codis proxy日志只可以看到:

2023/05/25 15:51:16 session.go:83: [INFO] session [0xc012833600] create: {"ops":0,"create":1685001076,"remote":"192.168.3.26:39470"}
2023/05/25 22:53:10 session.go:90: [INFO] session [0xc012833600] closed: {"ops":136162772,"create":1685001076,"lastop":1685026390,"remote":"192.168.3.26:39470"}, error: EOF

codis配置文件为:

    "config": {
        "proto_type": "tcp4",
        "proxy_addr": "0.0.0.0:19000",
        "admin_addr": "0.0.0.0:11080",
        "jodis_name": "",
        "jodis_addr": "",
        "jodis_auth": "",
        "jodis_timeout": "20s",
        "jodis_compatible": false,
        "product_name": "codis-search-pika",
        "proxy_datacenter": "",
        "proxy_max_clients": 1000,
        "proxy_max_offheap_size": "1gb",
        "proxy_heap_placeholder": "256mb",
        "backend_ping_period": "5s",
        "backend_recv_bufsize": "20mb",
        "backend_recv_timeout": "5m",
        "backend_send_bufsize": "20mb",
        "backend_send_timeout": "5m",
        "backend_max_pipeline": 51200,
        "backend_primary_only": false,
        "backend_primary_parallel": 1,
        "backend_replica_parallel": 1,
        "backend_keepalive_period": "5m",
        "backend_number_databases": 16,
        "session_recv_bufsize": "200mb",
        "session_recv_timeout": "2h",
        "session_send_bufsize": "200mb",
        "session_send_timeout": "5m",
        "session_max_pipeline": 204800,
        "session_keepalive_period": "0",
        "session_break_on_failure": false,
        "metrics_report_server": "",
        "metrics_report_period": "1s",
        "metrics_report_influxdb_server": "",
        "metrics_report_influxdb_period": "1s",
        "metrics_report_influxdb_username": "",
        "metrics_report_influxdb_database": "",
        "metrics_report_statsd_server": "",
        "metrics_report_statsd_period": "1s",
        "metrics_report_statsd_prefix": ""
    }

不知道是由于什么问题导致的同步进程中断,希望大家可以给予提示和帮助,谢谢。

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions