Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

DM's dm-worker can't support pull exceeded 4GB binlog. #5102

Open
superlzs0476 opened this issue Sep 4, 2020 · 0 comments
Open

DM's dm-worker can't support pull exceeded 4GB binlog. #5102

superlzs0476 opened this issue Sep 4, 2020 · 0 comments
Labels
area/dm Issues or PRs related to DM. type/feature Issues about a new feature

Comments

@superlzs0476
Copy link

Bug Report

Please answer these questions before submitting your issue. Thanks!

  1. What did you do? If possible, provide a recipe for reproducing the error.

As the source of MySQL produces exceeded 4GB Binlogs, DM-work will be abort and wait for the operator manual redo this task that Binlogs from the source platform to target dm-worker of rely-dir.

  1. What did you expect to see?

Dm-worker supports pull exceeded 4GB Binlog from source Mysql.

  1. What did you see instead?

https://docs.pingcap.com/tidb-data-migration/v2.0/error-handling#solutions-1

  1. Versions of the cluster

    • DM version (run dmctl -V or dm-worker -V or dm-master -V):

      (paste DM version here, and you must ensure versions of dmctl, DM-worker and DM-master are same)
      

All of DM version

- Upstream MySQL/MariaDB server version:

    ```
    (paste upstream MySQL/MariaDB server version here)
    ```

- Downstream TiDB cluster version (execute `SELECT tidb_version();` in a MySQL client):

    ```
    (paste TiDB cluster version here)
    ```

- How did you deploy DM: DM-Ansible or manually?

    ```
    (leave DM-Ansible or manually here)
    ```

- Other interesting information (system version, hardware config, etc):

    >
    >
  1. current status of DM cluster (execute query-status in dmctl)

  2. Operation logs

    • Please upload dm-worker.log for every DM-worker instance if possible
    • Please upload dm-master.log if possible
    • Other interesting logs
    • Output of dmctl's commands with problems
  3. Configuration of the cluster and the task

    • dm-worker.toml for every DM-worker instance if possible
    • dm-master.toml for DM-master if possible
    • task config, like task.yaml if possible
    • inventory.ini if deployed by DM-Ansible
  4. Screenshot/exported-PDF of Grafana dashboard or metrics' graph in Prometheus for DM if possible

@superlzs0476 superlzs0476 changed the title DM's dm-worker can't support pull more than 4GB binlog. DM's dm-worker can't support pull exceeded 4GB binlog. Sep 4, 2020
@scsldb scsldb added feature/accept type/feature-request Categorizes issue or PR as related to a new feature. priority/normal labels Sep 4, 2020
@lance6716 lance6716 transferred this issue from pingcap/dm Apr 2, 2022
@lance6716 lance6716 added area/dm Issues or PRs related to DM. type/feature Issues about a new feature and removed priority/normal type/feature-request Categorizes issue or PR as related to a new feature. feature/accept labels Apr 2, 2022
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
area/dm Issues or PRs related to DM. type/feature Issues about a new feature
Projects
None yet
Development

No branches or pull requests

3 participants