Skip to main content

🗓️ 09042024 0948
📎 #aliyun_canal

aliyun_canal_mq_client

Partitioning Strategies

IMPORTANT

Affects ordering / rate at which messages are consumed

Single Topic, Single Partition

  • 😀 Guarantees ordering
  • 🙁 Not good write performance

Multiple topics, each single partition

  • 😀 Guarantees ordering
  • 🙁Not recommended for hot (tables with high write frequency) tables

Single / multiple topics, each multiple partitions (PK key)

  • Partition based on a specified key
canal.mq.partitionHash=mytest.person:id,mytest.role:id
  • 😀 Ordering within each partition guaranteed
  • 😀 Good write performance
  • 🙁 Carefully consider how to use PKEY ()

References