search

Home  >  Q&A  >  body text

What are the advantages of partition design in kafka?

Is it possible to improve concurrent writing? Disk io can only write one file at the same time, right?
Is it possible to improve concurrent reading? Disk io can only read one file at a time, right?
Is it possible to increase the single write speed? It seems to have nothing to do with partition, right?
Is it possible to increase the single read speed? Wouldn’t it be solved with multiple segments?

滿天的星座滿天的星座2709 days ago1140

reply all(1)I'll reply

  • ringa_lee

    ringa_lee2017-06-23 09:15:28

    Original answer: Isn’t it the scalability of the topic? Otherwise, the capacity of a single topic can only be limited to the physical machine
    Updated answer:
    The partitions in the log serve several purposes. First, they allow the log to scale beyond a size that will fit on a single server. Each inpidual partition must fit on the servers that host it, but a topic may have many partitions so it can handle an arbitrary amount of data. Second they act as the unit of parallelism—more on that in a bit.
    Official documentation (see above) .
    Partitions have two main purposes. 1. Enhance scalability so that it can handle any amount of data. 2. Use it as a parallel unit to improve parallel capabilities (mainly considering this point).
    This is my first answer and I only remember the first point~~sorry

    reply
    0
  • Cancelreply