<strong>1. Consuming concurrently on the same topic and same partition</strong>
Suppose I have 100 partitions for a given topic (e.g.
Purchases), I can easily consume these 100 partitions (e.g.
Clothing, and etc...) in parallel using a consumer group with 100 consumers in it.
However, that is assigning one consumer to each subset of the total data on
Purchases. What if I want just want to consume one subset of data with 100 consumers concurrently? For example, for all of my consumers, they just want to know
Electronics partition of the
<em>Is there way they can consume this partition concurrently?</em>
In general I just want all my consumers to receive <strong>the same data set concurrently</strong>.
From the information I've gathered, it seems to me that consumers CANNOT consume from replicas: <a href="https://stackoverflow.com/questions/37803376/consuming-from-a-replica" rel="nofollow">Consuming from a replica</a>
<em>Can I produce the same data to multiple topics, like
Purchase-2[Electronics] so then I can consume them concurrently? Is this a recommended approach?</em>
<strong>2. Producing concurrently on the same topic and same partition</strong>
When multiple producers are producing to the same topic and same partition, since we can only write to the partition leader and replicas are only there for fault-tolerance, <em>does this mean there isn't any concurrency?</em> (i.e. each commit must wait in line.)Answer1: