There are a few ways we can consume the data generated within our Kafka architecture. I want our API side consumers to do minimal work to consume topics. With that in mind there are a few ways we can get data out of topics and into our APIs that feed our Apps. API in this case is referring to the Backend For Frontend (BFF). There are 3 ways I think these patters can work.
- Direct from Kafka Topics
- From a shared consolidated store built off the topics
- Consumers that work via webhooks -- off of topics