Magento Integration Apache Kafka advantages over the RabbitMQ
Srinivasu Lanka
Enterprise Digital Retail eCommerce Transformations Initiatives | Crafting Strategic Roadmaps for Growth & Success | Driving 20X Sales Increase with Composable, Serverless, Cloud Native Solutions
Magento message queue Apache Kafka integration better option than RabbitMQ for larger volume message queues, complex message processing and number of nodes increases.
Go through below some of Apache Kafka advantages over the RabbitMQ.
RabbitMQ Disadvantages:
- Publish / Subscribe broker failure to delivery messages on specified time
- Instabilities increases if number of nodes increases and message volume grows.
- No topic groups or tag support to categorize message queues
- No confirmation and no guaranty message delivery to subscribers
- No log recovery if logger fails or crashes
Replace RabbitMQ with Apache Kafka you can get following advantages:
- High-throughput, low-latency platform for handling real-time data feeds
- Supports larger network packets, larger sequential disk operations, contiguous memory blocks
- Runs on a cluster of one or more servers and the partitions of all topics are distributed across the cluster nodes
- Topics are divided into partitions for better categorization
- Topics can be configured with a retention time or a space bound to delete message to free storage space
RabbitMQ Architecture:
Apache Kafka Architecture:
Refer when to use Apache Kafka over RabbitMQ.
https://stackoverflow.com/questions/42151544/when-to-use-rabbitmq-over-kafka/42154452#42154452
RabbitMQ Cloud Service:
https://www.cloudamqp.com/
Apache Kafka Cloud Service:
https://www.cloudkarafka.com/