New extension: Producing Messages (Kafka)

Announcements
1

The next extension for the Kafka challenge is now live: Producing Messages.

The Produce API in Apache Kafka enables producers to send messages to brokers, ensuring persistence by reliably storing those messages on disk for later consumption by consumers.

image
image1200×630 157 KB

By the end of this extension, your Kafka broker implementation will support:

  • Responding to Produce requests
  • Handling invalid topics and partitions
  • Writing single and multiple records to log files
  • Supporting multi-partition and multi-topic produce requests

Here’s the stage breakdown:

image
image1328×656 48.6 KB

Please give this a try and let us know how it can be improved! @UdeshyaDhungana (author of this extension) and I will be available here to help out!

3

I dont know how but did you guys break unsigned varint parsing on your end?

My old code dosen’t work anymore and I suspect it is an issue of varint parsing in RecordBatches Size

5

Hey @LynX-gh, would you mind starting a new thread (topic), uploading your code to GitHub and sharing the link? It will be much easier to debug if I can run it directly.

7

Not sure if this is the same issue you’re facing, but one thing that tripped me up was the flexible headers. Some APIs have a \_tagged_field and some don’t. This could result in one byte off problems. Not sure though if this is the problem you’re running into but figured I’d point it out jic.