Uploaded image for project: 'Policy Framework'
  1. Policy Framework
  2. POLICY-1963

Apex-pdp: Introduce "exactly once" messaging sematics through Apache Kafka Transactional API

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Closed
    • Priority: Highest
    • Resolution: Won't Do
    • Affects Version/s: None
    • Fix Version/s: Frankfurt Release
    • Labels:

      Description

      "Exactly Once" messaging semantics means no duplication or loss of messages.

      Exactly-once processing is based on a 'read-process-write pattern', which can be achieved through Transactions, see below links more more information:

      1. Exactly once Semantics are Possible: Here’s How Kafka Does it: https://www.confluent.io/blog/exactly-once-semantics-are-possible-heres-how-apache-kafka-does-it/
      2. Transactions in Apache Kafka:  https://www.confluent.io/blog/transactions-apache-kafka/
      3. Video presentation on the link above, search Exactly one semantics: https://www.confluent.io/resources/ 
      4. What does Kafka's exactly-once processing really mean?: https://softwaremill.com/what-kafka-exactly-once-really-means/

       

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            Hengye Yehui Wang
            Reporter:
            emagrog marc grogan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: