Uploaded image for project: 'Policy Framework'
  1. Policy Framework
  2. POLICY-1963

Apex-pdp: Introduce "exactly once" messaging sematics through Apache Kafka Transactional API

    Details

    • Type: Story
    • Status: Open
    • Priority: Highest
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: Frankfurt Release
    • Labels:

      Description

      "Exactly Once" messaging semantics means no duplication or loss of messages.

      Exactly-once processing is based on a 'read-process-write pattern', which can be achieved through Transactions, see below links more more information:

      1. Exactly once Semantics are Possible: Here’s How Kafka Does it: https://www.confluent.io/blog/exactly-once-semantics-are-possible-heres-how-apache-kafka-does-it/
      2. Transactions in Apache Kafka:  https://www.confluent.io/blog/transactions-apache-kafka/
      3. Video presentation on the link above, search Exactly one semantics: https://www.confluent.io/resources/ 
      4. What does Kafka's exactly-once processing really mean?: https://softwaremill.com/what-kafka-exactly-once-really-means/

       

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            • Assignee:
              Hengye Yehui Wang
              Reporter:
              emagrog marc grogan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: