Clik here to view.
Karafka Web UI – Your Ruby and Rails out-of-the-box Kafka UI
I'm thrilled to announce the new and shiny addition to the Karafka ecosystem: Karafka Web. For those who wonder what Karafka is, Karafka is a Ruby and Rails multi-threaded efficient Kafka processing...
View ArticleClik here to view.
Kafka topics as code – declarative Kafka topics management in Ruby
Kafka topics are a fundamental concept in Apache Kafka. Topics are logical names or labels representing a stream of messages that Kafka clients can produce and consume. What makes them interesting is...
View ArticleClik here to view.
Delaying Kafka Messages Processing with Karafka: A Deep Dive into Delayed Topics
Kafka is a popular distributed streaming platform that is commonly used for building real-time data pipelines and streaming applications. One of the core features of Kafka is its ability to handle...
View ArticleClik here to view.
Karafka framework 2.1 announcement
I'm happy to announce that Karafka 2.1 has just been released. For those who wonder what Karafka is, Karafka is a Ruby and Rails multi-threaded efficient Kafka processing framework. The Karafka 2.1...
View ArticleClik here to view.
Inside Kafka: Enhancing Data Reliability Through Transactional Offsets with...
Karafka is a Ruby and Rails framework that simplifies the development of Apache Kafka-based applications. Among its varied features, the Filtering API provides enhanced control over the data flow. The...
View ArticleClik here to view.
Asset Handling in Roda: Cache Forever, Refresh When Needed
Introduction Managing frontend assets in gems serving Web UI can be tricky. Why? Because while you want assets to expire across versions, you don't want them fetched repeatedly, slowing things down....
View ArticleClik here to view.
Monitoring Karafka Jobs Progress Using Web UI
Introduction Karafka is a Ruby and Rails framework designed to simplify processing messages consumed from Apache Kafka. One of Karafka's components is the Web UI. It provides a convenient way for...
View ArticleThe Ruby 2.7 Challenge: Adapting to Bundler’s Latest 2.5+ Update
While officially End-of-Life (EOL), Ruby 2.7 remains critical in many ongoing projects. Despite its EOL status, a significant user base continues to rely on this version for various reasons, ranging...
View ArticleClik here to view.
Karafka Framework 2.3 + Web UI 0.8 Release Announcement
Introduction I'm happy to announce that Karafka 2.3 and its Web UI 0.8 have just been released. For those who wonder what Karafka is, Karafka is a Ruby and Rails multi-threaded efficient Kafka...
View ArticleClik here to view.
Ruby Warsaw Community Conference 2024: A Compact Adventure in the Heart of...
Introduction Leaving Cracow's familiar scenes behind, I headed to Warsaw with anticipation for the Ruby Warsaw Community Conference. The compact yet promising event marked a day dedicated to Ruby...
View ArticleClik here to view.
The Art of Forking: Unlocking Scalability in Ruby
Introduction The journey towards efficient parallelization in library development has often been based on using threads. As Karafka celebrates its eighth anniversary, it's become clear that while...
View ArticleFrom Oniguruma to POSIX: The Regex Rift Between Ruby and C
Introduction In the world of Kafka and its applications, utilizing regular expressions for topic subscriptions is a common strategy. This approach is particularly beneficial for dynamically managing...
View ArticleClik here to view.
Karafka 2.4 Release Announcement: Advancing Kafka Processing for Ruby and Rails
Introduction I am thrilled to announce the release of Karafka 2.4, a significant milestone in the evolution of my Ruby and Rails multi-threaded efficient Kafka processing framework. This release builds...
View ArticleClik here to view.
From Sleep to Speed: Making Rdkafka Sync Operations 16 Times Faster
As an open-source developer, I constantly seek performance gains in the code I maintain. Since I took over rdkafka from AppSignal in November 2023, I promised not only to maintain the gem but to...
View ArticleClik here to view.
The librdkafka Supply Chain Breakdown: rdkafka-ruby’s Darkest Hour
Opening Note We all make mistakes, and fundamentally, the havoc caused by this incident was due to a flaw in the design of rdkafka-ruby. While the disappearance of librdkafka from GitHub was...
View ArticleClik here to view.
Under the Hood: Enhancing Karafka’s CPU and Memory Efficiency
Introduction Now and then, I like to go on a performance improvement hunt because life isn't just about adding new features. Recently, I have been focusing on enhancing efficiency, particularly...
View Article