Clik here to view.
Inside Kafka: Enhancing Data Reliability Through Transactional Offsets with...
Karafka is a Ruby and Rails framework that simplifies the development of Apache Kafka-based applications. Among its varied features, the Filtering API provides enhanced control over the data flow. The...
View ArticleClik here to view.
Asset Handling in Roda: Cache Forever, Refresh When Needed
Introduction Managing frontend assets in gems serving Web UI can be tricky. Why? Because while you want assets to expire across versions, you don't want them fetched repeatedly, slowing things down....
View ArticleClik here to view.
Monitoring Karafka Jobs Progress Using Web UI
Introduction Karafka is a Ruby and Rails framework designed to simplify processing messages consumed from Apache Kafka. One of Karafka's components is the Web UI. It provides a convenient way for...
View ArticleThe Ruby 2.7 Challenge: Adapting to Bundler’s Latest 2.5+ Update
While officially End-of-Life (EOL), Ruby 2.7 remains critical in many ongoing projects. Despite its EOL status, a significant user base continues to rely on this version for various reasons, ranging...
View ArticleClik here to view.
Karafka Framework 2.3 + Web UI 0.8 Release Announcement
Introduction I'm happy to announce that Karafka 2.3 and its Web UI 0.8 have just been released. For those who wonder what Karafka is, Karafka is a Ruby and Rails multi-threaded efficient Kafka...
View ArticleClik here to view.
Ruby Warsaw Community Conference 2024: A Compact Adventure in the Heart of...
Introduction Leaving Cracow's familiar scenes behind, I headed to Warsaw with anticipation for the Ruby Warsaw Community Conference. The compact yet promising event marked a day dedicated to Ruby...
View ArticleClik here to view.
The Art of Forking: Unlocking Scalability in Ruby
Introduction The journey towards efficient parallelization in library development has often been based on using threads. As Karafka celebrates its eighth anniversary, it's become clear that while...
View ArticleFrom Oniguruma to POSIX: The Regex Rift Between Ruby and C
Introduction In the world of Kafka and its applications, utilizing regular expressions for topic subscriptions is a common strategy. This approach is particularly beneficial for dynamically managing...
View ArticleClik here to view.
Karafka 2.4 Release Announcement: Advancing Kafka Processing for Ruby and Rails
Introduction I am thrilled to announce the release of Karafka 2.4, a significant milestone in the evolution of my Ruby and Rails multi-threaded efficient Kafka processing framework. This release builds...
View ArticleClik here to view.
From Sleep to Speed: Making Rdkafka Sync Operations 16 Times Faster
As an open-source developer, I constantly seek performance gains in the code I maintain. Since I took over rdkafka from AppSignal in November 2023, I promised not only to maintain the gem but to...
View ArticleClik here to view.
The librdkafka Supply Chain Breakdown: rdkafka-ruby’s Darkest Hour
Opening Note We all make mistakes, and fundamentally, the havoc caused by this incident was due to a flaw in the design of rdkafka-ruby. While the disappearance of librdkafka from GitHub was...
View ArticleClik here to view.
Under the Hood: Enhancing Karafka’s CPU and Memory Efficiency
Introduction Now and then, I like to go on a performance improvement hunt because life isn't just about adding new features. Recently, I have been focusing on enhancing efficiency, particularly...
View ArticleClik here to view.
The Silent Guardian: Why Bundler Checksums Are a Game-Changer for Your...
Introduction: A Fragile Trust The Ruby ecosystem relies heavily on RubyGems.org as the central platform for distributing and managing gems. We all depend on it to provide reliable, untampered gems that...
View ArticleClik here to view.
Breaking the Rules: RPC Pattern with Apache Kafka and Karafka
Introduction Using Kafka for Remote Procedure Calls (RPC) might raise eyebrows among seasoned developers. At its core, RPC is a programming technique that creates the illusion of running a function on...
View ArticleClik here to view.
Certificate Apocalypse: Bringing Your Chromecast Back from the Dead
On March 9, 2025, many Chromecast 2nd generation and Chromecast Audio devices suddenly stopped working. Users like me could not cast content or set up their devices. This wasn't due to a software...
View ArticleClik here to view.
From pidfd to Shimanami Kaido: My RubyKaigi 2025 Experience
Introduction I just returned from RubyKaigi 2025, which ran from April 16th to 18th at the Ehime Prefectural Convention Hall in Matsuyama. If you're unfamiliar with it, RubyKaigi is the biggest Ruby...
View Article