top of page

The resurgence of Open Source ETL

Fascinating times in the ebb and flow of open source projects. I initially dipped my toes in the open source community back in the mid 2000's. At the time I was looking for a cheaper ETL alternative to the big dogs at the time (IBM/Ascential Datastage, and Informatica). There were a few alternatives at that juncture, but I leaned toward Kettle and Talend. After many trials I ended up diving head first into kettle due to its flexibility and scalability, which eventually became Pentaho Data Integration.


I consider myself very lucky at the time to be in the "wild west" of open source. I was part of a small startup consulting company that provided open source analytic solutions. We provided guidance on a plethora of projects for a few years and had a ball doing it! Eventually we were acquired by Pentaho and helped lead that company to a successful acquisition by Hitachi Vantara.


Over those years I slowly saw the great open source projects gobbled up by large companies (which subsequently made all those closed source). It was sad times to see that happen. Fast forward to the past couple years. There are some newer players in the open source ETL market (Keyboola, Airbyte, Singer, Apache Nifi, etc.).


But, what really caught my eye was the resurgence of what was formerly kettle and Pentaho Data Integration. Apache Hop https://hop.apache.org/ is a fork of kettle/Pentaho Data Integration from its true open source days. The original architect, Matt Casters, is leading the team, and there are a lot of great new use-cases for it! It is well out of incubator status and is already up to a stable version of 2.3.


Exciting times! Check it out!

46 views0 comments

Recent Posts

See All

KPI Forge Announces A New Fully Open Source BI Stack

At KPI Forge we have always provided technology agnostic solution consulting, services, and guidance. We pride ourselves in having experience in just about every platform in existence. Whether it ha

The Customer is Always Wrong

A preface to a book about making customers successful I vividly remember very early in my life, the excitement I got fixing things.  One of the earliest gifts I received at Christmas or a birthday was

Harnessing "The Power of 3" for a Productive Day!

In the hustle and bustle of modern work life, context switching has become an inevitable challenge. Whether you're juggling multiple projects, tasks, or roles, the ability to seamlessly transition bet

Comments


bottom of page