Week of May 27th

TL;DR:

• Weekly Hamilton Release. Main highlights: Kedro plugin support; more Project Jupyter magic functionality.
• Blog post: Kedro + Hamilton. We explain the differences and then how you can use Hamilton to run Kedro ??.
• Organic user post on Hamilton for RAG. Excited to see organic posts like this hit our radar!
• Weekly Burr Release: no release cut just yet, but we had an open source contribution for MongoDB . Thanks Nandani Thakur (hopefully the right one!)
• ScrapeGraphAI Burr integration .
• Hamilton OS Meetup Group: June & August scheduled.

Hamilton Release 1.64.0

What's new:

• Kedro support!
• Project Jupyter magic improvements.

Kedro

You can now import a Kedro pipeline and have Hamilton run & display it

You can also access the Kedro data catalog via the data saver/loader abstraction that Hamilton has in two ways - option (1) Hamilton figures out it's Kedro:

The other way is to explicitly say you're reading and writing to/from the Kedro catalog:

This then enables one to utilize the Hamilton UI to run and see your execution!

If you're a Kedro user, we'd love for you to take this for a spin!

Check out this notebook for details.

Jupyter Magic

You can now do more things with Hamilton's magic command. For example:

• write the cell to a module
• pass in configuration to change the display
• pass in a builder & inputs to execute the code in the cell
• and a few more

This enables you to get more done faster with the existing magic :)

All this work this week was by Thierry Jean ??.

Hamitlon Examples / Documentation Updates:

Kedro plugin

To go with the Kedro support we just pushed. This is a notebook that shows how to use the plugin Hamilton has for your kedro project.

Kedro comparison:

If you wanted to see a side by side comparison of Hamilton & Kedro we have that now using their spaceflight tutorial. See this directory for details . This complements our documentation here as well.

Blog post on Kedro & Hamilton

Title: Hamilton & Kedro for modular data pipelines

What is it about? This is a post that describes the two projects, their shared goals, how they differ, and then how they can be used together, e.g. via the kedro plugin. It's a good post for those that don't know either project, as well as those who know Kedro but don't know Hamilton.

The post goes to show code and then how you can integrate Kedro into Hamilton, so it's never an either or question; it's always "Hamilton and ..." ??.

We're excited to open up more access to the Hamilton UI with this feature!

Organic Hamilton blog

We were excited to see an organic user post on Hamilton this past week!

Vyom Modi wrote a post on using Hamilton for high performance RAG using Qdrant , Groq , LangChain in addition to Hamilton. What I love seeing most is people utilizing the graphical duality of Hamilton to produce images that tell you what the code is doing:

Burr Release News:

• We had an open source contribution from Nandani Thakur (hopefully the right person) who added MongoDB persistence support. ?? Thanks Nandani! We'll be shipping this in our next release.
• We've got a few features brewing that we'll hopefully drop next week; hint: SERDE and subgraphs.

ScrapeGraphAI's Burr integration

If you're looking to scrape the web ScrapeGraphAI has an open source project that does that. We've been recently working with them to integrate Burr into ScrapeGraphAI to help users more easily debug what is going on underneath.

We're super excited to see Burr already integrated into a library for others to use.

To see their post and get the details click here .

Hamilton OS Meetup Group

We have June & August meet-ups scheduled. Join/sign-up here .

We're still have speaking slots available, message me if you're interested:

• If you are using Hamilton and want to share, we'd love to have you present.
• We're also soliciting talks for anyone that's interested in chatting about software quality in the data world.

We'll lock down the June topics soon. We'll likely showcase how to use Hamilton for a RAG context.