Week of April 15th
Skim the TL;DR: stay for more details.

Week of April 15th

Hi all, here's my first attempt at writing a newsletter for the weekly updates I have been pushing.

TL;DR:

  • We're going to be at #PyCon in Pittsburgh in May as part of Start-Up Row!
  • New Hamilton release 1.58.0 driven by OS contributions, with one coming from a user at 安海斯 - 布希英博 !
  • Meet-up recording: learn about how Thierry Jean approached building ML models & evaluation with Hamilton as well as a deeper dive into loading & saving data with Hamilton.
  • New blog & Hamilton example show casing a lightweight and flexible #ETL stack using dltHub with Ibis; pure python libraries that don't require systems to run!
  • New Burr release 0.14.0 with with UI updates, as well as documentation explaining the multi-agent "divide-and-conquer" example.

PyCon Start-Up Row

We're excited to be accepted to PyCon as part of Start-Up row. We'll have a booth for the duration of the conference; come grab a sticker!

Are you going to be there? If so, let us know as we're trying to organize an informal meet-up / happy-hour.

------------------------

Hamilton Release 1.58.0

-------------------------

pip install sf-hamilton==1.58.0

?? New features - driven by OS contributors

We continue to get more coverage for our data savers & loaders!

??? Fixes:

Documentation / Examples:

-----------------------------

Hamilton Meet up Recording

-----------------------------

The title for Thierry's talk -

Catch the recording of this month's meetup here. In it we covered:

  1. Thierry Jean 's experience using Hamilton for managing ML Experiments and what led to the creation of the lightweight experiment manager that Hamilton ships with.
  2. We covered recent feature releases and contributions to Hamilton.
  3. We went deeper into the different ways you can structure loading/saving data with Hamilton. Going over the "Data savers & loaders" concept and when they're most appropriate.

---------------

From our blog

---------------

https://blog.dagworks.io/p/slack-summary-pipeline-with-dlt-ibis?r=2cg5z1&utm_campaign=post&utm_medium=web

In this past week's blog we wrote about how you can create a lightweight and flexible #ETL stack using dltHub , Ibis, and Hamilton. The example used shows how one could pull slack data and transform it.

The bigger picture/theme is that all of these tools work within a python process and are therefore quite lightweight and portable; say good-bye to infrastructure lock-in for your pipelines!

See the code here.

------------------------

Burr Release 0.14.0

-------------------------

pip install burr==0.14.0

?? New features:

  • Collapsable views of rendered state:

You can now collapse state in the UI to more easily navigate.

??? Fixes:

  • Better error messaging for when no inputs are provided but are required.

?? Documentation:

  • Want to see an agent example with Burr? We've now add more documentation to our "divide-and-conquer" example that shows two "agents" working together to complete a task. There are two implementations: one in LangChain the other in Hamilton.


That's all for this week -- let me know what you think of this format!

?????? Mikiko B.

MLOps & AI Engineer ?????? Building SOTA Gen-AI adaptive ML & data systems

11 个月

Looks great! ??

要查看或添加评论,请登录

Stefan Krawczyk的更多文章

  • February Updates

    February Updates

    TL;DR: #Hamilton highlights: crossed 2000 github stars, released multithreading based DAG parallelism, RichProgressBar…

    3 条评论
  • Last week of 2024 / first week of 2025

    Last week of 2024 / first week of 2025

    TL;DR: #Hamilton + #Burr 2024 stats: 35M+ telemetry events (10x), 100K+ unique IPs (10x) from 1000+ companies, 1M+…

    3 条评论
  • Week of December 9th

    Week of December 9th

    TL;DR: #Hamilton release highlights: Better TypedDict support and modular subdag example Office Hours & Meet ups for…

  • Week of December 2nd

    Week of December 2nd

    TL;DR: #Hamilton release highlights: Async Datadog Integration, Polars & Pandas with_columns support. #Burr release…

  • Week of November 18th

    Week of November 18th

    TL;DR: #Hamilton release highlights: SDK configurability #Burr release highlights: parallelism UI modifications, video…

  • Week of November 11th

    Week of November 11th

    TL;DR: #Hamilton release highlights: async support for @pipe + various small fixes #Burr release highlights:…

  • Week of November 4th

    Week of November 4th

    TL;DR: #Hamilton release highlights: @with_columns decorator for Pandas by Jernej Frank & module overrides for async…

  • Week of October 28th

    Week of October 28th

    TL;DR: #Hamilton release highlights: in-memory cache store. #Burr release highlights: release candidate for a first…

  • Week of October 21st

    Week of October 21st

    TL;DR: #Hamilton release highlights: some minor fixes and docs updates from five different OS contributors! Also…

  • Week of October 14th

    Week of October 14th

    TL;DR: Announcing Shreya Shankar as an advisor. #Hamilton release highlights: tweaks to pipe_input, new…

    3 条评论

社区洞察

其他会员也浏览了