Tobiko

???????????? ?????????????????????? The open-source project Streamlit continues to build momentum in the developer community. Streamlit embraces and embodies the latest movement, making it remarkably easy and fast for people to build powerful apps. It equips data scientists and engineers to transform Python scripts into dashboards, chat apps, and even websites in minutes ???. It’s no wonder we’ve been hearing all about it and seeing developers adopt it in droves. At Tobiko, we’ve long admired Streamlit’s innovation and utility. In fact, our very own Marisa Smith, PhD was the first developer advocate at Streamlit, and laid the foundation for strong relationships with its open-source community ??? . Our early involvement has fostered ongoing collaboration with the Streamlit team (some of you might have peeped the Tobiko team at Snowflake’s first-ever Dev Day!) A great example of the interplay between Streamlit’s and Tobiko’s solutions comes from Thomas Johnson, a member of our #SQLMesh and #SQLGlot communities. We encourage you to explore this app (link in comment), built with Streamlit, which displays the abstract syntax tree (AST) ?? for SQL code using SQLGlot, Tobiko’s open-source parser/transpiler/engine. It’s a clever tool to flatten expressions and visualize them as nodes within a graph structure, making complex SQL relationships more legible at a glance. This AST visualizer highlights the adaptability that’s driving Streamlit’s success, and also demonstrates SQLGlot’s versatility. When paired with SQLMesh, our data transformation framework, SQLGlot provides seamless SQL parsing and optimization while SQLMesh ensures zero-waste workflows and data quality. Together, they make data engineers’ work simpler and more productive. We’re proud to see applications like this, and look forward to more instances where our tools intersect with other exciting technologies in the data space. ?? #DataEngineering #OpenSource #DataTransformation

As the year begins to winds down, we couldn’t help but revisit a memorable moment from this summer, when Tobias (Toby) Mao, our CTO, caused a bit of a stir during The IT Press Tour ?? While other attendees showed up in business attire, Toby rolled in wearing sweatpants - practical, comfortable, and on-brand. For what it’s worth, his wardrobe choices didn’t overshadow the real show ?, an in-depth discussion with reporters about how Tobiko is helping data teams trim inefficiencies and costs by only building tables once, and improving trust in #data #pipelines by making the impact of every change visible. We were honored to be interviewed alongside innovators in fields like AI/ML infrastructure and cybersecurity. It’s a testament not only to how Tobiko is carving out our place in the data transformation landscape, but also to how vital timely and error-free data is across industries - and becoming ever more critical in highly technical spaces where it moves at immense speeds and volumes ?? For Toby, this was a novel experience. Being part of a press tour gave him a fresh perspective on tech journalism and how to communicate our mission to the broader tech world. As we continue to grow, these opportunities to share our story are invaluable. And here’s a little teaser: next year, we plan to hit the road even more ???- spreading the word about Tobiko and how we’re expanding our capabilities to help data teams scale fast and operate waste-free. Read Toby’s interview with C. Thomas (Tom) Smith, III of Insights From Analytics in the comment below, and stay tuned! ??? #DataEngineering #DataTransformation #SQLMesh

???????????????? ???????????? ???? ???????? ?????????????? ???- ?? ???????? ?????????? ?????????????????? ???????????????????? Last week, our CTO Tobias (Toby) Mao, joined a panel on data governance hosted by Etai Mizrahi, CEO/co-founder of Secoda, joining Kelly Burdine of Wellthy and Sreyashi Das, who currently works at Netflix—where Toby is a proud alumnus. The session covered important topics, including the often hairy challenges of getting data governance taken seriously and implemented rigorously. We recapped the topics below - along with our thoughts on each. ?? ??????????????’?? ?????????????? ?????? ?????????????????? ?????????????? ?????? ?????????????????????? ???? ???????? ???????????????????? Toby shared his experience at Netflix, helping data scientists contribute custom metrics within the bounds of version controls and unit-testing standards. We discussed how this has evolved into Netflix’s current approach: a decentralized data ownership model that removes bottlenecks caused by API proliferation and places subject matter experts in positions to oversee data within their domains. ?? ???????????? ???????? ???????????????????? ‘????????’ Tobiko is all about making developers more productive - and their experiences more smooth. We highlighted SQLMesh as a tool that embeds quality and ‘predictive’ visibility into the data workflow. In doing so, we enhance productivity without exposing data governance as ‘additional work’. ?? ?????????????????? ???????? ???????????????????? ?????????????? Success is one-part uptime (how often pipelines meet quality standards), and one-part confidence in making changes. Pipelines are always evolving, and we built SQLMesh not with only for accuracy, but also responsive transparency. By showing data teams the potential impact of their changes, we give them assurance to add new data and deliver results. ?? ???????????????? ???????? ‘????????????’ ?????? ‘??????????’ ???? ?????????? ???????? ???????????????????? ???????????????? Implementing data governance introduces additional processes and controls, which will almost certainly meet inertia or resistance. One powerful strategy is a ‘stick’ approach: corralling teams away from any alternatives to governed workflows. By requiring all pipelines to be in CI/CD, with unit tests and version control, we remove the temptation to run ad-hoc scripts. But along with other panelists, we also agreed on the importance of incentives - making adoption as painless as possible, and showing business value with high-impact test cases. At Tobiko, we bake good governance into our design thinking for SQLMesh and Tobiko Cloud, and we love to see it gain greater attention. Exciting times ahead as we continue to lead the charge in helping teams build scalable, agile, and well-governed data solutions! ?? See links in comments below for a replay of our panel, and to talk to us about how Tobiko can help you level up your data governance and productivity.

???From Mana to Metrics: SQLMesh powers Hearthstone data magic At Tobiko, we're always delighted by the imaginative ways our community uses SQLMesh. Mattias Thalén, one of our open-source community members, recently launched a fascinating GitHub project called "Arcane Insight", combining #SQLMesh with DuckDB to explore game data from Blizzard's Hearthstone API. ?? What is Arcane Insight? "Arcane Insight" is a data analytics project that processes and analyzes Hearthstone card game data to reveal trends, mechanics, and strategic insights. We’re honored that Mattias has chosen to use: -> SQLMesh for building scalable, efficient data pipelines, and -> DuckDB for lightning-fast local analytics ?? Highlights of the Project -> Analyzing Hearthstone cards and classes to uncover card statistics and attributes. -> Employing SQLMesh models like incremental time-based staging for powerful data transformations. -> Designing a pipeline that bridges technical depth with real-world gaming applications. This project is a testament to how SQLMesh empowers developers not only to transform raw data into insights, but make the process so seamless and friendly that they’re inspired to apply it to creative, perhaps unexpected domains - like gaming - even for personal projects. ??We're thrilled to see the intersection of creativity and data engineering! Check out links in the comments to explore Arcane Insight on GitHub and see SQLMesh and DuckDB in action. You can also join our community, or get a demo from our team to learn how to harness the power of SQLMesh!

We joined Databricks on their Data + AI World Tour ?? Our sales team had the privilege of attending Databricks’ Data + AI summit last week on the LA leg of their World Tour, and as we do every time we take part in their conferences, we came away loaded with learnings on the latest in the data industry. Our top three takeaways: 1. Meeting ‘in the field’ is and will always be an irreplaceable experience. Connecting live with members of the Databricks team opened up more collaboration opportunities ?? As a big plus, we also got to chat face-to-face with Joseph Hobbs and with our friends at Sigma Computing. 2. And on that note, Sigma sizzled in their breakout session. They shone a spotlight on the incredible time saved (hundreds of hours per month for a retail customer???) through their partnership with?Databricks by replacing outdated workflows. It was a powerful use case that sparked ideas?among our team around how #SQLMesh can also help more companies modernize data processes. 3. Databricks continues to double down on helping SQL-first data teams work more efficiently?—and that’s right in line with what we’re doing at Tobiko with SQLMesh and Tobiko Cloud?? It’s exciting to explore ways our platforms can team up to make life easier for data teams. ?? The tour was packed with insights and new connections. We’ve brought these learnings back to Tobiko to continue delivering next-level data infrastructure solutions. Schedule time to hear about our roadmap and get a demo at https://lnkd.in/exEU3WG7! #DataAIWorldTour #DataTransformation #SQLMesh #Databricks

There’s nothing quite like a night out at The Magic Castle? to top off a successful quarter at Tobiko ?? Last week, our founders and GTM team gathered in LA for a mini-offsite ?? As a #remote?company, we hold the flexibility of WFH sacred, but we also foster and cherish occasions to meet face-to-face, which allow us to bounce ideas around and take our creativity and collaboration to the next level ??. And this is just the beginning - we’re planning more trips that blend business and bonding for the team! With many of our team members based in Greater LA and the Bay Area, we’re excited to extend this in-person magic ? by hosting meetups in both regions for the data community. First up: our popular Peninsula Data Happy Hour is back on 11/14. If you’re in the area, come join us over free bites & beers! https://lu.ma/omfb6f4o #remotework #offsite #teamfun

Surprise #SQLMesh representation at Python Barcelona! ???? It always warms our hearts to see SQLMesh get recognized and spotlighted organically by our community members. We’re delighted to have been showcased last Saturday at Python Barcelona's #PyDay by???? Marc Ramírez Invernón of Pitch. It’s great to see our open source power users’ involvement and passion for our OS project! ???We’re thrilled to see SQLMesh evolve ever more into a tool trusted by data professionals around the world and can’t wait to see other innovative use cases our community will apply it to next! ?? To reciprocate Marc’s support for SQLMesh, we also want to show appreciation for Marc’s work. To learn more, check out his workshop on GitHub! https://lnkd.in/gRrxt3bj #opensource #Community #python

Check out our latest blog by Tobias (Toby) Mao, which made it to the front page of HackerNews! https://lnkd.in/gv3nE3JU #madeit #data #dbt #SQLMesh

?? Thrilled to share our experience at TechCrunch Disrupt 2024, where Tobiko had a fantastic presence! Thank you to Tomasz Tunguz for his insightful moderation of the Data Transformation panel. And, of course, to the panel participants, Tobias (Toby) Mao, Daniel Svonava, Jordan Tigani, and Colin Zima, for their thought-provoking discussion. ?? A couple key takeaways: 1. The love-hate relationship with AI is evolving; our focus should be on leveraging it to enhance human creativity and productivity rather than replacing it. 2. The increasing need for flexibility in data platforms, especially given the diverse range of tools available today. This is exactly why SQLMesh is designed to integrate seamlessly with any data warehouse, helping to avoid vendor lock-in. We believe that transformation is essential as we navigate the complexities of the post-modern data stack. Excited for what lies ahead! #TechCrunchDisrupt #DataInnovation #SQLMesh #Tobiko

Last month, we celebrated Oktoberfest with the Bay Area data community with free food and drinks in San Mateo. It was such a hit, we’re hosting it again this month - same venue, same good vibes, more discussions about data! Join us for Happy Hour to learn and chat about the ???????? ???????????? ???????? ??????????, mingle with data industry peers, and meet our Tobiko Data team along with our co-sponsors typedef, Recce and Wilson Sonsini Goodrich & Rosati ?? Register here: https://lu.ma/omfb6f4o ???San Mateo, CA ????Thursday, Nov 14th ???5:00 PM PDT