All Data and AI Weekly #177 - 17-Feb-2025

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data )

https://bsky.app/profile/paasdev.bsky.social

Cool Stuff of the week

?? PyIceberg for upsert without the burden of Spark https://github.com/soumilshah1995/pyiceberg-upsert-demo

?? Apache NiFi 2.2! https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.2.0

?? https://www.dhirubhai.net/pulse/three-things-i-learned-from-customer-conversations-davos-ramaswamy-iklcc/

?? https://source.coop/repositories/harvard-lil/gov-data/description

?? https://medium.com/snowflake/streaming-data-to-snowflake-with-redpanda-connect-03c4c02dfd37

?? https://medium.com/@scottteal/tutorial-how-to-integrate-trino-and-snowflakes-service-for-apache-polaris-49ac5e25b389

?? https://github.com/moustafa-ismail/ragnroll/

?? https://medium.com/@sahil_singla/how-to-not-run-a-12-000-query-on-snowflake-b80c456b790c

?? https://www.youtube.com/watch?v=PZdVSISXdqM&list=PLqRma1oIkcWgN9agdJ0DQhX2gPf8K2ynk

?? https://github.com/Snowflake-Labs/sfguide-getting-started-with-cortex-agents

?? https://github.com/mufeedvh/code2prompt

?? https://www.dhirubhai.net/posts/snowflake-computing_1-million-strong-from-sharing-insights-activity-7295855409779593216-2QbZ/?utm_source=share&utm_medium=member_ios

?? https://launchdarkly.com/blog/launchdarkly-snowflake-warehouse-native-experimentation/

?? https://github.com/lewj85/jessesort

?? https://github.com/DavidXanatos/TaskExplorer

?? https://github.com/Goldziher/kreuzberg

?? If you are in Manhattan, check this cafe out. super cool. https://www.os-nyc.com/

?? Decentralized AI Agent Alliance https://medium.com/quantum-economics/why-we-started-the-decentralized-ai-agent-alliance-6eb0938d7bc5

?? RedPanda Connect to Snowflake is 2X faster. https://www.redpanda.com/blog/fast-simple-data-ingestion-snowflake-connector

New Models

?? Snowflake Arctic Instruct

?? Deepseek

?? https://github.com/plexe-ai/smolmodels

Upcoming

?? 20 February 2025 - Online - AI Dev World https://aidevworld.com/conference/speakers/

?? 03 March 2025 - Philadelphia - https://sites.google.com/servicenow.com/good-data-2025/invited-speakers

?? Now https://www.conf42.com/python2025

https://sessionize.com/tspann

https://github.com/timothyspann

Recent Tim Stuff

?? Video IoT

?? Dec 19: Conf42 IoT 2024: Virtual: https://www.conf42.com/Internet_of_Things_IoT_2024_Tim_Spann_opensource_build

?? Unstructured Data and LLM: What, Why and How with Timothy Spann

Technologies

CODE + COMMUNITY

? 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack (AI + Vectors + LLM + Streaming + IoT)