All Data and AI Weekly #180 - 10-March-2025

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data )

https://bsky.app/profile/paasdev.bsky.social

NiFi + AI + AI Data Cloud + Iceberg.

I spoke in Philly at AAAI 25.

?? https://www.slideshare.net/slideshow/2025-03-03-philly-aaai-gooddata-build-secure-rag-apps-with-open-llm/276236858

Cool Stuff of the week

?? https://www.snowflake.com/en/engineering-blog/evaluating-and-optimizing-search-quality--seamlessly-tune-your-s/

?? https://github.com/RangaRS/Plainsight

?? https://www.npmjs.com/package/lynx-framework

?? https://github.com/hyperledger-labs/aifaq

?? https://github.com/tspannhw/FLaNK-IceIceData

?? https://368chickens.com/

?? https://github.com/wild-card-ai/agents-json

?? https://revolt.chat/download

?? https://medium.com/@iamjaswanth9/data-quality-in-snowflake-using-soda-a-complete-guide-232b7da5a3c1

?? https://www.youtube.com/watch?v=6p5gnccM9pw

?? https://mike-outcomesec.medium.com/azure-tri-secret-secure-byok-external-stage-service-endpoints-security-model-da0f0225f9d5

?? https://github.com/sfc-gh-tspann/cortex_analyst_hol/blob/main/NOTEBOOK_CORTEX_ANALYST/notebook_app.ipynb

?? https://www.snowflake.com/en/news/press-releases/sam-altman-to-keynote-seventh-annual-snowflake-summit/

?? https://medium.com/snowflake/whats-new-with-snowflake-dynamic-tables-b8826cb0d4c1

?? https://medium.com/snowflake/transforming-business-search-with-ai-how-markaaz-and-snowflakes-cortex-search-enhance-speed-b532d81f93fe

?? https://github.com/michaelgorkow/snowflake_cortex_agents_demo

?? https://www.dhirubhai.net/posts/deleatanda_while-the-world-was-busy-with-the-launch-activity-7298724395668111360-gfkZ/?utm_source=share&utm_medium=member_ios&rcm=ACoAAAAE8G0BI4WdoF-RuQ779lO5QtQPBBvLWCM

?? https://www.youtube.com/watch?v=uPnv_O7w3uM

?? https://github.com/yshavit/mdq

?? https://docs.redpanda.com/redpanda-connect/components/outputs/snowflake_streaming/

?? Java - WASM https://chicory.dev/

?? https://www.meetup.com/pro/snowflake-user-groups/

?? https://github.com/akmalsoliev/Validoopsie

?? https://github.com/Snowflake-Labs/sfguide-data-crawler/tree/f61c1131b5fa28dc222126acf96daa03f33e4baf

?? https://github.com/Snowflake-Labs/Arctic_Agentic_RAG/tree/main/projects/ambiguous_qa

?? https://github.com/Snowflake-Labs/Arctic_Agentic_RAG

?? https://medium.com/snowflake/leveraging-snowflakes-cortex-ai-for-enhanced-data-awareness-at-clearwater-analytics-d91d5e83ddd6

?? https://github.com/jklahr/snowflake_fun/blob/main/ai_powered_query_profile.ipynb

?? https://community.snowflake.com/s/article/Caching-in-the-Snowflake-Cloud-Data-Platform

?? https://unstract.com/blog/process-unstructured-data-with-unstract-snowflake/

?? https://docs.ultralytics.com/guides/nvidia-jetson/#what-is-nvidia-jetson

?? https://www.dhirubhai.net/pulse/three-things-i-learned-from-customer-conversations-davos-ramaswamy-iklcc/

?? https://github.com/rrprasan/Finance/tree/main/Snowflake/Notebooks/Miscellaneous_Topics/2024_SQL_New_Features

?? https://github.com/landing-ai/landingai-python?tab=readme-ov-file

?? https://select.dev/posts/snowflake-slack-alerts

?? https://medium.com/@scottteal/tutorial-how-to-integrate-trino-and-snowflakes-service-for-apache-polaris-49ac5e25b389

?? https://cloudyard.in/2025/01/schema-evolution-with-case-sensitivity-handling-in-snowflake/

?? https://medium.com/@sahil_singla/how-to-not-run-a-12-000-query-on-snowflake-b80c456b790c

?? https://www.youtube.com/watch?v=PZdVSISXdqM&list=PLqRma1oIkcWgN9agdJ0DQhX2gPf8K2ynk

?? https://github.com/Snowflake-Labs/sfguide-getting-started-with-cortex-agents

?? https://github.com/mufeedvh/code2prompt

?? https://www.dhirubhai.net/posts/snowflake-computing_1-million-strong-from-sharing-insights-activity-7295855409779593216-2QbZ/?utm_source=share&utm_medium=member_ios

?? https://medium.com/snowflake/transform-your-addresses-in-snowflake-with-the-precisely-geo-addressing-native-app-9d23e891a95a

?? https://github.com/lewj85/jessesort

?? https://github.com/DavidXanatos/TaskExplorer

?? https://github.com/Goldziher/kreuzberg

?? If you are in Manhattan, check this cafe out. super cool. https://www.os-nyc.com/

?? Decentralized AI Agent Alliance https://medium.com/quantum-economics/why-we-started-the-decentralized-ai-agent-alliance-6eb0938d7bc5

?? RedPanda Connect to Snowflake is 2X faster. https://www.redpanda.com/blog/fast-simple-data-ingestion-snowflake-connector

New Models

?? https://huggingface.co/Qwen/QwQ-32B-Preview

?? https://huggingface.co/microsoft/Phi-4-multimodal-instruct

?? Snowflake Arctic Instruct

?? Deepseek

?? https://github.com/plexe-ai/smolmodels

Upcoming

????? Data for Breakfast Demo: Real-Time Business Intelligence with Snowflake ?????

• https://www.snowflake.com/events/data-for-breakfast/new-york/
• https://www.snowflake.com/events/data-for-breakfast/princeton/

?? March 20, 2025 - NYC - https://lu.ma/0av3pvoa?tk=egFNoK

?? April 29, 2025 - Virtual - Snowflake Data Engineer Connect

?? May 14, 2025 - Boston - https://www.dbta.com/DataSummit/2025/default.aspx

https://sessionize.com/tspann

https://github.com/timothyspann

Tip

conf/bootstrap.conf

https://community.snowflake.com/s/article/JDBC-Driver-Compatibility-Issue-With-JDK-16-and-Later 

java.arg.20=--add-opens=java.base/java.nio=ALL-UNNAME 

java.arg.21=--add-opens=java.base/jdk.internal.access=ALL-UNNAMED        

Recent Tim Stuff

?? Video IoT ?? Dec 19: Conf42 IoT 2024: Virtual: https://www.conf42.com/Internet_of_Things_IoT_2024_Tim_Spann_opensource_build ?? Unstructured Data and LLM: What, Why and How with Timothy Spann ?? Conf42 IoT Building IoT ?? XTremePython 2024 - LLM ?? PyData NYC ?? Advanced RAG Techniques @ All Things Open Raleigh 2024 ?? Building Real Time LLM Models ?? Big Data Conference EU Talk on Open Source Real-Time AI ?? CloudX AI Real-Time

? 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack (AI + Vectors + LLM + Streaming + IoT)