All Data and AI Weekly
( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data )
#201-04-Aug, 2025
https://bsky.app/profile/paasdev.bsky.social
NiFi + AI + AI Data Cloud + Iceberg.
https://www.reddit.com/r/DataEngineeringForAI/hot/
Monthly NYC and Youtube Events
Code and Open Source Projects
AWS New York Summit
https://github.com/tspannhw/conferences/tree/main/2025/awsny
Hex + Snowflake Hackathon
https://github.com/tspannhw/hackathons/tree/main/2025-07-15
Apache NiFi + AI Agents + Cortex AI + Snowflake AISQL
https://github.com/tspannhw/TrafficAI/tree/main/Agents
https://github.com/tspannhw/transit-ridership
https://github.com/tspannhw/conferences
https://github.com/tspannhw/hackathons/tree/main/2025-07-15
Recent Cool Stuff
Convert your old SQL Server to Snowflake
https://www.snowflake.com/en/migrate-to-the-cloud/snowconvert-ai/
Snowflake LLM and RealWorld
https://medium.com/@snowflake_ai_research/bridging-the-gap-between-llms-and-real-world-challenges-snowflake-at-acl-2025-73d7e4b79466
Cipher
https://github.com/campfirein/cipher
S3 Tables and snowflake with mcp servers
https://blog.dataengineerthings.org/dare-3-connecting-s3-tables-and-snowflake-through-mcp-servers-in-cursor-1f102fa3c01f
Local Apache Icerberg + Apache Polaris + Trino + Minio
https://medium.com/@gilles.philippart/build-a-data-lakehouse-with-apache-iceberg-polaris-trino-minio-349c534ecd98
https://medium.com/@gilles.philippart/build-a-streaming-data-lakehouse-with-apache-flink-kafka-iceberg-and-polaris-473c47e04525
Build an Agentic App Fast in Snowflake
https://quickstarts.snowflake.com/guide/build-agentic-application-in-snowflake/index.html?index=..%2F..index#6
AI Kimi-K2
https://github.com/MoonshotAI/Kimi-K2
GemAO OWASP
https://genai.owasp.org/introduction-genai-security-project/
AI Security Cheat Sheet
https://genai.owasp.org/resource/ai-security-solution-cheat-sheet-q1-2025/
CursorAI 101
https://www.youtube.com/watch?v=o7g_LNV4kW4&t=1s
- Apache Iceberg with Streaming
- An event focused on the integration of Apache Iceberg with streaming technologies.
- Learn more about the topic and relevant documentation here:
- Snowflake Docs: Snowpipe Streaming with Iceberg
- Snowflake Docs: Iceberg Data Types
- Apache Iceberg Spec: Primitive Types
Articles
- AI-Ready Data Products with Snowflake Internal Marketplace
- Read the official Snowflake blog post on creating AI-ready data products using their internal marketplace.
- Read the article here
- User-Based Security for Tasks
- An introduction to user-based security features for tasks within Snowflake.
- Learn about task security here
Demos
- Building a Modern Data Warehouse
- Watch a demo on building a modern data warehouse architecture.
- Watch on YouTube
- Data Pipelining Best Practices
- A video covering best practices for building robust data pipelines.
- Watch on YouTube
Tools
- Visivo.io
- A new tool for data visualization and analysis.
- Check out the tool
MCP (Most Common Pitfalls / Multi-Cloud Platform)
- Snowflake Labs MCP Guide
- The official GitHub repository from Snowflake Labs for MCP.
- View the GitHub repo
- MCP Snowflake Server
- A specific server implementation for MCP, designed for Snowflake.
- View the GitHub repo
- Cortex Agents for MCP
- A guide on using Cortex agents with the MCP framework.
- View the GitHub repo
Upcoming Events, Conferences, Meetups, Webinars and More
Sept 12 – Community over Code – Minneapolis –
https://communityovercode.org/schedule/
Build Nov 4-6
https://www.snowflake.com/en/build/
November 6, 2025 – NODES Conference – Virtual
I will be speaking about Snowflake and Neo4J at their conference.
https://github.com/timothyspann
© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack