explore | Grilled Cheese

IP Functions are Generally Available, bringing high-performance network analytics to the Lakehouse
tech_blogs_databricks

#DataEngineering

S3 Tables now support all Iceberg V3 data types.

Deletion vectors replace positional delete files. Deleting 50k rows from a 2B-row table writes one file instead of thousands. Native variant, nanosecond timestamps, geometry types.

#ApacheIceberg #DataEngineering

ift.tt/Jxf1Ahu

Show HN: Strata – an expressive semantic layer that can say no to your LLM
Discussion | hackernews | Author: ajoski9

#DataEngineering

Что такое Enrichment-архитектура (архитектура обогащения данных)

Enrichment-архитектура — это не конкретный стек техно…

Подробнее: https://gruzdevv.ru/stati/enrichment-arhitektura-obogashcheniya-dannyh/

#dataengineering #обогащениеданных #архитектураданных #enrichment #конвейерыданных #IT #SaaS

💼 GitLab is hiring a Staff Software Engineer - NLP
Location: 🇮🇳 Bangalore, India

#DataEngineering #DataEngineeringjob #hiring #techjob #jobs #careers

https://datasciencejobs.com/jobs/staff-backend-engineer-gitlab-india-8/

A data lake gives you cheap, scalable storage.

Apache Iceberg gives that storage memory, structure, time travel, schema evolution, and database-like reliability.

The future of the lakehouse is not more files.

It’s smarter metadata.

#ApacheIceberg #DataEngineering #DataLake

🚀 Ready to Explore Modern Data Engineering? Join the Free Demo!
👉 Trainer Name : Mr. Krishna
✔️ Date : 09/10/2026 @8:00AM IST
🔗 Join Link: bit.ly/4xuHanz
✔️ Meeting ID: 437 535 613404560
✔️ Passcode: Az96q98L
📞 For Details: +91 7032290546

#Visualpath #AgenticAI #DataEngineering #CloudData

🔹 La actualización de #DBT ha convertido a la herramienta en una muy buena opción para cualquier tarea de procesamiento de datos basada en SQL

📌 Accede a la guía completa de novedades y mejoras de DBT 2.0 en 📷 blog.damavis.com/dbt-2-0-guia...

#BigData #databuildtool #DataEngineering

🔹 Ahora, #DBT v2 presenta dos distribuciones y tendrá dos paquetes, dbt-core-v2 y dbt
🔹 Los nuevos artefactos basados en #Parquet permitien una lectura e indexación rápidas

#BigData #databuildtool #DataEngineering

AI agents are moving from simple chat responses to direct action.

They write code, process files, and execute multi-step workflows. PostgreSQL provides the structured, reliable foundation these autonomous systems need.

#PostgreSQL #AIAgents #DataEngineering #Database

Your data, your storage, your rules: a 2026 guide to storing Unity Catalog managed tables
tech_blogs_databricks

#DataEngineering

Silent data drift can undermine AML detection without breaking a pipeline. Here’s how data contracts, validation, lineage, and monitoring can reduce the risk. #dataengineering

Individual systems can all report healthy while the business data is wrong. Here’s how LLM-assisted correlation can shorten incident triage. #dataengineering

Official central-bank exchange rates in Snowflake SQL.

New guide: an external access integration and a Python UDF call the API, and a scheduled TASK refreshes the rates every business day.

www.globalexchangerates.org/use-official... #Snowflake #DataEngineering

Digital Twins for Small Towns and Rural Regions: Data Integration, Simulation and Visualisation Across Three Use Cases in Lower Austria
tech_blogs_arxiv | Author: Thomas Delissen, Lukas Daniel Klausner, Maximilian Lackner, Torsten Priebe, L\H{o}rinc Thurnay

#DataEngineering

Extracting data lineage from Microsoft Fabric Spark notebooks - automatically !

We can get all this information from a Spark Notebook:
• source tables
• target table
• notebook

blog.gbrueckl.at/2026/09/extr...

#MicrosoftFabric #PySpark #Spark #DataEngineering #Lineage