@z3usalmighty.bsky.socialThey have been trying to bury the warehouse for twenty years.
The estate underneath is still where the value lives.
Read the guide:
https://www.thedataexperts.us/writing/modernizing-enterprise-data-architecture-snowflake-databricks-guide.html
#DataEngineering
@siva26.bsky.social🚀 TBuild Your Foundation in Snowflake Data Engineering
✔️ Date : 10/10/2026 @8:00AM IST
🔗 Join Link: bit.ly/4z2zsSE
✔️ Meeting ID: 413 488 468379456
✔️ Passcode: gX9Hn7q3
👉 Trainer Name : Mr. Krishna
📞 For Details: +91 7032290546
@convectiveinc.bsky.socialDuckDB's team joined AWS. DuckDB is still MIT licensed, and a nonprofit foundation, not AWS, holds the copyright. The real question is who holds the copyright on every dependency you run. www.convective.com/blog/what-d... #AWS #DataEngineering
@quansight.comZero or null. Mathematically correct or practically useful. Marco Gorelli digs into a real design trade-off between Polars and SQL, and shares an opinion on which one gets it right.
Full talk: buff.ly/L0duaRh
@dmytro-nasyrov.bsky.socialHypothetical: a policy is verified at 08:59. A superseding revision is announced at 09:02. At 09:03, the old evidence is only four minutes old, yet it cannot support current instructions.
A five-minute expiry must not overrule a known change.
@dmytro-nasyrov.bsky.socialFresh RAG evidence needs a decision-specific expiry.
Pharos Production builds agent evaluation sets. Ask which source governs this decision and what change invalidates it.
AI agent development: pharosproduction.com
@hackernoon.comStop pipeline failures at 3 AM. Learn how to build a resilient, event-driven streaming data pipeline from scratch using Python, Kafka, and Airflow. #dataengineering
@rajeshdataai.bsky.social
An audit trail isn't a checkbox. It's a technical requirement that records *why* someone accessed what, *when*, and what changed. That's engineering. 🔍
#HealthTech #ClinicalResearch #DataEngineering
@news.karthihegde.devRelease of Polars 2.0
Discussion | hackernews | Author: simicd
@z3usalmighty.bsky.socialThe dashboard is dying.
The data estate underneath it is not.
Free. No email.
Read the whitepaper free:
https://www.thedataexperts.us/white-papers/modern-data-whitepaper.pdf
#DataEngineering #DataStrategy
@news.karthihegde.devScaling and Operating a Large dbt Project on Databricks: IFCO's Data Team on Performance, Visibility, and Debugging
tech_blogs_databricks
@rajeshdataai.bsky.social
@hackernoon.comLearn how Delta Lake Time Travel saves your pipelines and ML models from 3 AM data disasters. Master historical queries, rollbacks, and data versioning. #dataengineering
@survive-or-die.bsky.socialSCD2 tip: test the exact change boundary. Python/SQLite kit: 9 tests + checklist. £5; educational. #DataEngineering
@pgexperts.bsky.socialAurora PostgreSQL now queries Iceberg and Parquet in S3 through foreign tables, with DuckDB embedded as the execution engine. GA on 17.11 and 18.6 and later, no additional charge.
@powerbitips.bsky.socialNot just asking for a notebook. Tasking an agent to go research a problem and figure out your slowly changing dimensions. Data engineering is due for a big shakeup.
@tmtabor.ioA decade of messy help forum data had effectively turned the vector database into a high-volume noise generator that corrupted the model's reasoning. Reversing this required abandoning traditional token-count chunking for an LLM-driven atomic fact extraction strategy. #DataEngineering
@purplefrogdata.bsky.socialLooking to get more from the Companies House API?
Our latest Frog Blog by Callum Bryant shows how to use Python to filter, enrich and score company data for smarter analysis🐍
📖 www.purplefrogsystems.com/2026/06/part... #Python #DataEngineering
