@purplefrogdata.bsky.socialLooking to get more from the Companies House API?
Our latest Frog Blog by Callum Bryant shows how to use Python to filter, enrich and score company data for smarter analysis🐍
📖 www.purplefrogsystems.com/2026/06/part... #Python #DataEngineering
@nicolauroca.bsky.socialEl historial disponible responde qué pasado podemos recuperar. La coherencia responde si sus piezas pueden usarse juntas. En la cadena de recuperación aceptada son pruebas distintas.
@powerbitips.bsky.socialAn OS ships with a write up the issue skill and it lands differently. Data pipelines need that. Semantic models need that. Users hit a gap and something should write up what's missing.
@news.karthihegde.devUnlocking Data Portability: Preventing Catalog Lock-in with REGISTER and UNREGISTER APIs
tech_blogs_databricks
@hackernoon.comA Glue job silently dropped records from a 6 MB CSV. Strong S3 consistency made the real cause harder to find, not easier. #dataengineering
@rajeshdataai.bsky.social
@nicolauroca.bsky.social¿Quién recibe la alerta cuando su responsable no está?
La frescura del dato no resuelve esa ausencia. En el modelo de la ventana útil, la capacidad de actuar forma parte del compromiso.
@datamechanic.proPython, pandas, Git and testing: what stuck with me
mrneilbryan.substack.com/p/python-pan...
#DataEngineering #Python #pandas #Git #pytest #ContinuousLearning
@news.karthihegde.devArchiving the Oldest Webcam Feed
Discussion | hackernews | Author: rdmuser
@hugovalters.bsky.socialCatch bad CSV data before it hits your pipeline. 156 lines of Python and Pandera, intermediate level. Run: python3 schema_validate.py --csv data.csv --schema schema.py
https://www.valtersit.com/python/csv-schema-validator-with-pandera/
#python #dataengineering #pandera
@powerbitips.bsky.socialA brand new external data source cracks the whole thing open. Live or staged, how you authenticate, whether it's a secret. More moves than a chess game, and plenty of them are bad.
@todaystopainews.bsky.socialThe Data Engineering Professional Certificate is now available on DeepLearning.AI
#technology #news #dataengineering #ai #artificialintelligence
@pjlucidi.bsky.socialToxic PDFs crashing your RAG pipeline? 💥
OpenCrawling now runs Apache Tika 4.1.0 with PipesForkParser process isolation!
• Isolated child JVMs
• 30s watchdog timeouts
• Bounded heaps
• Zero-Trust Zip Slip defense
@siva26.bsky.social🚀 Ready to Explore Modern Data Engineering? Join the Free Demo!
👉 Trainer : Mr. Krishna
✔️ Date : 10/10/2026 @8:00AM IST
🔗 Join Link: bit.ly/4z2zsSE
✔️ ID: 413 488 468379456
✔️ Passcode: gX9Hn7q3
📞 Details: +91 7032290546
#Visualpath #AgenticAI #DataEngineering #CloudData #DataAnalytics
@ideidev.bsky.socialData engineering Miami: production pipelines shipped by senior engineers, no hiring drag. Embedded engineers own ingestion, transformation, orchestration—governed, auditable, production-grade. See how we scope it: https://codeponents.com/?page_id=8581&ref=2&rid=250 #DataEngineering #MiamiTech #Pi...
@news.karthihegde.devData Platforms Are Becoming a Supervision Problem
tech_blogs_acm | Author: Abhilash Rao Mesala
@rezarad.bsky.socialEp. 22, Sidney and I go deep on Medallion Architecture in Fabric
#MicrosoftFabric #PowerBI #MedallionArchitecture #DataEngineering #FabricInsider #DataArchitecture #DataWarehouse #DataLakehouse #DataGovernance #CICD #SemanticModel #DataAnalytics #BusinessIntelligence #RADACAD
@news.karthihegde.devRead Restrictions and Catalog Labels: Unifying governance across engines and catalogs
tech_blogs_databricks
@paradigmasoft.bsky.socialExport, import, diagnose, and automate with VCLI. From SQL dumps to encrypted DB access to Bash/Zsh/PowerShell completion, it’s a command‑line powerhouse for SaaS and ISV engineering teams. valentina-db.com/en/command-l...
#DataEngineering #ISV #SaaS
@news.karthihegde.devCloudflare K2: serverless event streams
Discussion | hackernews | Author: elffjs