Posts by Chad Upjohn
Databricks Delta Live Tables: Automated Testing
Databricks Delta Live Tables: Automated Testing On one data project that was for reporting sla’s to a partner company, an analyst misreported an SLA due to swapping the `<` with `>`. Because the comparison function should have been “less than”, the report showed always “meets SLA”. It was a simple mistake that reviewers overlooked. Also,…
Read MoreLLM for Database Model Descriptors
LLM for Database Model Descriptors Writing documentation of data models is the least fun task in engineering. It nonetheless has huge value to those making use of the data. Good human readable documentation of a database and its tables makes life easier for data analysts and data scientists. LLM’s can help to remove some of…
Read More