Posts by Chad Upjohn
Enhancing Roofing Sales with RAG and LLM: A Practical Approach
Scenario A consulting CTO collaborating with a roofing company proposed using a Retrieval-Augmented Generation (RAG) approach powered by a Large Language Model (LLM) to enhance the sales process. The goal is to engage potential customers, build trust, and connect them with sales representatives as warm leads. Solution The proposed solution involves deploying an LLM-driven chatbot…
Read MoreDelta Lake without Databricks
Scenario Databricks is a great tool for big data. It manages the environment to create tables in delta lake format. Databricks launches a spark cluster in which devs run pyspark that creates the tables and appends to them. What if appending to a delta lake table could be done in a cheaper environment than a…
Read MorePoetry Plugin: make AWS SAM work with python’s poetry
AWS creates good tools to work with its resources. The tool SAM, Serverless Application Model, takes your python code, packages it up and deploys to AWS lambda. It is similar to other tools like Serverless Framework. It simplifies the process to get your code into a lambda and also manages the configuration. There are limitations,…
Read MoreDatabricks Delta Live Tables: Automated Testing
Databricks Delta Live Tables: Automated Testing On one data project that was for reporting sla’s to a partner company, an analyst misreported an SLA due to swapping the `<` with `>`. Because the comparison function should have been “less than”, the report showed always “meets SLA”. It was a simple mistake that reviewers overlooked. Also,…
Read MoreLLM for Database Model Descriptors
LLM for Database Model Descriptors Writing documentation of data models is the least fun task in engineering. It nonetheless has huge value to those making use of the data. Good human readable documentation of a database and its tables makes life easier for data analysts and data scientists. LLM’s can help to remove some of…
Read More