Day 31:

Date: 2024-10-06

Morning Pregame and Introduction

personal context

Will

Happy Sunday. It's my very first Sunday back home in the bay area. Planning to meet with some of the Sunday Hustle guys at Red Rock today. In fact I'm sitting at the coffee shop right now (I'm almost always the first one there). Helps that it's in my back yard. Feeling good, ready to do some cool building today.

daily goals

Will

Today I want to build out some of the UI functionality for one of my work projects, the "AI Citation Helper". This is a tool I'm building for Contoural, in order to assist with the time consuming process of citation verification.

learning focus

Will

I need to learn more deeply about InstantDB, as well as React tan-stack tables.

challenges

Will

It's going to be difficult as always to build out UI. Styling HTML and inline tailwind CSS is always a tar pit. I need to try and focus on functionality.

plan of action

Will

The plan of action is going to be as follows:

  1. Start writing today's blogs. I've been seriously lacking in this habit and need to start out right.
  2. Plan out what requirements I have for the UI.
  3. Brainstorm a high level plan for deciding on and building out the functionality of the AI Citation Helper UI.
  4. Start implementing the UI.
  5. Test with real data.
  6. Integrate the AI pipelines into the UI.
  7. Test end-to-end.

focus level

enthusiasm level

burnout level

leetcode hatred level

Building Citation Helper UI

task reflection summary

Dave

task goal

Will

Actually start experimenting and implementing the AI Citation Helper UI.

task description

Will

task expected difficulty

task planned approach

Will

task progress notes

Will

time spent coding

Will

time spent researching

Will

time spent debugging

Will

output or result

Dave

challenges encountered

Dave

follow up tasks

Dave

reflection successes

Dave

reflection failures

Dave

research questions

Dave

tools used

Dave

Designing Citation Helper UI

task reflection summary

Dave

task goal

Will

I need to decide on a high level description/plan for how I'm going to design the AI Citation Helper UI.

task description

Will

This will mean a lot of explaining, thinking about what requirements I need, weighing different options, and designing at a high level.

task expected difficulty

task planned approach

Will
  1. Describe more deeply what the AI Citation Helper is
  2. Explain some of the requirements
  3. Explain what work I've already done
  4. Start planning furtther implementation of features.

task progress notes

Will

Okay so I need to explain more about the AI Citation Helper. It's a standalone LLM tool I've been building for Contoural. Contoural works with clients to help them understand what legal and regulatory requirements their clients face, and also help them develop plans and processes to be legally compliant with them. One of the most fundamental services Contoural offers is citation work. Citation work is where Contoural will help a client compile a list of citations to legal text, which contain exactly all of the legal and regulatory rules on how their specific data should be saved. It can be a very difficult and time consuming process to determine which citations are relevant to a given client. The AI Citation Helper is a tool used by Contoural to reduce the time and effort needed to determine which citations are relevant to a client's business.

The AI Citation Helper tools is a program that takes in raw citation data from a third party database, as well as settings for a specific client company, and then uses LLMs to classify and clean the raw data. It returns a filtered excel sheet which pre-classifies each citation as being "relevant", "not_relevant", or "further_research_needed". This is important, as the process of verifying "relevant" and "not_relevant" is incredibly fast. The user can focus on the citations which need research, and utilize further LLM tools to assist them in this. In initial testing, this system saves 50% of time. However, currently there is no frontend for a Contoural employee for using it. Right now, I'm manually uploading provided excel sheets and then pushing the button to run the system myself. I need to develop some self-contained application so that I can remove myself from the process entirely.

So there's a couple of requirements for the system which are important. The number one requirement is that it has to be easy to use. I'm going to be sending this to domain experts who aren't as comfortable with highly technical work as I am. However, they are very comfortable with excel and doing massive amounts of work in it. This leads to the next requirement, which is I would like the system to take in excel as input and output excel. This will make it integrate easily with Contoural's existing processes. Another requirement for the system is simplicity. I don't want to simply clone excel and add AI features, I want a more targeted and streamlined application. In this case, there may be very few cases where I actually need EDITING rows to be allowed.

So let's talk about what I've currently built. I've taken some inspiration from my daily blog builder tool and decided to build the frontend using InstantDB and NextJS, while also using a Flask Python backend for AI features. Right now it's in an incredibly simplistic state. It shows a fake "excel" table for a single data set, with some not working features for switching "sheets" by classification.

I want to add functionality to make viewing the different sheets smoother. I'd like to add advanced filtering and sorting capability to the columns. I need to add some fast and easy way of verifying AI output. Speed is key here, Contoural employees are going to be verifying 1000s of rows of AI classifications, as well as using the tool to conduct their own research.

time spent coding

Will
1

time spent researching

Will
4

time spent debugging

Will
1

output or result

Dave

challenges encountered

Dave

follow up tasks

Dave

reflection successes

Dave

reflection failures

Dave

research questions

Dave

tools used

Dave