Updates Sept 30

PGrid

There was an issue with my self hosted umami instance after migrating my http servers from nginx to caddy. Caddy acts as a reverse proxy to umami. Had to deal with weird CORS errors. Have a trail and error fix that im not sure about but it works.
The ebay scraper has been finding USD listings and I haven’t implemented handling other currencies or shipping so it assumes the listing is AUD. This happened for a popular gpu and I got an email pretty quickly about it. Added a fix to ignore non AUD listings for ebay.

Manually created a json of fujifilm cameras and some attributes about each camera with the help of pasting wikipedia into ai to output json
Created a script that has some rule based parsing of titles to try to extract a camera from the title name if it can. only 60% accurate though so ended up scrapping it and using ai.
Painfully created a json for fujifilm lenses taking data from multiple websites and using ai and screenshots
Parsed about 27k post titles using claude to extract camera and lens info with the prompt giving it all lenses and cameras and about 300 titles which it classified at a time.
Added lens and camera data to PGrid’s database as I will be using PGrids scrapers and utilities to scrape amazon and ebay for camera and lens data. Chose to do this instead of a new DB, hope it doesn’t bite me in the ass in the future. Still have an sqlite database with the same info + reddit post data + embeddings for the photo viewer app which will be used to create content.

Started working on this again to get recording working. Openai released a new version of whisper and I wanted to try getting it running locally. Mac has annoying new permissions to deal with. Had to learn about mac entitlements file and screw around a bit. Voice recording still not working.

Created a new tiktok account posting Micallef Programme sketches. Using it to get a bit more familiar with editing vertical videos on DaVinci Resolve and do experiments with posting like effects of hashtags, descriptions, post cadence. Also I found out about Micallef Programme from someone posting on youtube hopefully more people find out about it through tiktok now. From a brand new 3 day old account with 8 posts, one post has already gone viral with over 100k views.