I am lucky enough to have a flint hand axe that is many thousands of years old. It is a long way from being a museum-grade specimen and holds litte value. Today I sat in the sunshine and used it to...

I trained another 2B parameter LLM from scratch today. Am running SFT now, but I am excited that the base eval shows I have noticably improved on the last run on a number of key benchmarks: Here i...

After a couple of days of experimenting, I’ve finally got semantic search deployed and working on a test build. It was remarkably easy in the end. I started by section/paragraph chunking the decis...

I had a lovely couple of days away on the South Coast this weekend for the steam gala on the Swanage Railway. It was amusing how people defaulted to my partner being the train nerd - they were forc...

I am continuing to make good progress on proofreading the FOISA project, to the point that I will soon be in a position to publish. The shadow briefly returned at the weekend, but there is no shad...

I am still well ahead on my sprint plan, so have allowed myself some time to play about with other things. Parish Councils Finally got round to finishing collating a list of all the parish council...

I trained a 2B parameter LLM from scratch today. I named it Trionyx, and rather fittingly, whilst it was training, my partner found a Trionyx fossil whilst looking for sea glass. This is the third...

I spent the morning out enjoying the sunshine. It is always nice to feel the sun return, though it is often a bit of a false awakening at this time of year. There are blackbirds everywhere, which w...

That content moderation can cause trauma is not a mystery by now. The risk factors are well-documented, and most of them arise from the choices that we make long before anyone logs on to open a fil...

I have finished a second pass run through of the challenge tool to check for broken paths and missed nuance. The next step is to bring the reading age down whilst preserving the meaning. It will be...