將錯就錯 - One Continuous Mistake

  • Home /
  • 將錯就錯 - One continuous mistake
A simple prompting trick to fix LLM attention fade

A simple prompting trick to fix LLM attention fade

Transformer models under-attend to the middle of long inputs and taper off during long outputs. Here's a simple instruction set that counteracts both.

Read More
Why we trained a DeBERTa classifier to catch AI slop

Why we trained a DeBERTa classifier to catch AI slop

LLMs can't reliably detect their own writing patterns. Here's how we trained a DeBERTa v3 model to do the pattern-matching part of slop detection, and why …

Read More
Building a spaced repetition system for learning Irish tunes

Building a spaced repetition system for learning Irish tunes

How memory science informed a practice tool that cycles through 400+ traditional Irish tunes on a forgetting-curve schedule

Read More
The jig: What makes Irish traditional music feel right?

The jig: What makes Irish traditional music feel right?

Using Python and librosa to analyze what gives Irish jigs their distinctive rhythmic pulse. Spoiler: it's not what I expected.

Read More
Asymptotic Hearts Club

Asymptotic Hearts Club

Taking anglo concertina and irish accordion where it doesn't belong.

Read More
Learning out loud

Learning out loud

Why I'm posting my terrible concertina videos publicly.

Read More

Get new posts via email

Intuit Mailchimp

Copyright 2024-infinity, Paul Pereyda Karayan. Design by Zeon Studio