CS and AI
Lead AI Engineer. I write about reinforcement learning, transformers, multi-agent systems, and the tools I build along the way.
16 posts
Every few months I end up with two copies of the same photo library on two different drives, and I don’t know which files actually differ between them. File Explorer won’t answer that question, and I usually need the answer before I delete one of the copies.
Every coding agent I use keeps its memory in a local folder — .claude/, .cursor/, .agent/. That works until you switch machines, and then the agent has amnesia. The context it built up about your project stays on the laptop where it happened.
Reacher is the environment I had the easiest time with, and the one that taught me the most — because it contradicted what I’d learned on Tennis a year earlier.
If you’ve ever had a folder of papers you meant to read, you know the problem this came out of. I wanted something that would take a PDF and hand me twenty sentences worth reading, so I could decide whether the paper deserved an hour.
After the Banana Collector I moved on to Unity’s Tennis environment, which is harder in two ways. The actions are continuous, so DQN’s trick of taking the max over four actions doesn’t work anymore. And there are two agents, each one sitting inside the other’s environment.
This was the first RL agent I trained end to end. The environment is Unity’s Banana Collector: a square arena full of yellow and blue bananas. Yellow is worth +1, blue is worth −1, and the agent has to work out which is which from a stream of numbers.
In this article series, I will explain how to use a command-line terminal to connect to secure shell (SSH) servers, using the config file for quick access to frequently used servers, and setting up an SSH server on macOS, Ubuntu, or CentOS.
In this article series, I will explain how to use a command-line terminal to connect to secure shell (SSH) servers, using the config file for quick access to frequently used servers, and setting up an SSH server on macOS, Ubuntu, or CentOS.
In this post, I will go through installing Python 3.7 and all its dependencies on CentOS. Unlike Ubuntu, Python is not readily accessible using yum package manager on CentOS. Therefore, we first need to install a few packages before installing Python.
In this article series, I will explain how to use a command-line terminal to connect to secure shell (SSH) servers, using the config file for quick access to frequently used servers, and setting up an SSH server on macOS, Ubuntu, or CentOS.