Lead AI Engineer · Writing since 2016

Hi, I'm Sina. I build and train AI systems.

Lead AI Engineer. I write about reinforcement learning, transformers, multi-agent systems, and the tools I build along the way.

Explore by topic

Latest writing

Full archive →
·3 min·Deep RL with Unity 3/3

DDPG on Reacher: Twenty Arms Chasing a Balloon

Solving Unity's Reacher with DDPG: twenty robot arms sharing one replay buffer, the actor-critic setup, and why it trained so much easier than Tennis.

·3 min·Deep RL with Unity 2/3

Two DDPG Agents Learning to Play Tennis

Two DDPG agents learning to rally in Unity's Tennis environment: continuous actions, sparse shared rewards, what didn't work, and the settings that solved it.

·2 min·Deep RL with Unity 1/3

Training a DQN Agent to Collect Bananas in Unity

Training a DQN agent on Unity's Banana Collector: the Q-network, replay buffer and target network settings, and how it solved the task (+13 over 100 episodes).

·2 min·Learn SSH 3/3

Learn SSH: Config File

Use the ~/.ssh/config file to connect to servers by name, with identity files, multiple hosts, ProxyJump through a jump server, and wildcard patterns.

·2 min·Learn SSH 2/3

Learn SSH: CLI Commands

The SSH commands I use most: connecting with a key or custom port, local and remote port forwarding, jump hosts with -J, and a SOCKS proxy with -D.

Read in order

Series

Multi-part guides that build on each other, start to finish.

From the archive

All 15 posts by year →

New posts, no noise.

Subscribe to the RSS feed, or follow along on GitHub, LinkedIn and the RL Factory YouTube channel.