Posts by Lucas Gándara
My Omarchy Experience So Far
- May 23, 2026
I have to say — I love it.
It’s my first time using a tiling window manager, and yes, it takes some time to get used to. Not that much, but enough to feel the friction. Once you’re past that, you fly.
The Truth About Deep Reinforcement Learning
- Nov 08, 2025
Reinforcement learning is not always exciting. Sometimes you have to face the raw truth of it: most of the time, it won’t work at first. These algorithms have an enormous number of parameters to fine-tune, and the gap between “looks right on paper” and “actually learns” is wide.
I’ve been diving deep into policy gradient methods, specifically implementing the Vanilla Policy Gradient (VPG) algorithm with Generalized Advantage Estimation (GAE-λ). The video below is from one of my training runs.