Will Ma defines “model-based” to construct independent distributions over time and solve dynamic programming, while “model-free” optimizes over historical trajectories in a black-box fashion.