As the number of agents comprising a swarm increases, individual-agent-based control techniques for collective task completion become computationally intractable. Instead, we develop an algorithm, agnostic to the size of the swarm, to control, in a decentralized and probabilistic manner, a collective property of the swarm: its density distribution constrained with high-level task specifications expressed in temporal logic.