Let $K$ be a (commutative) locally compact hypergroup with a left Haar measure and $L^1(K)$ be the hypergroup algebra of $K$. In this paper we show that the topological (algebraic) center of the Banach algebra $L^1(K)^{**}$ is $L^1(K)$.