In this work, we obtain a quantitative estimate of unique continuation and an observability inequality for the diffusion equation with Neumann boundary condition. We analyze the observability problem with distributed controls (supported on a small open subset). The proof of our results is based on Carleman commutator estimates and the Generalized Hardy inequality.