In this paper, for extensive application of consensus problem with mutli-agent systems in practice, a consensus problem of second order multi-agent systems with switching topologies as well as non-uniform time delays is considered. Based on inequality technique and algebraic graph theory, the sufficient condition for stationary consensus is obtained, which are independent of the sizes of delays. Finally, an example is used to show the validity of the result.