This paper compares the statement ‘Mathematics is the study of structure’ with the actual practice of mathematics. We present two examples from contemporary mathematical practice where the notion of structure plays different roles. In the first case a structure is defined over a certain set. It is argued firstly that this set may not be regarded as a structure and secondly that what is important to mathematical practice is the relation that exists between the structure and the set. In the second case, from algebraic topology, one point is that an object can be a place in different structures. Which structure one chooses to place the object in depends on what one wishes to do with it. Overall the paper argues that mathematics certainly deals with structures, but that structures may not be all there is to mathematics. I wish to thank Colin McLarty as well as the anonymous referees for helpful comments on earlier versions of this paper.