In this article, we present a spectral element method for numerical solution of linear Volterra integro-differential equations with boundary conditions. First, we obtain discrete form of the problem using the spectral element method. We use the Legendre polynomials for interpolation. Also, the error analysis of the method is considered. Furthermore, the efficiency of the proposed method will be considered through numerical examples.