Pager buttons shown if there is only one page

I've got a playlist generated by a view that I've told to display all items, thus I've got one page. Still, the Next page button appears and pretends like it's doing something. (When I click it, the playlist stays the same. but the Previous page button appears and I can page through duplicate page lists.) The pager buttons should not appear when there is only one page.