To delete a collection:
Hover over a collection tile, and click the ellipsis.
From the drop down, click Delete Collection.