When you initially set up a TFS server, you may add a Team Project Collection for testing purposes. After you have confirmed TFS, SharePoint, and Reporting services are all working, you want to remove the test collection you made, but alas, there is no Delete option for project collections.
Figure: There is no way to delete the Team Project Collection from the TFS Administration console
To delete the unwanted Team Project Collection:
cd "%programfiles%\microsoft team foundation server 2010\tools"
TFSConfig Collection /delete /collectionName:[COLLECTION NAME]
Figure: Use the TFSConfig tool to delete a Team Project Collection (If you created a SharePoint Portal for your Team Project Collection, you should clean it up as well)
If you created a Reports site for your Team Project Collection, you should clean it up as well.
Now your TFS server is nice and clean and fit for production.