Check your local connection (Ethernet or WiFi) internet connection if you are streaming as that maybe the real issue.
If you live in a dense area its likely someone is stepping on your WiFi band if you are using WiFi to connect the Apple TV to your Internet Router. If you are using wired Ethernet connection then it could be an ISP issue.
If you have a Mac give this app a try: [https://itunes.apple.com/us/app/wifi-explorer/id494803304?mt=12|WiFi Explorer] it will allow you to see the bands that you and the others around you are using.