Can I eat ice cream or small amounts of candy while on a diet?

Thats the question, can I? Like today was a hot day, I ate a 170 calorie ice cream bar, and a 60 calorie Popsicle. Thats it for the day, no more sweets, but can I eat them once in a while?