no, they DON'T have a right to ask you where you are going, that's you're 4th Amendment rights
The other video clearly shows search and seizure that broke his 4th amendment rights. In the other case, he felt he was NOT free to go (as would anyone else in the situation), so it was a seizure.