Parking spaces opposite our homes

In front of our homes we have a row of parking spaces. These weren't allocated to any of the residents who live on Dimson Crescent, Bow, London. A man, whom doesn't even live on our street, visits our area a lot and he gets extremely unpleasant when he can't find parking. Once there was a car parked in the parking spot in front of our house and he asked my mother who happened to be in the garden at that time if that was our car and she said no and he said "I swear to God if that's your car, I will smash it". He drove off after threatening us. Another time, there was a tiny space and he tried to squeeze his huge car in but failed to do so and left. Today this man purposely took up two car spaces and is preventing residents to park. This man seems extremely dangerous and we are afraid to take any direct action against him. This man is very unpleasant and most of us do not feel safe knowing that he visits our area a few times a week for the past 3 months. Our solution is to only allow parking with permit. This would prevent a lot of non-residents from parking and keep our area safe.