Noise Restrictions - acceptable hours for building works

[Jane]

Can someone enlighten me as to noise restrictions as regards building activity at weekends? We are currently renovating/converting two properties into one and, until today have received no complaints from our neighbours. We are employing French plumbers and a French electrician who work 9:00-12:00 & 14:00-18:00 Monday-Friday which seems to be the norm. However, our Moroccan builder can normally only work Saturdays, as he indeed did today. We have always tried to keep noise to a minimum (especially between 12:00-14:00) and today he was merely laying floor tiles in our new kitchen which is hardly an activity that creates environmental noise pollution! However when I was innocently on my way to the Boulanger way for the proverbial Baguette I was both physically and verbally abused by a French neighbour for having building work done on a Saturday plus a stream of invectives as regards Les Anglais in general. From what I have read noise restrictions as regards Saturdays are the same as Monday-Friday - am I correct in this?

Similar thing has just happened to our son in La Trimouille. He is replacing a roof and building dormer windows, for which he has got permission. A few days ago a man who lives near by kept walking past our son's house, until eventually he asked our son if he spoke French. Our son said he did, a bit, so the man then tore into him. He basically told him he doesn't like the English, for reasons. He said he has reported him to the Mairie, and possibly the police, for working through lunch time. We had no idea that you couldn't work through lunch time on your own property. Is this true? 
The noise our son was making was not great, at this point. He was actually just removing tiles. 
When told that he was hated for being English, our son just replied, in French, that 'That's a shame, because I love the French'   
The actual neighbours to the house he is working on are lovely and no one else has complained.