Small camping gaz bottles appear to be allowed (see second item in 'allowed' list) but large propane tanks are not, unless secured in a caravan or motorhome.
As with all French regulations, the law is harsh but the application of it is generally reasonable. That is of course unless you take the pi** or you upset an official, in which case they throw the book at you with knobs on.
