Just before his death, the industrial empire that he had built there began to fall apart, due to competition from other companies, bad luck, his son's lack of interest in the business and the unexpected death of Jean-Baptiste Raymond, whom he had been grooming to take over the operation.