Jihadists in Libya pose a direct threat to Europe, according to France's prime minister who was speaking at a gathering in Madrid.