Is organaic food bad for the environment?

Before everybody thinks I'm a schmuck, hear me out. I have talked to farmers who explained to me that if they don't use pesticides and chemicals they only grow a fraction of what they currently do. So, that got me thinking.... if all food was grown 100% organically, wouldn't the land needed to grow the same amount as we need destroy many times more?