How hard is it to re-enter the US from Canada without a passport?
Very difficult. A valid Passport is REQUIRED to enter the US. Immigration is the same as you travel to the US from anywhere else - EU, Korea, Australia, Japan, etc. You may not be allowed to enter the US without a passport.