If you don't attach it to your wall securely, it might fall, which could end up damaging your drywall and your car. However, this shouldn't scare you into leaving your ladder on the floor ...

as is placing the ladder too far away from the wall. If the extension ladder is leaning against a gutter , make sure it's up above it three feet (and no more) so there is something to grab onto ...