Can I tell my dealer I would withdraw my can loan application?

I bought a new car. All the conversation with that dealer is based on the umption that I would apply for car loan from THEIR bank. I drove my car back home and he called me back two days later and told me their bank turned my loan application down. After that, he used my personal info to apply loan from several other banks. Do they have authorization to do that without letting me know?