Finding a mortgage lender is not hard; they are all over the place. You can work with your local bank if you like, but the best rates that will be offered are those that are offered through online lenders. Those that specialize in mortgage lending only are those that you want to talk to for a great price tag.
Your mortgage lender is someone that you should trust and be able to ask questions to. If you do not feel comfortable with them, do not work with them. It is their job to work with you, to educate you and to insure that you are getting the best possible product from them. It is not all about the bottom line.