When you do find small airlines, even if they are listed in a search engine results, it often pays to check the company site which may reveal exclusive online offers not found in a regular search engine. For example, when flying in Western Canada, I found that Hawk Air, a small and local company offers weekly deals on certain days. Be sure to double check!
You're not crazy for thinking that a flight price has changed after searching it a few times in your web browser. Based on the cookies in your browser, flight prices do increase when a particular route is repeatedly searched, as the site wants to scare you into booking the flight quickly before prices get even higher. Always search for flights in incognito or private browsing mode to see the lowest prices.