I'm working on a chatbot, and I need a Python 3 module (or library) for searching the web. I tried
pygoogle, but it gave me just URLs; I tried
xgoogle, but it's a Python 2 module that
2to3 didn't convert correctly; I tried
GoogleScraper, but it gave me a 403. I can scrape Google myself with BeautifulSoup or lxml, but I thought there was probably already a module out there that can do it for me.
- Most importantly, I need a URL, its title, and its description.
- Speed is pretty important. This is in chat, where a bot is not worth using if opening a new tab is just as fast.
It isn't important that I search Google. I tried
pws to search Bing, but the problem was that it threw an error whenever there weren't any related searches.