If you look at data you get back when using Requests and Beautiful Soup.
You will see that's is a big mess,this is because Google search use JavaScript heavily.
You will not find
I have done this task for before i 2-3 year ago for this question then did i used PhantomJS.
Now today is Selenium with Chrome and FireFox web-driver what's used.
Look at Web-scraping part-2.
Under:
Test my old code rewrite to use Selenium,search for
I only post output,give it some effort and try to use these tool yourself.
You will see that's is a big mess,this is because Google search use JavaScript heavily.
You will not find
h3 tag
or title
(only for search word) in output.I have done this task for before i 2-3 year ago for this question then did i used PhantomJS.
Now today is Selenium with Chrome and FireFox web-driver what's used.
Look at Web-scraping part-2.
Under:
Quote:God dammit JavaScript, why do i not get all content
Test my old code rewrite to use Selenium,search for
python forum
I only post output,give it some effort and try to use these tool yourself.
Output:Forums | Python.org
https://www.python.org/community/forums/
---------
Python Forum
https://python-forum.io/
---------
What are some active Python forums for beginners? - Quora
https://www.quora.com/What-are-some-active-Python-forums-fo...
---------
Python for beginner - Python - The freeCodeCamp Forum
https://www.freecodecamp.org/forum/t/python-for.../169628
---------
What are the best Python forums to hang out in? : Python - Reddit
https://www.reddit.com/.../Python/.../what_are_the_best_python_...
---------
Python Forum | Dream.In.Code
https://www.dreamincode.net/forums/forum/29-python/
---------
Python Forum - Youth4work
https://www.youth4work.com › Talent › Python
---------
Python Programming Help Forum | Go4Expert
https://www.go4expert.com › Forums › Programming
---------
Python - Raspberry Pi Forums
https://www.raspberrypi.org/forums/viewforum.php?f=32
---------
Python Discussion Forum | Hackr.io
https://hackr.io/forum/python