Failure in web scraping by Beautiful Soup

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Thread Modes

Failure in web scraping by Beautiful Soup

metulburr
The Castle of aaarrrrggh
Administrators

Posts: 5,150

Threads: 396

Joined: Sep 2016

Reputation: 170

Mar-17-2019, 10:18 AM

based on this

Quote:GenericErrorMessageCookies="Cookies must be enabled in order to view this page.";

I would suggest that your program is not using cookies.

(Mar-17-2019, 08:16 AM)yeungcase Wrote: I did check my browser setting and cookies are enabled.

Your browser settings has nothing to do with requests in python as that is what is sending the request data. Are you sending the cookie via requests module?

Show us your code.

Recommended Tutorials:

Find

Messages In This Thread

Failure in web scraping by Beautiful Soup - by yeungcase - Mar-17-2019, 08:16 AM

RE: Failure in web scraping by Beautiful Soup - by metulburr - Mar-17-2019, 10:18 AM

RE: Failure in web scraping by Beautiful Soup - by yeungcase - Mar-19-2019, 01:04 PM

RE: Failure in web scraping by Beautiful Soup - by yeungcase - Mar-23-2019, 06:49 AM

RE: Failure in web scraping by Beautiful Soup - by metulburr - Mar-23-2019, 12:36 PM

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	Soup('A')	new_coder_231013	6	2,625	Aug-12-2023, 10:55 AM Last Post: Pubfonts
	Beautiful Soup - access a rating value in a class	KatMac	1	3,499	Apr-16-2021, 01:27 PM Last Post: snippsat
	Beginner web scraping/Beautiful Soup help	7ken8	2	2,666	Jan-28-2021, 04:26 PM Last Post: 7ken8
	Help: Beautiful Soup - Parsing HTML table	ironfelix717	2	2,737	Oct-01-2020, 02:19 PM Last Post: snippsat
	Beautiful Soup (suddenly) doesn't get full webpage html	j.crater	8	17,207	Jul-11-2020, 04:31 PM Last Post: j.crater
	Requests-HTML vs Beautiful Soup - How to Choose?	robin73	0	3,856	Jun-23-2020, 02:53 PM Last Post: robin73
	looking for direction - scrappy, crawler, beautiful soup	Sly_Corn	2	2,490	Mar-17-2020, 03:17 PM Last Post: Sly_Corn
	Beautiful soup truncates results	jonesjoz	4	3,970	Mar-09-2020, 06:04 PM Last Post: jonesjoz
	Beautiful soup and tags	starter_student	11	6,263	Jul-08-2019, 03:41 PM Last Post: starter_student
	Beautiful Soup find_all()	kirito85	2	3,415	Jun-14-2019, 02:17 AM Last Post: kirito85

Users browsing this thread: 2 Guest(s)

View a Printable Version

Failure in web scraping by Beautiful Soup

User Panel Messages

Announcements