Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Automation/Scraping
#1
Hello All,
I've just joined this forum, had a quick look around and seems like a good place to be for someone like myself who's just starting out.

I was wondering if I might be able to get some ideas from your good selves on a work project I've been given.

We have an internal OSS site that we use for searching customer accounts, products/services purchased, address, contact details, etc.
I've been searching online for a way to pull all records of customers who have a certain product type.

So normally, we have to search the site using a product ref number.
But I need a way to scrape all customer data from the site to generate a list of all customers on record that have product type 'A', or 'B', etc.
Alternatively, perhaps there's a way to pull all existing customer records to a massive spreadsheet and then I can manipulate the data from there.
I don't have access to the back-end database unfortunately, so I need to be able to pull all data from the OSS site.

I know I'm guilty of being very vague here, I appreciate that, so I'm only really looking for general guide lines or concepts of how to do this (any libraries that can do this for instance?)

Any help or tips would be highly appreciated.
Reply
#2
suggest you start with scraping tutorials, two excellent one by snippsat here:
Web scraping Part1
Web scraping Part2
Reply


Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020