Vwwxrf

How to generate globally unique ids for different tables of the same database?

How is the Swiss post e-voting system supposed to work, and how was it wrong?

Dot in front of file

Do I need life insurance if I can cover my own funeral costs?

When do we add an hyphen (-) to a complex adjective word?

Make a transparent 448*448 image

Possible Leak In Concrete

Is having access to past exams cheating and, if yes, could it be proven just by a good grade?

Where is the 1/8 CR apprentice in Volo's Guide to Monsters?

Employee lack of ownership

RegionDifference for Cylinder and Cuboid

Pinhole Camera with Instant Film

How to make healing in an exploration game interesting

Why is "das Weib" grammatically neuter?

What has been your most complicated TikZ drawing?

Provisioning profile doesn't include the application-identifier and keychain-access-groups entitlements

Meaning of "SEVERA INDEOVI VAS" from 3rd Century slab

Is it normal that my co-workers at a fitness company criticize my food choices?

Life insurance that covers only simultaneous/dual deaths

Why do passenger jet manufacturers design their planes with stall prevention systems?

Happy pi day, everyone!

Why using two cd commands in bash script does not execute the second command

Replacing Windows 7 security updates with anti-virus?

What is IP squat space

Scraper to grab a Stack Overflow profile name

Stack Overflow user info fetcherStack Overflow tab notifier user-scriptAmazon web scraperOOP Web scraper using regex to grab tag contentsCross-posts from Stack Overflow to CRBeginner Python OOP web scraperWeb scraper for harvesting a full-sitePython + selenium scraper to grab results using reverse searchStack Overflow Tag UsagePython yelp scraper

3

1

$begingroup$

I've created a script in Python to log into stackoverflow.com using credentials and fetch the profilename once logged in. I've tried to do it using class. I created the methods within that class in such a way so that they work like chain. Should I stick to this design or there is anything better I can pursue? Whatever it is I would like this get_profile() method to be seperated like how it is now.

from bs4 import BeautifulSoup
import requests

class StackOverflowBot(object):

 login_url = "https://stackoverflow.com/users/login?ssrc=head&returnurl=https%3a%2f%2fstackoverflow.com%2f"

 def __init__(self,session,username,password):
 self.session = session
 self.username = username
 self.password = password
 self.login(self.session,self.username,self.password)

 def login(self,session,username,password):
 session.headers['User-Agent'] = 'Mozilla/5.0'
 req = session.get(self.login_url)
 soup = BeautifulSoup(req.text, "lxml")
 payload = 
 "fkey": soup.select_one("[name='fkey']")["value"],
 "email": username,
 "password": password,
 
 req = session.post(self.login_url,data=payload)
 return self.get_profile(req.text)

 def get_profile(self,htmlcontent):
 soup = BeautifulSoup(htmlcontent,"lxml")
 item = soup.select_one("[class^='gravatar-wrapper-']").get('title')
 print(item)

if __name__ == '__main__':
 with requests.Session() as session:
 StackOverflowBot(session,"username","password")

python python-3.x object-oriented web-scraping stackexchange

share|improve this question

edited 4 mins ago

200_success

130k17153419

asked 10 hours ago

MITHUMITHU

340111

$endgroup$

add a comment | 

3

1

$begingroup$

I've created a script in Python to log into stackoverflow.com using credentials and fetch the profilename once logged in. I've tried to do it using class. I created the methods within that class in such a way so that they work like chain. Should I stick to this design or there is anything better I can pursue? Whatever it is I would like this get_profile() method to be seperated like how it is now.

from bs4 import BeautifulSoup
import requests

class StackOverflowBot(object):

 login_url = "https://stackoverflow.com/users/login?ssrc=head&returnurl=https%3a%2f%2fstackoverflow.com%2f"

 def __init__(self,session,username,password):
 self.session = session
 self.username = username
 self.password = password
 self.login(self.session,self.username,self.password)

 def login(self,session,username,password):
 session.headers['User-Agent'] = 'Mozilla/5.0'
 req = session.get(self.login_url)
 soup = BeautifulSoup(req.text, "lxml")
 payload = 
 "fkey": soup.select_one("[name='fkey']")["value"],
 "email": username,
 "password": password,
 
 req = session.post(self.login_url,data=payload)
 return self.get_profile(req.text)

 def get_profile(self,htmlcontent):
 soup = BeautifulSoup(htmlcontent,"lxml")
 item = soup.select_one("[class^='gravatar-wrapper-']").get('title')
 print(item)

if __name__ == '__main__':
 with requests.Session() as session:
 StackOverflowBot(session,"username","password")

python python-3.x object-oriented web-scraping stackexchange

share|improve this question

edited 4 mins ago

200_success

130k17153419

asked 10 hours ago

MITHUMITHU

340111

$endgroup$

add a comment | 

$begingroup$

I've created a script in Python to log into stackoverflow.com using credentials and fetch the profilename once logged in. I've tried to do it using class. I created the methods within that class in such a way so that they work like chain. Should I stick to this design or there is anything better I can pursue? Whatever it is I would like this get_profile() method to be seperated like how it is now.

from bs4 import BeautifulSoup
import requests

class StackOverflowBot(object):

 login_url = "https://stackoverflow.com/users/login?ssrc=head&returnurl=https%3a%2f%2fstackoverflow.com%2f"

 def __init__(self,session,username,password):
 self.session = session
 self.username = username
 self.password = password
 self.login(self.session,self.username,self.password)

 def login(self,session,username,password):
 session.headers['User-Agent'] = 'Mozilla/5.0'
 req = session.get(self.login_url)
 soup = BeautifulSoup(req.text, "lxml")
 payload = 
 "fkey": soup.select_one("[name='fkey']")["value"],
 "email": username,
 "password": password,
 
 req = session.post(self.login_url,data=payload)
 return self.get_profile(req.text)

 def get_profile(self,htmlcontent):
 soup = BeautifulSoup(htmlcontent,"lxml")
 item = soup.select_one("[class^='gravatar-wrapper-']").get('title')
 print(item)

if __name__ == '__main__':
 with requests.Session() as session:
 StackOverflowBot(session,"username","password")

python python-3.x object-oriented web-scraping stackexchange

share|improve this question

edited 4 mins ago

200_success

130k17153419

asked 10 hours ago

MITHUMITHU

340111

$endgroup$

from bs4 import BeautifulSoup
import requests

class StackOverflowBot(object):

 login_url = "https://stackoverflow.com/users/login?ssrc=head&returnurl=https%3a%2f%2fstackoverflow.com%2f"

 def __init__(self,session,username,password):
 self.session = session
 self.username = username
 self.password = password
 self.login(self.session,self.username,self.password)

 def login(self,session,username,password):
 session.headers['User-Agent'] = 'Mozilla/5.0'
 req = session.get(self.login_url)
 soup = BeautifulSoup(req.text, "lxml")
 payload = 
 "fkey": soup.select_one("[name='fkey']")["value"],
 "email": username,
 "password": password,
 
 req = session.post(self.login_url,data=payload)
 return self.get_profile(req.text)

 def get_profile(self,htmlcontent):
 soup = BeautifulSoup(htmlcontent,"lxml")
 item = soup.select_one("[class^='gravatar-wrapper-']").get('title')
 print(item)

if __name__ == '__main__':
 with requests.Session() as session:
 StackOverflowBot(session,"username","password")

share|improve this question

edited 4 mins ago

200_success

130k17153419

asked 10 hours ago

MITHUMITHU

340111

share|improve this question

edited 4 mins ago

200_success

130k17153419

asked 10 hours ago

MITHUMITHU

340111

edited 4 mins ago

200_success

130k17153419

edited 4 mins ago

200_success

130k17153419

asked 10 hours ago

MITHUMITHU

340111

asked 10 hours ago

MITHUMITHU

340111