Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update gscholar.py, now it can filter start year and end year, also added set_cookie from response to cookie requests also added a delay option for requesting. #44

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

amirz7676
Copy link

@amirz7676 amirz7676 commented Sep 3, 2022

now it can filter data by start year and end year, also added set_cookie from response to cookie requests also added a delay option for requesting (for not getting banned).

@venthur
Copy link
Owner

venthur commented Oct 4, 2022

Hi, I've used the idea of using set-cookie in the hope it helps a bit with google blocking requests from gscholar. Did you run some experiments that showed that it works better?

What about the other changes in this PR, do they improve the situation from being temporarily blocked by google?

@amirz7676
Copy link
Author

amirz7676 commented Oct 11, 2022

Hi there, yes it worked better in my experiments, and it'll be working longer. But not too long!.
I've found a repo named 'scholar.py' it works better, i have updated it's code, currently I'm working on some way to pass google captcha manually, it works in my experiments, after debugging I'll update it to my github.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants