Introduction

If you like this project, please give it a ⭐Star.

This is a python script that gets all the article meta information (include doi, title, publication etc.) of the author from researchgate for learning and communication.

If you want to import all paper of specific author to your literature management tools(such as zotero), this scrip must be suitable for you. You can get doi or BibTex file easily from researchgate.

How to use?

1. Clone this repository to your computer.

2. Install Python3.10.

3. Install dependencies. pip install -r requirements.txt

4. Configure some information:

   • Download the same version of chromedriver.exe and Chrome.
   • 
   • Unzip chrome and chromedriver to the repository root. Make sure the directory format looks like this. Put the chrome.exe and chromedriver.exe in the chrome and chromedriver directory respectively.

      |—crawlerutils    # crawler script
      | | Article.py
      | | AuthorArtical.py
      | | ...
      |
      | DATA            # export folder
      | config.py       # config file
      | main.py         # Execute functions
      |
      |─chrome          # chrome folder
      |  | ...
      |  | chrome.exe
      |  | ...
      |
      |─chromedriver    # chromedriver folder
      |  | chromedriver.exe
   

5. Open config.py and replace the Url. Execute python script. python run main.py

TODO

• Export in xlsx format
• More fields
• Clean the useless data
• Multithreading
• Export in bib format