Skip to content

Rapid analysis of scientific papers from bioRxiv and PubMed

Notifications You must be signed in to change notification settings

OldBonhart/EDA-NLP-PubMed-and-bioRxiv

Repository files navigation

EDA-NLP-PubMed-and-bioRxiv

Rapid analysis of scientific papers from bioRxiv and PubMed

This repository contains the source code for asynchronously scraping science papers from the bioRxiv and PubMed, for subsequent conversion of this data into word embeddings Word2Vec for semantic and syntactic similarity words from this data, relations with other words, etc., followed by visualization of hight-dimensional Word2Vec word embeddings using t-SNE.

Expected Input - links to an articles of the format:

Pubmed

bioRxiv

Expected Output - images with visualization and scraped data recorded in PDF format.

Quick start

demo.ipynb
EDA-NLP-PubMed-and-bioRxiv.ipynb

Examples

Connectome

PubMed - https://www.ncbi.nlm.nih.gov/pubmed/?term=connectome

Foo

2,372 Results.

bioRxiv - https://www.biorxiv.org/search/Connectome

Foo

4568 Results.

            PubMed                                  bioRxiv

                        Words Cloud

                        Similar Words

Coronavirus 2019-nCoV

42 Results.

PubMed - https://www.ncbi.nlm.nih.gov/pubmed/?term=coronavirus+2019-nCoV

Foo

bioRxiv - https://www.biorxiv.org/search/coronavirus%252B2019-nCoV

Foo

72 Results.

            PubMed                                  bioRxiv

                        Words Cloud

                        Similar Words

Schizophrenia

PubMed - https://www.ncbi.nlm.nih.gov/pubmed/?term=Schizophrenia

Foo

5,000 out of 141,489 Results.

bioRxiv - https://www.biorxiv.org/search/Schizophrenia

Foo

4,102 Results.

            PubMed                                  bioRxiv

                        Words Cloud

                        Similar Words

Raspberry Pi

PubMed - https://www.ncbi.nlm.nih.gov/pubmed/?term=raspberry+pi

Foo

143 Results.

bioRxiv - https://www.biorxiv.org/search/raspberry%252Bpi

Foo

184 Results.

            PubMed                                  bioRxiv

                        Words Cloud

                        Similar Words

Electroactive Polymers

PubMed - https://www.ncbi.nlm.nih.gov/pubmed/?term=Electroactive+Polymers

Foo

860 Results.

bioRxiv - https://www.biorxiv.org/search/Electroactive%252BPolymers%252B

Foo

13 Results.

            PubMed                                  bioRxiv

                        Words Cloud

                        Similar Words