PastebinScrapy - Flask application for scraping latest scrapes from Pastebin

April 8, 2020
(125 views)

This is a Web Scraping application built on Flask. This web application utilizes Pastebin Scraping API and scrapes IOCs including IP addresses, domains, hashes, and emails from the latest pastes of Pastebin. It uses Elasticsearch as the database to store the pastes and Kibana is used for visualizing data from Elasticsearch.

Prerequisites

  • Python
  • Flask
  • Requests
  • Elasticsearch 5.6
  • BeautifulSoup
  • Kibana

Usage

  • Enter your Pastebing Scraping API key and Flask secret key in the code
  • Run the PastebinScrapy.py file
  • Open 127.0.0.1:5000 in any browser
  • Open 127.0.0.1:5601 in any browser to see the Kibana dashboard

Screenshots


More: https://github.com/apurvsinghgautam/PastebinScrapy

(125 views)
(125 views)

Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments
© HAKIN9 MEDIA SP. Z O.O. SP. K. 2023
What certifications or qualifications do you hold?
Max. file size: 150 MB.

What level of experience should the ideal candidate have?
What certifications or qualifications are preferred?

Download Free eBook

Step 1 of 4

Name(Required)

We’re committed to your privacy. Hakin9 uses the information you provide to us to contact you about our relevant content, products, and services. You may unsubscribe from these communications at any time. For more information, check out our Privacy Policy.