Reader small image

You're reading from  R Web Scraping Quick Start Guide

Product typeBook
Published inOct 2018
Reading LevelBeginner
PublisherPackt
ISBN-139781789138733
Edition1st Edition
Languages
Concepts
Right arrow
Author (1)
Olgun Aydin
Olgun Aydin
author image
Olgun Aydin

Olgun Aydin is a PhD candidate at the Department of Statistics at Mimar Sinan University, and is studying deep learning for his thesis. He also works as a data scientist. Olgun is familiar with big data technologies, such as Hadoop and Spark, and is a very big fan of R. He has already published academic papers about the application of statistics, machine learning, and deep learning. He loves statistics, and loves to investigate new methods and share his experience with other people.
Read more about Olgun Aydin

Right arrow

Storing data and creating schedule jobs for web scraping

In this part, we are going to create a free-tier AWS RDS instance and write a script to connect this database by using the RPostgreSQL library. After writing this script, we will create a cronjob that automatizes web scraping and sending data to the database based on the scheduled time.

Creating an AWS RDS Instance

Let's take a look at how to create the PostgreSQL database on AWS. In this section, we will talk about how to create an AWS account and how to create an RDS instance step by step:

  1. First, visit the AWS page by using the following URL: https://aws.amazon.com/
  1. Then click My Account to go to the login screen, as shown in the following screenshot:
AWS...
lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
R Web Scraping Quick Start Guide
Published in: Oct 2018Publisher: PacktISBN-13: 9781789138733

Author (1)

author image
Olgun Aydin

Olgun Aydin is a PhD candidate at the Department of Statistics at Mimar Sinan University, and is studying deep learning for his thesis. He also works as a data scientist. Olgun is familiar with big data technologies, such as Hadoop and Spark, and is a very big fan of R. He has already published academic papers about the application of statistics, machine learning, and deep learning. He loves statistics, and loves to investigate new methods and share his experience with other people.
Read more about Olgun Aydin