.
Data collection in big data analytics
Data Collection in Big Data Analytics
- It plays a crucial role .The web offers infinite data sources for different topics
- The significance of this region lies on the business category
- The conventional companies get a various external data sources and merges with transactional data e.g.
- Developing a system that suggest restaurants
- 1st step is data collection, so, restaurants reviews from various websites and accumulate the data in a database
- It is employed for data analytics , in case of raw text concern
- It is not that much relation where in the data is stored for developing a model
- 2nd is big data technologies, to deploy an application of big data , want to construct its operation lively in real time
Sample Mini Project on Twitter
- When the problem statement is identified, the next step is data collection
- The underneath concept of mini project operates on gathering data from an internet and formatting it to be employed in a model of machine learning
- Gather tweets from twitter and process it using R programming language
- To proceed, generate an account in twitter and carry on the instructions underneath for the generation of an account for twitter developer. The instructions are as follows
- Do log in the given link https://twitter.com/apps/new/
- do fill the general information and move to the “settings” tab and choose “ read, write and access direct messages”
- Do save the made settings
- Catch the consumer key & consumer secret from “details” tab
- API key along with an API secret values are accessed in the R session
- Then execute the script given in the beneath section.
- It installs the package twitter from its storage repository on github
- To obtain the data with the string value “big_ mac” and identifying the topics out of this.
- To perform this, the initial step is gathering data from the page twitter
- the underneath is the script from R programming language to gather necessary data from the twitter page
![Data Collection data collection img1](https://www.assignmenthelp.net/webimg/ahp/big-data-assignment-help/data-collection-img1.jpg)
![Data Collection data collection img2](https://www.assignmenthelp.net/webimg/ahp/big-data-assignment-help/data-collection-img2.jpg)
![Data Collection data collection img3](https://www.assignmenthelp.net/webimg/ahp/big-data-assignment-help/data-collection-img3.jpg)
.