Literature Review on Past and Present Areas of Big Data Challenges in IoT and Cloud
The IoT or Internet of Things is a framework of different interconnected computing devices, individuals provided with different unique identifiers and digital and mechanical machines. This also includes the capability of transferring information over networks instead of any human to a computer or human to human interaction.
The IoT and big data are the “business output demand” that has been driving changes in the applications. It creates distinct problems for networks. Further, they also need expertise for networking to expand their ideas beyond the system. The current technologies enabling big data and IoT have been enabling innovative opportunities in business. Big data is the capability of an aggregating massive quantity of data through technologies and distributed systems of storage. An enormous amount of data originating due to the rise of IoT has been feeding the necessities of capabilities of big data.
The following study has conducted a literature review on the topic. It discusses the methodologies utilized in different times. Those methods are then compared. The plans are later explained. Proper tables and graphs are also included to support the arguments and justifications. Lastly, the research findings are discussed.
The amount of data has been created by healthcare applications, social media, devices, sensors, temperature sensors and different other digital devices and software applications. They consistently create a large quantity of data. They have been structured, unstructured or semi-structured continuously rising. The huge data generation gives birth to big data. The conventional databases were improper while storing and processing and assessing the quickly growing quantity of data or the big data. This work was not seen in the previous literature and is considerably latest in the IT and business.
One of the finest examples of studies related to big-data is the upcoming frontier for productivity, competition and innovation. Hashem et al. (2015) as defined the big data as the size of the datasets. Those have been better database systems than the general tools to capture, store, process and analyze the data. Zaslavsky, Perera and Georgakopoulos (2013) label these technologies as the latest generation of architectures and technologies aiming to take out value from the huge amount of data with different formats. This is done by enabling analysis, discovery and capturing of high-velocity. The prior studies have also characterized big data to three elements. They are data sources, data analytics and presenting the outcomes of analytics.
The current definition utilizes 3Vs like volume, variety and velocity model. These highlights e-commerce trend in management of data facing issues for managing size or volumes of different data sources of data and speed or velocity to create data. Few studies like that conducted by Botta et al. (2014) declare quantity as the primary property of big data rather than delivering pure definition. Besides, additional researchers have proposed other elements for big data. Those include veracity, variability and the complexity. The model and its deviations are most general descriptions of the word “big data”.
The Methodology Used Big Data in IoT and Cloud in Past and Present
The analytics is big data includes methods to search database, mining and assessing data that is dedicated to developing organizational performance. This is the method to investigate substantial data sets containing various data types. These are meant to display the hidden correlations, customer preferences, market trends, unseen patterns and extra helpful business information. Jin et al. (2015) mentions that the ability to examine the enormous quantity of data helps the companies to deal with sufficient amount of data affecting the business. Thus the primary aim of big data analytics has been to help business communities to possess an enhanced idea of data. In this way, it makes well-informed and efficient decisions. The analytics allows scientists and data miners in analyzing a large quantity of data. This might not be harnessed utilizing conventional tools.
According to Biswas and Giaffreda (2014), analytics need tools and technologies transforming huge quantity of those data in a more metadata format and credible data regarding the analytical process. Algorithms used in the analytical tools should find out patterns, trends and different correlations around different time horizons in data. As the data are analyzed, those tools perceive those findings in tables, spatial charts and graphs for the effective making of a decision. In this way, the analysis falls under an important challenge for different applications due to the complexity of data and scalability of the underpinning algorithms supporting those processes.
Liu et al. (2014) has highlighted that retrieving useful data from analysis of big data has been a vital matter requiring scalable analytical techniques and algorithms for returning well-times outcomes. However, present algorithms and techniques are not sufficient to manage analytics of big-data. Thus huge infrastructure and extra applications have been needed for supporting data parallelism. Further, data sources like high stream data stream have gained from various data sources, having various formats. This has helped in integrating various sources for a critical analytic solution. Thus the challenge has concentrated on present algorithms utilized in the analysis of big data. This has not been rising linearly with the huge rise in the computational resources.
Figure 1: “Reference architecture for IoT data analytics platforms”
(Source: “Extracting insights with Internet of Things data analytics platforms”, 2017)
The process of big data analytics has been consuming notable time to deliver feedback and guidelines to the users. On the other hand, Da Xu, He and Li (2014) shows just a few tools have been processing high datasets under the considerable period of processing. On the other hand, the maximum of remaining tools has been using a complex trial-and-error method to deal with the high quantity of data sets and different data heterogeneity. Systems of big data have been present like the exploratory data analysis environment with is a type of big data visual system of analytics used to assess complicated earth system simulations along with a huge number of the data sets.
From cuneiform, one of the earliest modes of writing to the data centres, the human race has always collected information. A rise in technologies has been leading to overflow of data. This constantly needs more sober systems of data storage. Identification of information overload begun in the early 1930s.Outburst in population, issuing of numbers of social security, and a common rise of knowledge expected more organized and thorough keeping of records. Despite all this, it has been too long prior the initial warning rose (Fernandez & Pallis, 2014). As the rise of knowledge has been good for society, it has been leading to storage and retrieval challenges for libraries very fast. Information continues to grow in the coming decades.
The companies started to develop, design and deploy centralized systems of computing allowing them to automate the inventory systems. Systems started to mature around industries and integrating into enterprises. The companies started to use those data for providing reactions and in-depths allowing them to create better decisions of business or business intelligence or BI (Fang et al., 2015).
Figure 2: “2012 Big Data Revenue by Vendor”
(Source: “Big Data Vendor Revenue and Market Forecast 2012-2017”, 2017)
As business intelligence piled up, a challenge of storage and management surfaced again quickly. For offering more functionality, the digital storage needed to turn to be most cost-effective. It has lead to a rise of platforms of business intelligence. Since platforms of BI platforms started to mature, data gleaned has enabled organizations, medical practitioners, scientific researchers and defence and intelligence operations creating revolutionary breakthroughs. After some years during 1999, the word Big Data has been appearing in “Visually Exploring Gigabyte Datasets in real time”, as published Association for Computing Machinery. Moreover, propensity to store a huge quantity of data with no other way to analyze is done sufficiently (Aazam et al., 2014). It was the first time the term IoT came to the market, for describing a rise in some devices online and potential to communicate with others without any human middleman.
During 2000, various economists attempted to quantify the quantity of digital information and rate of growth for a first time. It was seen that the total annual production of a film, print, magnetic and optical content had needed about 1.5 billion GB of storage. It has been quite equal to 250 MB per person for every people in the world. In 2001, the term “software as service” emerged (Yadav, Singh & Kumari, 2016). It is the idea that has been basic to various cloud based applications that have turned to industry standards.
The beginning of the 2000s brought a change in focus with a rise in accountability of institutional outputs. The organizations have developed their concentration towards smarter monitoring of re-enrollment, academic performance and financial data to make sense of progression. The current age of analytics has been beginning to look more prominent with more integration of data systems, huge data warehouses and advanced tools of reporting able to produce products that are predictive (Ranjan, 2014). Current technology of big data has provided prescriptive views to student success, recommending shortest path, informing curriculum design, a successful way towards degree attainment and triggering interventions for keeping people on track. For delighting stakeholders, few organizations have gone through experienced transformative outcomes by latest practices by strategies of informed big data.
In the current stage, there has been much to be achieved from Big data. Fast technological advancements in computational power, image processing, prescriptive analytics, beacons and sensors, system integration tools, data storages, advanced searching capabilities among high other primary advances (Wang & Ranjan, 2015). They supply in-depth analysis to process bottlenecks, system performances, hidden dependencies, devise based data and another user event in near real time.
For instance, most of IT systems have been delivering large log files of detailed data on machine events and the user activities. Despite all this, most of the logging functions has been only illuminating most severe circumstances provided that the logs have been manually reviewed and correlated less frequently among various systems (Xiaofeng & Xiang, 2013). A technology of big data also permits those log files ingested concurrently and assessed in real time. This is done by alerting staff to IT situations around the enterprise. It highly improves the effectiveness and efficiencies of IT staff to solve problems to raise complex ecosystems of networks, on-premise services and cloud.
Figure 3: “Internet of Things: New Challenges and Practices for Information Governance”
(Source: “Internet of Things: New Challenges and Practices | Reva Solutions”, 2017)
Big data has also been providing insights to users through creating profiles of applications used, information consumption, location data and various related security events (Sharma et al., 2015). Further, significant data technology is used to assimilate different processes of workflow logs to deliver more complex views of how the business could be done on campus.
In the present scenario, this technology monitors security logs done by alerting IT staff to unusual activities regarding users such as successful phishing attacks that result in login from various distant locations, an absence of healthy activities and direct deposit changes in the last-minute (Bi & Cochran, 2014). The ability to process multiple log-files in the real time has been leading to early resolution and detection of issues, reducing blame games, thwarted cyber attacks among the owners of the systems, stakeholders and developed performance and availability of different methods.
In IoT, all devices generate data. As every tool makes an infrequent and small quantity of data, the added amount of data from various IoT devices produces a staggering amount of disaggregated data. Application of important data technology to the IoT delivers views into the way how the campuses operate and lead to latest economies of efficiencies, savings and models of effectiveness.
For instance, maximum of control systems in the campus have digital interfaces. Data gathered from those interfaces tells us more regarding resource consumption. As the machine data is combined with environmental data, creating utilization schedules and weather, complete scenario emerges delivering facilities managers with latest insights to maintain energy efficiencies from those interfaces telling a lot about the resource consumption (Bessis & Dobre, 2014). Data collected from the interfaces states a lot about resource consumptions. Further, facilities management resources could be directed in resolving problems producing the highest positive effects by a wide variety of different factors. These have been some of the practical uses of big data in the IT ecosystems.
The technology segments have been intended to achieve noted a rise in the current years from advancements of Big Data. This includes visualization technology. It is witnessing additional attention for facilitating the adoption of the Big Data. Reality technologies have also gained funding to help innovation of more user-friendly and sophisticates systems. The tools have attracted important users of business, rising demands for easy tools of Big Data (Perera et al. 2015). Despite all this, a supply of those reality technologies has been dependent highly on current wireless technologies such as 5G wireless. Next, development in BCI or Brain Computing Interface is another current trend in this field. Various researching organizations have been working in the field to develop various human-machine interaction systems (Fernandez & Pallis, 2014). Convergence of BCI, Big Data and AL has been intended to supply promising applications in future and note the central issues with current computing infrastructure. This includes scalability of data, interactive interface and quicker delivery of various meaningful insights.
Regarding efficiency a revolution of connectivity is found to be brewing across the globe. Internet in the 90s was able to connect 1 billion users via shaky dial-up networks. A mobile wave of the 2000s has been able to connect about 2 billion users to seek information. This helps in keeping in touch with friends, watch videos and perform various other activities. Currently, IoT can inter-connect ten times or about 28 billion devices online from cares to various bracelets by 2020. Revenue originating from IoT enabled products and services are expected to surpass 300 billion dollars by 2020 (Chen et al., 2016). However, this can only be regarded as the tip of an iceberg. A vast quantity of data is generated by IoT. Thus a well-analyzed data is highly expensive. Effect of this is felt around the universe of big data. This, on the other hand, forces the organizations in quickly upgrading the present process, technology and tools for accommodating huge data volumes and considers benefits of insights delivered by big data.
To explain the simplicity of Big data let the example of Oracle be taken. It is comprehensive. Clouds services enable to easily implement total big data management system with security and unified query through Oracle SQL. The big data is on demand. This includes the rapid and secure self-service provisioning of Hadoop clusters. It is also elastic and organizations can start small and then grow their cluster based on various needs of processing. There are scales to handle megabytes of data (Xu et al. 2015). Moreover, it is secured and the organizations can integrate with enterprise security utilizing pre-configured LDAP authorization, robust centralized auditing and Kerberos authentication. Besides, it is easily managed. Having Oracle has been helping in managing clusters with easy-to-use tooling. It includes patching with a single click and various upgrades. Big data is also dedicated and this instance delivers high performance consistently. It is also easily connected integrated with cloud and different on-premises services. Other services could be seamlessly integrated using big data connectors. Lastly, it is easily integrated. All the data could be stored in services of Oracle Storage Cloud and could be processed with numerous Hadoop clusters.
Regarding extension of Big Data experts has been describing IoT as a collision of software and hardware has put the market on the brink of transformation like the Industrial Revolution. The extension is ready to react again through educating and informing clients about the connection between processes, data, things and people transforming business, lives and many more (Chen, Mao & Liu, 2014). Failure and success of the reaction hinge on future progress to overcome the traditional bias regarding face-to-face service to the clients over engagements of digital forms.
Regarding health IoT revolutionizes personal health, keeping new demands on community health programming and extension family. People have been able to measure the individual health metrics via self-tracking wearable technologies, wearable sensor patches, clinical remote monitoring, Wi-Fi scales and a myriad of additional bio-sensing applications. Those devices can report individual health status directly to the people who can further adjust medication schedules, confirm safety and track overall health (Channe, Kothari & Kadam, 2015). The kitchens can monitor food supplies in the refrigerators, upgrade shopping lists, and provide recommendations promoting better habits of eating. Here, extensions are needed to be developed for assisting clients in interpreting this diet data and digital personal health.
The next extension of big data is agriculture. IoT has been playing a primary role in a pursuit of precision agriculture. Various sensors on equipment inter-connected to Internet supplies real time points of data regarding harvesting, planting and yielding that have been leading to improvements in agriculture from decision making ion farm to making policies at national levels. Usage of IoT in farming has also been including sensor installation in fields. For instance, sensors in different locations of various vineyards have been collecting data regarding soil and plants that could be used to prevent different diseases. For example, the condition could be Peronospora, prior they could inflict any damage (Suciu et al. 2015). Again for instance in Japan, Internet of Cows are implemented which is another cloud based system, allowing dairy farmers in tracking the health of the herds via W-Fi pedometers particularly for enormous FitBits for the animal. This type of advances necessitate a reinterpretation of practices in farming via the use of data-centric technologies and need an extension to create a capacity to assist clients in implementing this kind of technology.
The last extension is education. The IoT in a classroom has been promising means to develop more adaptive, contextual and connected adaptive learning experiences for extension learners. The online extension clients or hybrid learning environments has generated education variety of big data. This is the learning analytics retrieved from learning the used management systems. These help instructors to pinpoint issues of learning and recognize remedies. Extensions are also involved in creating and delivering online adaptive learning experiences guiding learners via trouble spots, accelerating learning and offering remediation as required. Regarding this expansion new teachable moments could be expected to evolve while information is exchanged between the devices and clients (Nepal, Ranjan & Choo, 2015). This very moment can deliver latest and innovative forms of different just-in-iome publications of extensions. This helps the clients to understand, decode and react to connected worlds. Moreover, people must anticipate an accompanying rise in demand to train in digital life skills embracing Big Data and IoT.
Figure 4: “Big Data with Cloud Computing”
(Source: “Big Data with Cloud Computing – 20x reduction in TCO”, 2017)
To understand the time consumption, big data analytics for banks could be considered. The investment banks have been the first to adopt big data analytics. All documents provided require recommend market movements, stocking behaviors of purchasing, trends of investment and manual processing, the task is not impossible. Further it could be also time consuming. Moreover, different manually imputed data has been prone to human error. Any mistake results in high problems. Availability of technology of big data is shown to be effective. A considerable quantity of data could be processed to develop and decreasing the risk of inaccuracy (Díaz, Martín & Rubio, 2016). Proper data and reports have been empowering organizations in analyzing data smoothly and create better predictions like before. The efficiency could be improved by big data that helps in explaining different aspects of business. For instance it is also able to study massive quantity of time taking product to have from real development in market. Data is able to pinpoint sectors taking most extended quantity of time. It has been allowing determining the roadblocks.
Thus new ways could be found to develop efficiently and cutting down time taking for products to react in the market. It permits to find barriers and to find latest methods to improve efficiency along with reducing downtime taken for products for reaching a market. It has been also useful to cut down costs developing the competence via big data leading to a notable reduction in the cost of production. Data is able to show few development stages that are repetitive. However, data must display duplicity as per as particular processes are considered (Yin & Kaynak, 2015). At a business, all means have been costing money. A technology of big data has been helping to lower the costs and making trade more beneficial. Big data has been able to do away with the unnecessary contracts. Business is intended to possess maintenance contract in place. The data gleaned from platform chosen shows the real number of service calls that are against price of commitment. A careful analysis of data shows that the business could be shortchanged. Ultimately data points to the fact that company has been better off paying regarding individual service calls tied to any contract. Big data has been enhancing customer service.
Big data analytics needs getting information from the customers. One is able to seek the necessities of customers with such information in hand permitting to provide them more sophisticated personalized service (Riggins & Wamba, 2015). Further, it is able to save the money of business. Winning new customers takes adequate time and resources that are ready. Marketing campaigns, promotional activities and advertising need to dabble in as new customers are required to be attracted. Further, through big data analytics a firsthand look can also be gained to make the customers satisfied. Making the existing customers happy is much better and cheaper than searching for latest ones. Big data is also able to resolve the issues quicker. With the help of big data analytics one can smoothly point particular problems. It helps in determining issues quicker, before anything goes out of hand. Besides, it helps in getting things right.
There are chances to do so that helps in saving money for business. For instance data collected shows the nature of calls of customer service. Further, data shows that problems of shipping look to the reason behind most of customer complaints (Lee & Lee, 2015). Data collected helps in studying processes to see the places of improvement. Lastly, it is helpful to boost the efficient of the staffs. It comprises of particular programs of procedures in place starting to be proving ineffective (Baccarelli et al., 2016). Analysis of data shows that one needs to alter those plans or make processes work efficiently. Data collected via platform of big data likewise shows whether one needs to deliver extra training to staff or revise policies in place.
Regarding feasibility, it can be said that big data has been facing many problems. It raises benefits regarding social and productivity. Its essence has been to increase the accuracy of activities related to human production. Big data itself has been bringing no direct benefits. However, it can be worn or eaten. However, it eliminates waste. Prior the emergence of big data, it was hard to glean wisdom from devices, since knowledge emerges from experts around all kind of industries (Khan et al., 2015). Presently the input information from a vast base of knowledge created by mining of big data could be transformed to wisdom guiding people to develop productive and social activities.
Every technology gives rise to social advantages satisfying two requirements. One is technical feasibility and the other one is financial feasibility. Former one indicates whether the technology delivers relevant methods to implement. The latter one refers whether that system or product created using the technique bringing benefits. Big data also requires needing perquisites as it is applied on a large scale from before. Big data has been found to go through a trough of disillusionment as it is passed through a period of hype.
Technologies at this platform have been technically feasible. For example, as driven by a Hadoop-based open source system, the data could already possess the fundamental technical feasibility in a maximum of areas instead of particular sectors like cutting-edge (Al-Fuqaha et al., 2015). Although all this economic viability has been considered in an adverse way in implementing to projects, there has been no straight-forward objective of the project and additional initial investment. It indicates that the plan has been failing to deliver intended goals. Therefore, economic feasibility is the primary consideration to big data projects.
A system based on big data platform can retrieve and assimilate central data via applications of closed-loop and create application ecosystem through using those open-loop implementations. A healthy ecosystem of claim has been able to resolve economic feasibility problems under the ecosystem. This indicates that the applications in that ecosystem, like closed-loop applications, system light-loading and open-loop applications have been able to develop reasonable benefits and commercially feasible. There have been various data ecosystems constructed in every field. Ecosystems that are not feasible economically, gradually gets phased out or integrated as the competition in the market intensifies (Bonomi et al., 2014). Different dominant ecosystems dominate in particular areas. These solve issues regarding economic feasibility along with their ecological fields. To gain common prosperity and collaboration between dominant ecosystems, data could be transferred and exchanges as per as the mutual benefit and principles of equality.
A minute quantity of data has not been included in ecosystems that could be traded freely in maximizing the social value by data exchange. In the current age of colossal growth of big data, it is found to be feasible financially in every field. Thus big data has been available at every place. Big data platform has been delivering data encapsulation, openness in capability, easy and quick scenario to application development (Aazam et al., 2014). This helps customers to plan and develop the ecosystems of big data in various stages, reducing initial investment and lowering the risks of projects.
As per as connectivity is considered there have been more in-depth technical reasons why connecting to big data is difficult as customarily explained by the industry. Organizations have been looking at the problems to connect and manage big data, a hybrid could and IoT applications under a single technology proposition. Further, people require assimilating the data and then being able to implement what has been denoted as multi-model support. This indicates that more than a data model itself has been needed to be accommodated. The term “data model” here shows formalized ways and various documented processes through which objects in a database and their related data-oriented structures have been present (Fernandez & Pallis, 2014). Thus it has been forming a behavioral relationship under that model. All of these have been by defined requirements for supporting business processes. With the rise in the quantity of data models and applications for accommodating, bringing data together has not been straightforward as few solutions of big data have been claiming at the outset. For bringing big data together, businesses require the processes of automating and orchestrating the management provisioning and version control of applications under those environments.
For instance, the instance of HP could be taken. As per as research commissioned from the part of HP, about 60% of organizations surveyed have been found to spend a minimum of 10% of their budget of innovation in any particular year. Further, the study also showed that more than about one in every three companies has been failing with initiative of big data. HP revealed that it has been working with portfolio for delivering the needed services and resolutions for facilitating the successful deployment of those efforts (Sharma et al., 2015). This also helps enterprises to manage growing variety, volume, vulnerability and velocity of data causing those initiatives to be failed. To help companies to reap rewards of big data, HP revealed a statement. Big data analytics platform leveraging software of HP analytics services and hardware has been creating a future generation of analytics for big-data-ready solutions and applications.
Regarding commercialization, the investment a macroeconomic effect of big data at the market of UK can be considered. The analytics and big data have been broadly extended and improving quickly. However, a little is been known from the previous regarding the extent of investment of UK business. That team has been used the publicly available employee profiles registered on social media network and estimated that significant data employment in the nation’s market sector had been 190,000 during 2010. Comparatively UK organizations have employed about 17000 workers in R&D at 2013 and 750000 workers in software during 2010. Thus the activities related to big data have surpassed R&D as per as the human resources (Fernandez & Pallis, 2014). Moreover, it is estimated that UK market sector investment in data-based resources in 2013 has been 7 billion pounds. The UK R&D investments, on the other hand, have been 15.5 billion dollars during 2012.
Despite all this, the data investment has been rising rapidly in an economy. Hence the further step has been to examine whether investments of big data has been equally significant returns to UK economy. Thus it is seen that contribution of capital to data-based to GDP has been on average 0.015% per year between 2005 and 2012. It has reflected the fact that data has been in their earlier stages of growth and commercialization. This contribution to growth is expected while the organizations start to have a better understanding of how to have a maximum of the investments.
The various methodologies suiting application or problems on Big Data are discussed hereafter. The first one is data quality assurance and grading. It would help in developing the new or adapting methods to merge data from various sources (Sharma et al., 2015). This also extended robust techniques for data quality grading and assurance supplying automated quality of data and cleaning processes to be used by researchers. The there is the identification of unusual data segments. It is developed automatically recognizing anomalous data segments via techniques based on metrics. These help in alerting researchers on particular data segments needed further assessment and determining potential problems with unsolicited manipulation of data and integrity breaches. Then confidentiality must be preserved on various data mining techniques.
Few datasets have been including sensitive data. It helps to transform or aggregate data for allowing analysis to be done with the lesser loss of data. Processes regarding dimensionality reduction and techniques of data perturbation are investigated along with preserving the privacy of data mining methods (Aazam et al., 2014). Next, another method is the text data mining. The textual data refers to rich information. However, it lacks structure and needs specialist techniques to get mined and linked correctly along with reasoning with and making useful correlations. Set of technologies could be developed to retrieve entities and relations among them, opinions and additional elements using to support semantic indexing, anonymisation and visualization. Then there is the tracking of interactions among users.
The data generated through the interaction of users through Internet comprises of enormous information. The methodology investigates automatic processes to track interactions that could be used for various purposes. For instance, this could be used to recognize service delivery towards customers and citizens (Sharma et al., 2015). Methodologies used for recognizing the context of interaction and the individual user requires delivering tailor-made services that are needed to be developed.
Moreover, machine learning and transactional data can be used. Machine learning and other methods to identify seasonal, stylized factors and different patterns or relations of behavior are investigated here. These methods deliver essential decision support information to companies in planning service based on predicted trends troughs or spikes in demand. Further, meta-analysis and evidence synthesis method can be utilized. Data has been varying in granularity and content. Few of them have been available at an individual or organizational level (Aazam et al., 2014). However very often because of different privacy preservation considerations to business, data gets aggregated to upper levels. For example, this includes postcode, ward or institutional level.
This is also aggregated by distinct properties like age group. A focus of this methodology is to develop a meta-analysis and methods for evidence synthesis enabling users to go through unified analysis. This has been especially for kinds of data available through the centre. Thus new ways are useful to develop regarding indirect comparisons like a meta-analysis of social interventions.
6. Conclusion:
The widespread popularity of IoT has turned analytics of big data a critical issue. This is due to the collection and processing of data via various sensors in IoT environment. A vast quantity of data is generated since the past decades with the rise of miniaturization of IoT devices. The report shows that that kind of data has not been used without any analytic power. The study discusses that various big data, IoT, and cloud solutions have enabled to gain expensive analysis to huge data created by the IoT devices. Despite this fact, those answers have been still in infancy. The domain has been lacking comprehensive survey. The paper has state-of-the art research efforts that have been directed towards big IoT data and cloud. A relationship between IoT and cloud with Big data is also demonstrated here. For doing this, various instances are drawn to quickly explain the cases. Multiple opportunities that could be brought to big data analytics in the paradigm of IoT and cloud is also analyzed. The report has pointed that big data analytics has placed a high demand for servers, storage and networks. Thus the current businesses have been outsourcing this kind of hassle and costs towards the cloud. The big data in cloud and IoT has been supplying latest business opportunities supporting significant data analysis and confronting different architectural hurdles. Both IoT and cloud have been aimed to help business to better understand customers. Since more and more companies have been adopting analytics of big data and cloud, they have been able to speed up product development cycle and quickly to respond to change in market conditions. This includes opening up new markets that have not been available from before.
7. References:
Aazam, M., Khan, I., Alsaffar, A. A., & Huh, E. N. (2014, January). Cloud of Things: Integrating Internet of Things and cloud computing and the issues involved. In Applied Sciences and Technology (IBCAST), 2014 11th International Bhurban Conference on (pp. 414-419). IEEE.
Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., & Ayyash, M. (2015). Internet of things: A survey on enabling technologies, protocols, and applications. IEEE Communications Surveys & Tutorials, 17(4), 2347-2376.
Baccarelli, E., Cordeschi, N., Mei, A., Panella, M., Shojafar, M., & Stefa, J. (2016). Energy-efficient dynamic traffic offloading and reconfiguration of networked data centers for big data stream mobile computing: review, challenges, and a case study. IEEE Network, 30(2), 54-61.
Bessis, N., & Dobre, C. (Eds.). (2014). Big data and internet of things: a roadmap for smart environments (Vol. 546). Springer.
Bi, Z., & Cochran, D. (2014). Big data analytics with applications. Journal of Management Analytics, 1(4), 249-265.
Big Data Vendor Revenue and Market Forecast 2012-2017. (2017). Bigdatanews.datasciencecentral.com. Retrieved 30 December 2017, from https://www.bigdatanews.datasciencecentral.com/profiles/blogs/big-data-vendor-revenue-and-market-forecast-2012-2017
Big Data with Cloud Computing – 20x reduction in TCO. (2017). Bijoor Family’s Blog. Retrieved 30 December 2017, from https://bijoor.me/2012/03/09/big-data-cloud-computing-20x-reduction-in-tco/
Biswas, A. R., & Giaffreda, R. (2014, March). IoT and cloud convergence: Opportunities and challenges. In Internet of Things (WF-IoT), 2014 IEEE World Forum on (pp. 375-376). IEEE.
Bonomi, F., Milito, R., Natarajan, P., & Zhu, J. (2014). Fog computing: A platform for internet of things and analytics. In Big Data and Internet of Things: A Roadmap for Smart Environments (pp. 169-186). Springer International Publishing.
Botta, A., De Donato, W., Persico, V., & Pescapé, A. (2014, August). On the integration of cloud computing and internet of things. In Future Internet of Things and Cloud (FiCloud), 2014 International Conference on (pp. 23-30). IEEE.
Botta, A., De Donato, W., Persico, V., & Pescapé, A. (2016). Integration of cloud computing and internet of things: a survey. Future Generation Computer Systems, 56, 684-700.
Channe, H., Kothari, S., & Kadam, D. (2015). Multidisciplinary model for smart agriculture using internet-of-things (IoT), sensors, cloud-computing, mobile-computing & big-data analysis. Int. J. Computer Technology & Applications, 6(3), 374-382.
Chen, M., Ma, Y., Song, J., Lai, C. F., & Hu, B. (2016). Smart clothing: Connecting human with clouds and big data for sustainable health monitoring. Mobile Networks and Applications, 21(5), 825-845.
Chen, M., Mao, S., & Liu, Y. (2014). Big data: A survey. Mobile Networks and Applications, 19(2), 171-209.
Da Xu, L., He, W., & Li, S. (2014). Internet of things in industries: A survey. IEEE Transactions on industrial informatics, 10(4), 2233-2243.
Díaz, M., Martín, C., & Rubio, B. (2016). State-of-the-art, challenges, and open issues in the integration of Internet of things and cloud computing. Journal of Network and Computer Applications, 67, 99-117.
Extracting insights with Internet of Things data analytics platforms. (2017). IBM Big Data & Analytics Hub. Retrieved 30 December 2017, from https://www.ibmbigdatahub.com/blog/extracting-insights-internet-things-data-analytics-platforms
Fang, H., Zhang, Z., Wang, C. J., Daneshmand, M., Wang, C., & Wang, H. (2015). A survey of big data research. IEEE network, 29(5), 6-9.
Fernandez, F., & Pallis, G. C. (2014, November). Opportunities and challenges of the Internet of Things for healthcare: Systems engineering perspective. In Wireless Mobile Communication and Healthcare (Mobihealth), 2014 EAI 4th International Conference on (pp. 263-266). IEEE.
Gubbi, J., Buyya, R., Marusic, S., & Palaniswami, M. (2013). Internet of Things (IoT): A vision, architectural elements, and future directions. Future generation computer systems, 29(7), 1645-1660.
Hashem, I. A. T., Yaqoob, I., Anuar, N. B., Mokhtar, S., Gani, A., & Khan, S. U. (2015). The rise of “big data” on cloud computing: Review and open research issues. Information Systems, 47, 98-115.
Hassanalieragh, M., Page, A., Soyata, T., Sharma, G., Aktas, M., Mateos, G., … & Andreescu, S. (2015, June). Health monitoring and management using Internet-of-Things (IoT) sensing with cloud-based processing: Opportunities and challenges. In Services Computing (SCC), 2015 IEEE International Conference on (pp. 285-292). IEEE.
Internet of Things: New Challenges and Practices | Reva Solutions. (2017). Reva Solutions. Retrieved 30 December 2017, from https://www.revasolutions.com/internet-of-things-new-challenges-and-practices-for-information-governance/
Jin, X., Wah, B. W., Cheng, X., & Wang, Y. (2015). Significance and challenges of big data research. Big Data Research, 2(2), 59-64.
Khan, Z., Anjum, A., Soomro, K., & Tahir, M. A. (2015). Towards cloud based big data analytics for smart future cities. Journal of Cloud Computing, 4(1), 2.
Lee, I., & Lee, K. (2015). The Internet of Things (IoT): Applications, investments, and challenges for enterprises. Business Horizons, 58(4), 431-440.
Li, J., Tao, F., Cheng, Y., & Zhao, L. (2015). Big data in product lifecycle management. The International Journal of Advanced Manufacturing Technology, 81(1-4), 667-684.
Liu, C., Yang, C., Zhang, X., & Chen, J. (2015). External integrity verification for outsourced big data in cloud and IoT: A big picture. Future Generation Computer Systems, 49, 58-67.
Nepal, S., Ranjan, R., & Choo, K. K. R. (2015). Trustworthy processing of healthcare big data in hybrid clouds. IEEE Cloud Computing, 2(2), 78-84.
Perera, C., Ranjan, R., Wang, L., Khan, S. U., & Zomaya, A. Y. (2015). Big data privacy in the internet of things era. IT Professional, 17(3), 32-39.
Ranjan, R. (2014). Streaming big data processing in datacenter clouds. IEEE Cloud Computing, 1(1), 78-83.
Ranjan, R., Wang, L., Jayaraman, P. P., Mitra, K., & Georgakopoulos, D. (2017). Special issue on Big Data and Cloud of Things (CoT). Software: Practice and Experience, 47(3), 345-347.
Riggins, F. J., & Wamba, S. F. (2015, January). Research directions on the adoption, usage, and impact of the internet of things through the use of big data analytics. In System Sciences (HICSS), 2015 48th Hawaii International Conference on (pp. 1531-1540). IEEE.
Sharma, S., Tim, U. S., Gadia, S., & Wong, J. (2015). Growing cloud density & as-a-service modality and OTH-CLOUD classification in IOT era. Iowa.
Suciu, G., Suciu, V., Martian, A., Craciunescu, R., Vulpe, A., Marcu, I., … & Fratu, O. (2015). Big data, internet of things and cloud convergence–an architecture for secure e-health applications. Journal of medical systems, 39(11), 141.
Sun, Y., Song, H., Jara, A. J., & Bie, R. (2016). Internet of things and big data analytics for smart and connected communities. IEEE Access, 4, 766-773.
Wang, L., & Ranjan, R. (2015). Processing distributed internet of things data in clouds. IEEE Cloud Computing, 2(1), 76-80.
Xiaofeng, M., & Xiang, C. (2013). Big data management: concepts, techniques and challenges [J]. Journal of computer research and development, 1(98), 146-169.
Xu, B., Da Xu, L., Cai, H., Xie, C., Hu, J., & Bu, F. (2014). Ubiquitous data accessing method in IoT-based information system for emergency medical services. IEEE Transactions on Industrial Informatics, 10(2), 1578-1586.
Xu, X., Sheng, Q. Z., Zhang, L. J., Fan, Y., & Dustdar, S. (2015). From big data to big service. Computer, 48(7), 80-83.
Yadav, D. K., Singh, K., & Kumari, S. (2016, November). Challenging issues of video surveillance system using internet of things in cloud environment. In International Conference on Advances in Computing and Data Sciences (pp. 471-481). Springer, Singapore.
Yang, C., Huang, Q., Li, Z., Liu, K., & Hu, F. (2017). Big Data and cloud computing: innovation opportunities and challenges. International Journal of Digital Earth, 10(1), 13-53.
Yin, S., & Kaynak, O. (2015). Big data for modern industry: challenges and trends [point of view]. Proceedings of the IEEE, 103(2), 143-146.
Zaslavsky, A., Perera, C., & Georgakopoulos, D. (2013). Sensing as a service and big data. arXiv preprint arXiv:1301.0159.