This article describes the procedures involved in integrating a NoSQL database with a traditional one. These procedures were implemented in an academic project context of agile development, entitled Big Data, Internet of Things and Mobile Devices (BDIC-DM in Portuguese). This project was conceived in the first half of 2015 at Aeronautics Institute of Technology (ITA). As a requirement for the effectiveness of the mission, the implementation of an e-commerce system to manage transactions involving large volumes of data (Big Data), a number of different technologies were used. Among these tools the ones that stand out are those involving the generation, storage and consumption of large volumes of data. As a starting point for some features of Real Time Transactional Processing (OLTP - Online Transactional Processing) system, the traditional Database Management System (DBMS) MySQL was used along with the DBMS NoSQL Cassandra to store the portal purchase data. As for the batch data analysis (OLAP - Online Analytical Processing) Apache Hadoop Ecosystem was used. An infrastructure based on the Apache Sqoop tool allowed the export of data from traditional relational database to the HDFS(Hadoop File System).
Biografia do Autor
Ramiro Tadeu Wisnieski, Instituto Federal de São Paulo
