The Challenge of Big Data: An Analysis of NoSQL Technology

We are all currently living in an era of huge data stocks, yet Big Data and its underlying technology NoSQL is also becoming a buzzword on the Internet. For global Internet organizations like Google, Facebook, and IBM, the use of NoSQL, a highly scalable non-relational database inventory, has often surpassed that of relational databases. In fact, in the process of some of the problems of massive data and semi-structured data, a series of new database products have been born, and these databases we call NoSQL.

On April 26-27, 2013, the 2013 Big Data Global Technology Summit, organized by 51CTO Media Group's WOT (World Of Tech) brand, was held at the Renaissance Beijing Renaissance Hotel. noSQL products are so varied, with different features and value propositions, that it's often difficult to choose. The reporter deeply communicated with Ming Lei, a software development expert from Silicon Valley, who has worked in Oracle, Microsoft and Google, and analyzed the actual NoSQL products, and summarized some points for the reference of the users.

Mr. Ming Lei (left)

Distributed Systems and NoSQL

A distributed system consists of many different layers, including the application layer, the data layer, the performance layer, etc. Now we are mainly talking about the application layer and the data layer, which are important components of a distributed system. The application layer generally has no state, and the data layer is constantly doing operations to make it save state. The data layer is the most difficult and deepest layer in a distributed system.

Mr. Ming Lei's point of view is that NoSQL is a memory in a distributed system, it is a kind of distributed system. Or rather it is a level of distributed system.

Comparison of NoSQL Cache to CDN Cache

In the NoSQL side of the cache is represented by Memcached, NoSQL cache and CDN cache the biggest difference is that NoSQL cache refers to the data layer cache, not the application layer cache, not the network layer cache, so its cache is more raw data. For example, if the transaction in the application logic is not the final result for the user to see, then if we do the caching in the network layer, the most common technology is called CDN, which is called ContentDeliveryNetwork, it is generally at the end of the network near the end of the user's end of the network on some of the web servers to cache some specific web pages.