Friday, August 2, 2013

Big Data is not born in a Day !

Adieu to an Algorithmic Age::

Intelligence every where! Sensors every where! Data seems to be liberated from all the corners of universe. One may wonder, where was all these exabytes and petabytes of data hidden. Or is this internet universe that spawn monsters of data from nowhere? 

Absolutely not. Big Data is not born in a day ! This rich collection of data that we see accumulating in minutest measures of seconds was nothing but encapsulated in the abstractions of an algorithmic age. 




A Critique of Classical Computational Models:
In the scientific computing community, there is an emerging realization that we are moving ahead of an algorithmic age to an age of intelligence and adaptation. We emulate more and more the natural cognition. Data structures have grown beyond the linkages and contextual affinities of algorithms. We may look back for a while. What were we doing with information spaces all these while? Data structures in various information spaces where conditioned by a logic that could approximate a mathematical behavior.

In a way , Boolean logic is largely a mathematical behavior or an operational approximation for the convenience of calculation. Mathematical behavior can be modeled by approximations. Thus we created concept machines based on Boolean logic.Mathematical behavior or for that matter any behavioral logic is just the reflection of a larger set of conditions. If we look from a higher abstraction, we were trying to fix the multidimensional data structures into a partial projection of Boolean logic. Thus my argument is that Boolean logic was insufficient to capture the computational complexities of data streams.

Data Structures and Dialectical Logic
Then what is inherent in data structures: in reality, do they exist at all? I am not an exponent enough to lay down my arguments in mathematical formats. However, I may try in terms of dialectical logic here. Data as such is a representation of a physical entity or a cognitive process. It may have its own primary structure or it may be derived or dependent on a much more relatively invariant structure.  This integral between representational mathematical format ( symbol ) and the corresponding primary or secondary structure constitute a data structure. This visualization is in terms of dialectical logic. 

In the measures of physics, we may use the metrics of space time in many models. But when the data streams are dependent or realizations of energy structures the scenario becomes more interesting. The high energy physics and the future smart sensors may become the sources of such #energy structures. As the data explosions gains momentum, we may need inner eyes to capture the innate structures behind the 'Big Data' ecosystem.

No comments:

Post a Comment