Welcome!

Microservices Expo Authors: Liz McMillan, Elizabeth White, Pat Romanski, Gregor Petri, AppDynamics Blog

Related Topics: Microservices Expo, Industrial IoT

Microservices Expo: Article

A Complementary Query Language to Google’s Dart

Structured Data Query Languages

Dart is a new structured data programming language from Google. While unstructured data has become extremely useful, structured data is still extremely important because it keeps businesses running day in and day out. Programming languages still need to be coded by hand and most Google users are not programmers. To fill this large gap for most Google users who have no programming experience, a structured data query language would be very useful. Query languages operate by what data or information is wanted and not how to access or derive it. No programming is necessary to use. This is very similar to a standard Google request. This allows anyone to specify a powerful structured data query request.

How does a query request automatically operate without being instructed on how to perform the request? This is done by analyzing the semantics in the data structure. Since query languages have the ability to search out meaning, they can derive the most value out of the semantics in the data structure. The first and primary place to look for semantics is in the data structure and should not be ignored even if other types of semantics are available. This is because the data structure drives or guides the meaning of the query.

Structured data often involves hierarchical structures. Hierarchical data structures inherently have a significant amount of structure semantics. Besides having vertical semantics they have horizontal semantics where data across pathways are related. This produces very complex structures requiring complicated data structure user navigation for programming languages. Query languages on the other hand are free to perform the navigation internally without involving the user. In fact, some complex data structures are too complex to handle with user navigation within programming languages. This makes query languages indispensable in these complicated situations proving query languages unique usefulness in structured data processing. One such complex data structure processing requiring query processing are multipath queries. These require complicated coordination between multiple paths of a hierarchical data structure such as when a query selects data from one path based on data from another path.

An amazing thing happened unnoticed and unplanned in the ANSI SQL-92 standard. In this standard, the LEFT Outer Join was introduced along with other outer join capabilities. The LEFT Outer Join is a one-sided join that is hierarchical by nature. It always preserves the left side of the outer join operation allowing, for example, employee data that has no dependent data to always be preserved. A new ON clause operation allows specification of hierarchical join criteria at each join point to replace the single use SQL WHERE clause. This prevents any ambiguity in defining hierarchical data structures that occurred when using the older WHERE clause. This combination of new SQL features unexpectedly turned out to support complete hierarchical multipath data structure definition and hierarchical processing even though there was no prior design performed or coding added in ANSI SQL to support full hierarchical processing.

These powerful hierarchical data structures can also be naturally defined in SQL views which can be dynamically joined in multiple ways creating larger variable structures and perform their hierarchical processing on the fly. This concept for processing dynamically created structured data is new and opens up many powerful capabilities in structured data. It utilizes a new Dynamic Metadata Maintenance operation that allows the metadata to be transparently processed. This eliminates any metadata operation by the user to process dynamic structured data. The ANSI SQL query language is in a position to take advantage of these new dynamic structured data capabilities such as for use in peer-to-peer data collaboration.

As stated in the very beginning of this article, Dart is a programming language. This gives it great user control that requires the user to have programming experience and knowledge. But what is not generally recognized, is that some problems are just too complicated to solve under user control. They require automatic processing to handle. These can be performed by a query processor. This automatic processing also means that the user does not need programming experience to specify the query. ANSI SQL's natural hierarchical structured data processing described above places it in a good position to be a complementary language for Google's Dart processor because each has their strong and weak points. Documentation describing the technology used by ANSI SQL hierarchical structured data processing follows:

SQL Dynamic Structured Data Processing Collaboration Article at:
http://soa.sys-con.com/node/1875139

ANSI SQL Transparent Hierarchical Processing User Guide at: 
http://www.adatinc.com/images/Verifying_SQLfX_Current.pdf

ANSI SQL Transparent Hierarchical Processing Technology Slide Presentation at:
http://www.adatinc.com/images/Enterprise_Data_World_Presentation.pdf

Online Interactive ANSI SQL Transparent Hierarchical Processing Prototype at:
www.adatinc.com/demo.html

More Stories By Michael M David

Michael M. David is founder and CTO of Advanced Data Access Technologies, Inc. He has been a staff scientist and lead XML architect for NCR/Teradata and their representative to the SQLX Group. He has researched, designed and developed commercial query languages for heterogeneous hierarchical and relational databases for over twenty years. He has authored the book "Advanced ANSI SQL Data Modeling and Structure Processing" Published by Artech House Publishers and many papers and articles on database topics. His research and findings have shown that Hierarchical Data Processing is a subset of Relational Processing and how to utilize this advanced inherent capability in ANSI SQL. Additionally, his research has shown that advanced multipath (LCA) processing is also naturally supported and performed automatically in ANSI SQL, and advanced hierarchical processing operations are also possible. These advanced capabilities can be performed and explained in the ANSI SQL Transparent XML Hierarchical Processor at his site at: www.adatinc.com/demo.html.

@MicroservicesExpo Stories
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management solutions, helping companies worldwide activate their data to drive more value and business insight and to transform moder...
Enterprise IT has been in the era of Hybrid Cloud for some time now. But it seems most conversations about Hybrid are focused on integrating AWS, Microsoft Azure, or Google ECM into existing on-premises systems. Where is all the Private Cloud? What do technology providers need to do to make their offerings more compelling? How should enterprise IT executives and buyers define their focus, needs, and roadmap, and communicate that clearly to the providers?
SYS-CON Events announced today the Kubernetes and Google Container Engine Workshop, being held November 3, 2016, in conjunction with @DevOpsSummit at 19th Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA. This workshop led by Sebastian Scheele introduces participants to Kubernetes and Google Container Engine (GKE). Through a combination of instructor-led presentations, demonstrations, and hands-on labs, students learn the key concepts and practices for deploying and maintainin...
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
There is little doubt that Big Data solutions will have an increasing role in the Enterprise IT mainstream over time. Big Data at Cloud Expo - to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA - has announced its Call for Papers is open. Cloud computing is being adopted in one form or another by 94% of enterprises today. Tens of billions of new devices are being connected to The Internet of Things. And Big Data is driving this bus. An exponential increase is...
About a year ago we tuned into “the need for speed” and how a concept like "serverless computing” was increasingly catering to this. We are now a year further and the term “serverless” is taking on unexpected proportions. With some even seeing it as the successor to cloud in general or at least as a successor to the clouds’ poorer cousin in terms of revenue, hype and adoption: PaaS. The question we need to ask is whether this constitutes an example of Hype Hopping: to effortlessly pivot to the ...
DevOps at Cloud Expo, taking place Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long dev...
The many IoT deployments around the world are busy integrating smart devices and sensors into their enterprise IT infrastructures. Yet all of this technology – and there are an amazing number of choices – is of no use without the software to gather, communicate, and analyze the new data flows. Without software, there is no IT. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists will look at the protocols that communicate data and the emerging data analy...
All clouds are not equal. To succeed in a DevOps context, organizations should plan to develop/deploy apps across a choice of on-premise and public clouds simultaneously depending on the business needs. This is where the concept of the Lean Cloud comes in - resting on the idea that you often need to relocate your app modules over their life cycles for both innovation and operational efficiency in the cloud. In his session at @DevOpsSummit at19th Cloud Expo, Valentin (Val) Bercovici, CTO of So...
Video experiences should be unique and exciting! But that doesn’t mean you need to patch all the pieces yourself. Users demand rich and engaging experiences and new ways to connect with you. But creating robust video applications at scale can be complicated, time-consuming and expensive. In his session at @ThingsExpo, Zohar Babin, Vice President of Platform, Ecosystem and Community at Kaltura, will discuss how VPaaS enables you to move fast, creating scalable video experiences that reach your...
If you’re responsible for an application that depends on the data or functionality of various IoT endpoints – either sensors or devices – your brand reputation depends on the security, reliability, and compliance of its many integrated parts. If your application fails to deliver the expected business results, your customers and partners won't care if that failure stems from the code you developed or from a component that you integrated. What can you do to ensure that the endpoints work as expect...
SYS-CON Events announced today the Enterprise IoT Bootcamp, being held November 1-2, 2016, in conjunction with 19th Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA. Combined with real-world scenarios and use cases, the Enterprise IoT Bootcamp is not just based on presentations but with hands-on demos and detailed walkthroughs. We will introduce you to a variety of real world use cases prototyped using Arduino, Raspberry Pi, BeagleBone, Spark, and Intel Edison. Y...
With the rise of Docker, Kubernetes, and other container technologies, the growth of microservices has skyrocketed among dev teams looking to innovate on a faster release cycle. This has enabled teams to finally realize their DevOps goals to ship and iterate quickly in a continuous delivery model. Why containers are growing in popularity is no surprise — they’re extremely easy to spin up or down, but come with an unforeseen issue. However, without the right foresight, DevOps and IT teams may lo...
As applications are promoted from the development environment to the CI or the QA environment and then into the production environment, it is very common for the configuration settings to be changed as the code is promoted. For example, the settings for the database connection pools are typically lower in development environment than the QA/Load Testing environment. The primary reason for the existence of the configuration setting differences is to enhance application performance. However, occas...
When scaling agile / Scrum, we invariable run into the alignment vs autonomy problem. In short: you cannot have autonomous self directing teams if they have no clue in what direction they should go, or even shorter: Alignment breeds autonomy. But how do we create alignment? and what tools can we use to quickly evaluate if what we want to do is part of the mission or better left out? Niel Nickolaisen created the Purpose Alignment model and I use it with innovation labs in large enterprises to de...
SYS-CON Events announced today that Numerex Corp, a leading provider of managed enterprise solutions enabling the Internet of Things (IoT), will exhibit at the 19th International Cloud Expo | @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Numerex Corp. (NASDAQ:NMRX) is a leading provider of managed enterprise solutions enabling the Internet of Things (IoT). The Company's solutions produce new revenue streams or create operating...
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
While DevOps promises a better and tighter integration among an organization’s development and operation teams and transforms an application life cycle into a continual deployment, Chef and Azure together provides a speedy, cost-effective and highly scalable vehicle for realizing the business values of this transformation. In his session at @DevOpsSummit at 19th Cloud Expo, Yung Chou, a Technology Evangelist at Microsoft, will present a unique opportunity to witness how Chef and Azure work tog...
Throughout history, various leaders have risen up and tried to unify the world by conquest. Fortunately, none of their plans have succeeded. The world goes on just fine with each country ruling itself; no single ruler is necessary. That’s how it is with the container platform ecosystem, as well. There’s no need for one all-powerful, all-encompassing container platform. Think about any other technology sector out there – there are always multiple solutions in every space. The same goes for conta...
Let's recap what we learned from the previous chapters in the series: episode 1 and episode 2. We learned that a good rollback mechanism cannot be designed without having an intimate knowledge of the application architecture, the nature of your components and their dependencies. Now that we know what we have to restore and in which order, the question is how?