Click here to close now.

Welcome!

Microservices Journal Authors: Carmen Gonzalez, Liz McMillan, Roger Strukhoff, Elizabeth White, Baruch Sadogursky

Related Topics: Microservices Journal, XML

Microservices Journal: Article

A Complementary Query Language to Google’s Dart

Structured Data Query Languages

Dart is a new structured data programming language from Google. While unstructured data has become extremely useful, structured data is still extremely important because it keeps businesses running day in and day out. Programming languages still need to be coded by hand and most Google users are not programmers. To fill this large gap for most Google users who have no programming experience, a structured data query language would be very useful. Query languages operate by what data or information is wanted and not how to access or derive it. No programming is necessary to use. This is very similar to a standard Google request. This allows anyone to specify a powerful structured data query request.

How does a query request automatically operate without being instructed on how to perform the request? This is done by analyzing the semantics in the data structure. Since query languages have the ability to search out meaning, they can derive the most value out of the semantics in the data structure. The first and primary place to look for semantics is in the data structure and should not be ignored even if other types of semantics are available. This is because the data structure drives or guides the meaning of the query.

Structured data often involves hierarchical structures. Hierarchical data structures inherently have a significant amount of structure semantics. Besides having vertical semantics they have horizontal semantics where data across pathways are related. This produces very complex structures requiring complicated data structure user navigation for programming languages. Query languages on the other hand are free to perform the navigation internally without involving the user. In fact, some complex data structures are too complex to handle with user navigation within programming languages. This makes query languages indispensable in these complicated situations proving query languages unique usefulness in structured data processing. One such complex data structure processing requiring query processing are multipath queries. These require complicated coordination between multiple paths of a hierarchical data structure such as when a query selects data from one path based on data from another path.

An amazing thing happened unnoticed and unplanned in the ANSI SQL-92 standard. In this standard, the LEFT Outer Join was introduced along with other outer join capabilities. The LEFT Outer Join is a one-sided join that is hierarchical by nature. It always preserves the left side of the outer join operation allowing, for example, employee data that has no dependent data to always be preserved. A new ON clause operation allows specification of hierarchical join criteria at each join point to replace the single use SQL WHERE clause. This prevents any ambiguity in defining hierarchical data structures that occurred when using the older WHERE clause. This combination of new SQL features unexpectedly turned out to support complete hierarchical multipath data structure definition and hierarchical processing even though there was no prior design performed or coding added in ANSI SQL to support full hierarchical processing.

These powerful hierarchical data structures can also be naturally defined in SQL views which can be dynamically joined in multiple ways creating larger variable structures and perform their hierarchical processing on the fly. This concept for processing dynamically created structured data is new and opens up many powerful capabilities in structured data. It utilizes a new Dynamic Metadata Maintenance operation that allows the metadata to be transparently processed. This eliminates any metadata operation by the user to process dynamic structured data. The ANSI SQL query language is in a position to take advantage of these new dynamic structured data capabilities such as for use in peer-to-peer data collaboration.

As stated in the very beginning of this article, Dart is a programming language. This gives it great user control that requires the user to have programming experience and knowledge. But what is not generally recognized, is that some problems are just too complicated to solve under user control. They require automatic processing to handle. These can be performed by a query processor. This automatic processing also means that the user does not need programming experience to specify the query. ANSI SQL's natural hierarchical structured data processing described above places it in a good position to be a complementary language for Google's Dart processor because each has their strong and weak points. Documentation describing the technology used by ANSI SQL hierarchical structured data processing follows:

SQL Dynamic Structured Data Processing Collaboration Article at:
http://soa.sys-con.com/node/1875139

ANSI SQL Transparent Hierarchical Processing User Guide at: 
http://www.adatinc.com/images/Verifying_SQLfX_Current.pdf

ANSI SQL Transparent Hierarchical Processing Technology Slide Presentation at:
http://www.adatinc.com/images/Enterprise_Data_World_Presentation.pdf

Online Interactive ANSI SQL Transparent Hierarchical Processing Prototype at:
www.adatinc.com/demo.html

More Stories By Michael M David

Michael M. David is founder and CTO of Advanced Data Access Technologies, Inc. He has been a staff scientist and lead XML architect for NCR/Teradata and their representative to the SQLX Group. He has researched, designed and developed commercial query languages for heterogeneous hierarchical and relational databases for over twenty years. He has authored the book "Advanced ANSI SQL Data Modeling and Structure Processing" Published by Artech House Publishers and many papers and articles on database topics. His research and findings have shown that Hierarchical Data Processing is a subset of Relational Processing and how to utilize this advanced inherent capability in ANSI SQL. Additionally, his research has shown that advanced multipath (LCA) processing is also naturally supported and performed automatically in ANSI SQL, and advanced hierarchical processing operations are also possible. These advanced capabilities can be performed and explained in the ANSI SQL Transparent XML Hierarchical Processor at his site at: www.adatinc.com/demo.html.

@MicroservicesExpo Stories
The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential. The DevOps Summit at Cloud Expo – to be held June 3-5, 2015, at the Javits Center in New York City – will expand the DevOps community, enable a wide...
Enterprises are fast realizing the importance of integrating SaaS/Cloud applications, API and on-premises data and processes, to unleash hidden value. This webinar explores how managers can use a Microservice-centric approach to aggressively tackle the unexpected new integration challenges posed by proliferation of cloud, mobile, social and big data projects. Industry analyst and SOA expert Jason Bloomberg will strip away the hype from microservices, and clearly identify their advantages and d...
Cloud Expo, Inc. has announced today that Andi Mann returns to DevOps Summit 2015 as Conference Chair. The 4th International DevOps Summit will take place on June 9-11, 2015, at the Javits Center in New York City. "DevOps is set to be one of the most profound disruptions to hit IT in decades," said Andi Mann. "It is a natural extension of cloud computing, and I have seen both firsthand and in independent research the fantastic results DevOps delivers. So I am excited to help the great team at ...
There is no question that the cloud is where businesses want to host data. Until recently hypervisor virtualization was the most widely used method in cloud computing. Recently virtual containers have been gaining in popularity, and for good reason. In the debate between virtual machines and containers, the latter have been seen as the new kid on the block – and like other emerging technology have had some initial shortcomings. However, the container space has evolved drastically since coming on...
Container frameworks, such as Docker, provide a variety of benefits, including density of deployment across infrastructure, convenience for application developers to push updates with low operational hand-holding, and a fairly well-defined deployment workflow that can be orchestrated. Container frameworks also enable a DevOps approach to application development by cleanly separating concerns between operations and development teams. But running multi-container, multi-server apps with containers ...
Converging digital disruptions is creating a major sea change - Cisco calls this the Internet of Everything (IoE). IoE is the network connection of People, Process, Data and Things, fueled by Cloud, Mobile, Social, Analytics and Security, and it represents a $19Trillion value-at-stake over the next 10 years. In her keynote at @ThingsExpo, Manjula Talreja, VP of Cisco Consulting Services, will discuss IoE and the enormous opportunities it provides to public and private firms alike. She will shar...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading in...
The integration between the 2 solutions is handled by a module provided by XebiaLabs that will ensure the containers are correctly defined in the XL Deloy repository based on the information managed by Puppet. It uses the REST API offered by the XL Deploy server: so the security permissions are checked as a operator could do it using the GUI or the CLI. This article shows you how use the xebialabs/xldeploy Puppet module. The Production environment is based on 2 tomcats instances (tomcat1 &...
SYS-CON Events announced today that EnterpriseDB (EDB), the leading worldwide provider of enterprise-class Postgres products and database compatibility solutions, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. EDB is the largest provider of Postgres software and services that provides enterprise-class performance and scalability and the open source freedom to divert budget from more costly traditiona...
How can you compare one technology or tool to its competitors? Usually, there is no objective comparison available. So how do you know which is better? Eclipse or IntelliJ IDEA? Java EE or Spring? C# or Java? All you can usually find is a holy war and biased comparisons on vendor sites. But luckily, sometimes, you can find a fair comparison. How does this come to be? By having it co-authored by the stakeholders. The binary repository comparison matrix is one of those rare resources. It is edite...
With the advent of micro-services, the application design paradigm has undergone a major shift. The days of developing monolithic applications are over. We are bringing in the principles (read SOA) hereto the preserve of applications or system integration space into the application development world. Since the micro-services are consumed within the application, the need of ESB is not there. There is no message transformation or mediations required. But service discovery and load balancing of ...
Do you think development teams really update those BMC Remedy tickets with all the changes contained in a release? They don't. Most of them just "check the box" and move on. They rose a Risk Level that won't raise questions from the Change Control managers and they work around the checks and balances. The alternative is to stop and wait for a department that still thinks releases are rare events. When a release happens every day there's just not enough time for people to attend CAB meeting...
T-Mobile has been transforming the wireless industry with its “Uncarrier” initiatives. Today as T-Mobile’s IT organization works to transform itself in a like manner, technical foundations built over the last couple of years are now key to their drive for more Agile delivery practices. In his session at DevOps Summit, Martin Krienke, Sr Development Manager at T-Mobile, will discuss where they started their Continuous Delivery journey, where they are today, and where they are going in an effort ...
SYS-CON Events announced today that the "First Containers & Microservices Conference" will take place June 9-11, 2015, at the Javits Center in New York City. The “Second Containers & Microservices Conference” will take place November 3-5, 2015, at Santa Clara Convention Center, Santa Clara, CA. Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities.
Disruptive macro trends in technology are impacting and dramatically changing the "art of the possible" relative to supply chain management practices through the innovative use of IoT, cloud, machine learning and Big Data to enable connected ecosystems of engagement. Enterprise informatics can now move beyond point solutions that merely monitor the past and implement integrated enterprise fabrics that enable end-to-end supply chain visibility to improve customer service delivery and optimize sup...
Buzzword alert: Microservices and IoT at a DevOps conference? What could possibly go wrong? In this Power Panel at DevOps Summit, moderated by Jason Bloomberg, the leading expert on architecting agility for the enterprise and president of Intellyx, panelists will peel away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of our distributed cloud en...
I’ve been thinking a bit about microservices (μServices) recently. My immediate reaction is to think: “Isn’t this just yet another new term for the same stuff, Web Services->SOA->APIs->Microservices?” Followed shortly by the thought, “well yes it is, but there are some important differences/distinguishing factors.” Microservices is an evolutionary paradigm born out of the need for simplicity (i.e., get away from the ESB) and alignment with agile (think DevOps) and scalable (think Containerizati...
In this Power Panel at DevOps Summit, moderated by Jason Bloomberg, president of Intellyx, panelists Roberto Medrano, Executive Vice President at Akana; Lori MacVittie, IoT_Microservices Power PanelEvangelist for F5 Networks; and Troy Topnik, ActiveState’s Technical Product Manager; will peel away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of ...
There is no doubt that Big Data is here and getting bigger every day. Building a Big Data infrastructure today is no easy task. There are an enormous number of choices for database engines and technologies. To make things even more challenging, requirements are getting more sophisticated, and the standard paradigm of supporting historical analytics queries is often just one facet of what is needed. As Big Data growth continues, organizations are demanding real-time access to data, allowing immed...
While the DevOps movement and associated technologies have garnered much attention and fanfare, few have addressed the core issue - the hand off from development to operations. We tend to not acknowledge the importance of Release Management - a critical DevOps function. Release Management is the bridge between development and operations that needs to be strengthened with the right approach, tools, teams and processes. The white paper "How to set up an Effective Enterprise Release Management F...