Welcome!

Microservices Expo Authors: Mehdi Daoudi, Kong Yang, Carmen Gonzalez, Elizabeth White, Pat Romanski

Related Topics: Microservices Expo, Industrial IoT

Microservices Expo: Article

A Complementary Query Language to Google’s Dart

Structured Data Query Languages

Dart is a new structured data programming language from Google. While unstructured data has become extremely useful, structured data is still extremely important because it keeps businesses running day in and day out. Programming languages still need to be coded by hand and most Google users are not programmers. To fill this large gap for most Google users who have no programming experience, a structured data query language would be very useful. Query languages operate by what data or information is wanted and not how to access or derive it. No programming is necessary to use. This is very similar to a standard Google request. This allows anyone to specify a powerful structured data query request.

How does a query request automatically operate without being instructed on how to perform the request? This is done by analyzing the semantics in the data structure. Since query languages have the ability to search out meaning, they can derive the most value out of the semantics in the data structure. The first and primary place to look for semantics is in the data structure and should not be ignored even if other types of semantics are available. This is because the data structure drives or guides the meaning of the query.

Structured data often involves hierarchical structures. Hierarchical data structures inherently have a significant amount of structure semantics. Besides having vertical semantics they have horizontal semantics where data across pathways are related. This produces very complex structures requiring complicated data structure user navigation for programming languages. Query languages on the other hand are free to perform the navigation internally without involving the user. In fact, some complex data structures are too complex to handle with user navigation within programming languages. This makes query languages indispensable in these complicated situations proving query languages unique usefulness in structured data processing. One such complex data structure processing requiring query processing are multipath queries. These require complicated coordination between multiple paths of a hierarchical data structure such as when a query selects data from one path based on data from another path.

An amazing thing happened unnoticed and unplanned in the ANSI SQL-92 standard. In this standard, the LEFT Outer Join was introduced along with other outer join capabilities. The LEFT Outer Join is a one-sided join that is hierarchical by nature. It always preserves the left side of the outer join operation allowing, for example, employee data that has no dependent data to always be preserved. A new ON clause operation allows specification of hierarchical join criteria at each join point to replace the single use SQL WHERE clause. This prevents any ambiguity in defining hierarchical data structures that occurred when using the older WHERE clause. This combination of new SQL features unexpectedly turned out to support complete hierarchical multipath data structure definition and hierarchical processing even though there was no prior design performed or coding added in ANSI SQL to support full hierarchical processing.

These powerful hierarchical data structures can also be naturally defined in SQL views which can be dynamically joined in multiple ways creating larger variable structures and perform their hierarchical processing on the fly. This concept for processing dynamically created structured data is new and opens up many powerful capabilities in structured data. It utilizes a new Dynamic Metadata Maintenance operation that allows the metadata to be transparently processed. This eliminates any metadata operation by the user to process dynamic structured data. The ANSI SQL query language is in a position to take advantage of these new dynamic structured data capabilities such as for use in peer-to-peer data collaboration.

As stated in the very beginning of this article, Dart is a programming language. This gives it great user control that requires the user to have programming experience and knowledge. But what is not generally recognized, is that some problems are just too complicated to solve under user control. They require automatic processing to handle. These can be performed by a query processor. This automatic processing also means that the user does not need programming experience to specify the query. ANSI SQL's natural hierarchical structured data processing described above places it in a good position to be a complementary language for Google's Dart processor because each has their strong and weak points. Documentation describing the technology used by ANSI SQL hierarchical structured data processing follows:

SQL Dynamic Structured Data Processing Collaboration Article at:
http://soa.sys-con.com/node/1875139

ANSI SQL Transparent Hierarchical Processing User Guide at: 
http://www.adatinc.com/images/Verifying_SQLfX_Current.pdf

ANSI SQL Transparent Hierarchical Processing Technology Slide Presentation at:
http://www.adatinc.com/images/Enterprise_Data_World_Presentation.pdf

Online Interactive ANSI SQL Transparent Hierarchical Processing Prototype at:
www.adatinc.com/demo.html

More Stories By Michael M David

Michael M. David is founder and CTO of Advanced Data Access Technologies, Inc. He has been a staff scientist and lead XML architect for NCR/Teradata and their representative to the SQLX Group. He has researched, designed and developed commercial query languages for heterogeneous hierarchical and relational databases for over twenty years. He has authored the book "Advanced ANSI SQL Data Modeling and Structure Processing" Published by Artech House Publishers and many papers and articles on database topics. His research and findings have shown that Hierarchical Data Processing is a subset of Relational Processing and how to utilize this advanced inherent capability in ANSI SQL. Additionally, his research has shown that advanced multipath (LCA) processing is also naturally supported and performed automatically in ANSI SQL, and advanced hierarchical processing operations are also possible. These advanced capabilities can be performed and explained in the ANSI SQL Transparent XML Hierarchical Processor at his site at: www.adatinc.com/demo.html.

@MicroservicesExpo Stories
A Man in the Middle attack, or MITM, is a situation wherein a malicious entity can read/write data that is being transmitted between two or more systems (in most cases, between you and the website that you are surfing). MITMs are common in China, thanks to the “Great Cannon.” The “Great Cannon” is slightly different from the “The Great Firewall.” The firewall monitors web traffic moving in and out of China and blocks prohibited content. The Great Cannon, on the other hand, acts as a man in the...
To more closely examine the variety of ways in which IT departments around the world are integrating cloud services, and the effect hybrid IT has had on their organizations and IT job roles, SolarWinds recently released the SolarWinds IT Trends Report 2017: Portrait of a Hybrid Organization. This annual study consists of survey-based research that explores significant trends, developments, and movements related to and directly affecting IT and IT professionals.
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Val...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor – all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
Is your application too difficult to manage? Do changes take dozens of developers hundreds of hours to execute, and frequently result in downtime across all your site’s functions? It sounds like you have a monolith! A monolith is one of the three main software architectures that define most applications. Whether you’ve intentionally set out to create a monolith or not, it’s worth at least weighing the pros and cons of the different architectural approaches and deciding which one makes the most s...
Enterprise architects are increasingly adopting multi-cloud strategies as they seek to utilize existing data center assets, leverage the advantages of cloud computing and avoid cloud vendor lock-in. This requires a globally aware traffic management strategy that can monitor infrastructure health across data centers and end-user experience globally, while responding to control changes and system specification at the speed of today’s DevOps teams. In his session at 20th Cloud Expo, Josh Gray, Chie...
Cloud Expo, Inc. has announced today that Aruna Ravichandran, vice president of DevOps Product and Solutions Marketing at CA Technologies, has been named co-conference chair of DevOps at Cloud Expo 2017. The @DevOpsSummit at Cloud Expo New York will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and @DevOpsSummit at Cloud Expo Silicon Valley will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Cloud promises the agility required by today’s digital businesses. As organizations adopt cloud based infrastructures and services, their IT resources become increasingly dynamic and hybrid in nature. Managing these require modern IT operations and tools. In his session at 20th Cloud Expo, Raj Sundaram, Senior Principal Product Manager at CA Technologies, will discuss how to modernize your IT operations in order to proactively manage your hybrid cloud and IT environments. He will be sharing be...
When you decide to launch a startup company, business advisors, counselors, bankers and armchair know-it-alls will tell you that the first thing you need to do is get funding. While there is some validity to that boilerplate piece of wisdom, the availability of and need for startup funding has gone through a dramatic transformation over the past decade, and the next few years will see even more of a shift. A perfect storm of events is causing this seismic shift. On the macroeconomic side this ...
This recent research on cloud computing from the Register delves a little deeper than many of the "We're all adopting cloud!" surveys we've seen. They found that meaningful cloud adoption and the idea of the cloud-first enterprise are still not reality for many businesses. The Register's stats also show a more gradual cloud deployment trend over the past five years, not any sort of explosion. One important takeaway is that coherence across internal and external clouds is essential for IT right n...
Back in February of 2017, Andrew Clay Schafer of Pivotal tweeted the following: “seriously tho, the whole software industry is stuck on deployment when we desperately need architecture and telemetry.” Intrigue in a 140 characters. For me, I hear Andrew saying, “we’re jumping to step 5 before we’ve successfully completed steps 1-4.”
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, will discuss how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He will discuss how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
In large enterprises, environment provisioning and server provisioning account for a significant portion of the operations team's time. This often leaves users frustrated while they wait for these services. For instance, server provisioning can take several days and sometimes even weeks. At the same time, digital transformation means the need for server and environment provisioning is constantly growing. Organizations are adopting agile methodologies and software teams are increasing the speed ...
Developers want to create better apps faster. Static clouds are giving way to scalable systems, with dynamic resource allocation and application monitoring. You won't hear that chant from users on any picket line, but helping developers to create better apps faster is the mission of Lee Atchison, principal cloud architect and advocate at New Relic Inc., based in San Francisco. His singular job is to understand and drive the industry in the areas of cloud architecture, microservices, scalability ...
Software as a service (SaaS), one of the earliest and most successful cloud services, has reached mainstream status. According to Cisco, by 2019 more than four-fifths (83 percent) of all data center traffic will be based in the cloud, up from 65 percent today. The majority of this traffic will be applications. Businesses of all sizes are adopting a variety of SaaS-based services – everything from collaboration tools to mission-critical commerce-oriented applications. The rise in SaaS usage has m...
The proper isolation of resources is essential for multi-tenant environments. The traditional approach to isolate resources is, however, rather heavyweight. In his session at 18th Cloud Expo, Igor Drobiazko, co-founder of elastic.io, drew upon his own experience with operating a Docker container-based infrastructure on a large scale and present a lightweight solution for resource isolation using microservices. He also discussed the implementation of microservices in data and application integrat...
We'd all like to fulfill that "find a job you love and you'll never work a day in your life" cliché. But in reality, every job (even if it's our dream job) comes with its downsides. For you, the constant fight against shadow IT might get on your last nerves. For your developer coworkers, infrastructure management is the roadblock that stands in the way of focusing on coding. As you watch more and more applications and processes move to the cloud, technology is coming to developers' rescue-most r...
2016 has been an amazing year for Docker and the container industry. We had 3 major releases of Docker engine this year , and tremendous increase in usage. The community has been following along and contributing amazing Docker resources to help you learn and get hands-on experience. Here’s some of the top read and viewed content for the year. Of course releases are always really popular, particularly when they fit requests we had from the community.