Tuesday, January 30, 2018

Data Integration for Java Developers - Introducing "Teiid Spring Boot"

Are you trying to integrate data from a REST web service with a data in your legacy RDBMS database?  How about data from Excel or CSV file,  JSON,  XML, MongoDB contents? As Java developers we know how to read the data from these sources and how to stitch data together, all it takes some boilerplate code right?

How about running some filters on that data, working with data type incompatibilities between data sources like converting a string type to decimal, doing aggregations like grouping the records by certain parameters and finally exposing it as REST service and you got 30 minutes do it?

If you have NOT heard about Teiid (t-ee-d) before, this software is exactly what it is designed to do. It has many more features, but let's focus on Data Integration feature. One of the basic features of Teiid is to provide ways to integrate data from multiple disparate sources where it knows how to work with data type incompatibilities and provides a relational data engine that can plan a very optimized query to fetch only the data that you are interested in and let you combine data with the power of SQL.  

If you have used Teiid before, you may have configured data sources in WildFly Server and designed Virtual Databases using Designer or Dynamic VDBs with DDL and deployed them into Teiid Server and used JDBC from your Java application to query it. 

Now, there is completely a "new" way to approach the problem with simplified options for Java developers. No more VDBs or Servers etc.

We are introducing a brand new sub-project called "Teiid Spring Boot" for Java developers which unleashes the same power and flexibility of Teiid's Data Integration and Virtualization features while harnessing the power of Spring Boot where using the conventions over configuration makes it developing an application much much more simple.

There are no lengthy APIs to learn if you are familiar with JPA and Spring Boot based programming, and SQL you already know most of it. The rest of the Teiid's Data Integration techniques that are defined using Java Annotations on the Entity you defined. For example, here are typical steps involved

  • Define the data source(s) and provide the configuration parameters such as connection URL, username, password as Spring requires. 
  • Write a JPA Entity (View) that you like to expose to your application
  • Decorate JPA Entity with additional Teiid specific Java Annotation and provide any SQL based integration logic as needed based on data source created.
  • Use Spring Data API query your Entity model you created.
If you are ready to take to this for spin take a look at this example where data from two different Postgres databases are being integrated and shown in the single Entity.

This is especially exciting new framework if you are developing Spring Boot based Microservices and need to integrate with your legacy RDBMS but at the same time not compromise on database per service. More on this later in future blogs.

I encourage take 15 minutes and take it for a spin.


Friday, January 26, 2018

Teiid 10.1 Released

We are pleased to announce the release of Teiid 10.1.0.  This was a shorter that usual release cycle, but that should become the new normal. See all 72 issues addressed.  The feature highlight are:
  • TEIID-5161 Broader pushdown of the RAND function.
  • TEIID-5134 The -final designation has been dropped from major/minor releases, and weekly snapshots have replaced preview releases.
  • TEIID-5201 NpgSQL client query support.
  • TEIID-5222 General array type conversion.
  • TEIID-5212 Additional optimization of join order with left outer joins.
Other Important Stuff:
  • OsiSoft Pi support is now robust and should be suitable for most integration scenarios.
  • Teiid 10.0.3 and 9.3.7 will be available in about 2 weeks. 9.3.7 will likely be the last release on the 9.3 line.
Special thanks to the many community members who contributed to this release.  In particular dalex dalex, Aditi Patel, Divyesh Vallabh, El Fuego who identified several important issues each.

Thank you,
The Teiid Team

Tuesday, January 9, 2018

Teiid 10.0.2 Released

Teiid 10.0.2 has been released.  It resolves 13 issues:
  • [TEIID-5176] - Postgresql ODBC driver converts {fn CONCAT()} calls to a "textcat()" function
  • [TEIID-4851] - Random errors about PostGIS without using it
  • [TEIID-5164] - Infinispan hotrod translator aggregate functions issues
  • [TEIID-5168] - PrestoDB translator - Convert to float not pushed correctly
  • [TEIID-5178] - doc formatting issues
  • [TEIID-5183] - NPE in Swagger translator
  • [TEIID-5184] - Clob not supported in dynamic VDB
  • [TEIID-5186] - NPE in QueryResolver when calling virtual procedure
  • [TEIID-5189] - Empty XmlElement throws an NPE when passed for the non-nullable parameter
  • [TEIID-5198] - Procedure names containing . do not resolve properly
  • [TEIID-5199] - Infinispan hotrod translator correlated subquery with where criteria issue
  • [TEIID-5200] - INSERT INTO query fails in BEGIN ATOMIC block if data is obtained from atomic procedure which catches some exception
  • [TEIID-5204] - NOW() is calculated several times for SYS tables
10.1 is expected in about 2 weeks.  For anyone already using the PI translator, please pick up the latest snapshot as there have been quite a few fixes.


Wednesday, January 3, 2018

Teiid 9.3.6 Released

Happy New Year to everyone!  After an end of year slow down, Teiid 9.3.6 has been released.  It resolves 11 issues:
  • [TEIID-4851] - Random errors about PostGIS without using it
  • [TEIID-5027] - Translator infinispan-hotrod incorrect data type import
  • [TEIID-5153] - RAND function gives same results in view
  • [TEIID-5164] - Infinispan hotrod translator aggregate functions issues
  • [TEIID-5171] - Forward navigation of expand returns wrong results.
  • [TEIID-5172] - Missing message for key "TEIID31262"
  • [TEIID-5173] - Swagger API mixup
  • [TEIID-5183] - NPE in Swagger translator
  • [TEIID-5184] - Clob not supported in dynamic VDB
  • [TEIID-5189] - Empty XmlElement throws an NPE when passed for the non-nullable parameter
  • [TEIID-5198] - Procedure names containing . do not resolve properly
Expect a Teiid 10.1 in a couple of weeks.