Skip to main content

JCA Container Integration, Why Teiid needs it? - Part 1

A huge architectural change for the Teiid runtime is upcoming up in Teiid 7.0 release. Teiid is being integrated into a JCA container - JBossAS 5.1.0 GA. In this new platform you can expect all the data integration features of Teiid with power and flexibility of JBossAS.

If you are thinking, Teiid is a relational data integration engine what does it has to do with a JEE container? This has little do with Web technologies. It is all about JCA (Java Connector Architecture) and the advanced development features of JBossAS. Let me explain each reason in a multi-part series of articles.

Reason 1: Right ingredients. Integrate with modules designed by the domain experts.

Even though Teiid is a data integration engine, the inner runtime workings of Teiid apart from the command parsing, relational planner and optimization engine are much more similar to any enterprise server application. Like security, user management, resource management, log management, caching, availability, scalability, reliability. How about the usage of current day's POJO based IOC containers, Management APIs and various tools associated with them? Over the past 7~8 years of MetaMatrix/Teiid development all of these features were home grown per customer need. However many of these features were not developed per industry standards since no relevant standards existed at the time nor did customers demand standards compliance. As a result Teiid has ended up with tens and thousands of lines to code to replicate what has become common container functionality. The Teiid Team claims to be experts in the data integration arena and leveraging an alternative runtime platform allows us to maintain a sharper focus.

Not coincidentally the JBoss AS 5 platform, built using the highly extensible and feature rich Microcontainer environment/framework, provides not only a JCA container, but a POJO based service framework with dependency injection, AOP, virtual file system, deployer and management frameworks which are ideal for developing robust software. JBoss AS is also a vibrant and exciting community ready to help with any issues. So, for Teiid we choose Microcontainer as the underlying framework to redesign Teiid's service components and JBoss AS host environment.

This will not only dramatically reduce the code foot print of Teiid, but will leverage a wealth of existing documentation and knowledge around utilizing JBoss AS, Microcontainer, and JCA. We still however did not talk in-depth about the JCA container part of it - that will be coming up in the next article.

Ramesh..

Comments

  1. Nice!
    Can you point me to MC pieces for a quick peek of what you've been doing? :-)

    -Ales

    ReplyDelete
  2. Thanks Ales.

    The work is still in progress, but you can see deployer work here

    http://anonsvn.jboss.org/repos/teiid/branches/JCA/jboss-integration/src/main/java/org/teiid/jboss/deployers/

    http://anonsvn.jboss.org/repos/teiid/branches/JCA/runtime/src/main/java/org/teiid/deployers/

    The Teiid services are also updated as MC pojo beans and that configuration can be seen here

    http://anonsvn.jboss.org/repos/teiid/branches/JCA/build/kit-jboss-container/

    Also, we have been using the management api & profile service to manage these artifacts.

    Ramesh..

    ReplyDelete

Post a Comment

Popular posts from this blog

Tech Tip: Teiid SQL Language MAKEDEP Hint Explained

In this article I will explain what a MAKEDEP hint is, how and when, why it should be used in Teiid. What: MAKEDEP is query hint.  When a query hint is defined in the SQL query it influences the Teiid query planner to optimize the query in a way that is driven by the user. MAKEDEP means "make this as a dependent join". What is a Dependent Join? For example if we have query like: SELECT * FROM X INNER JOIN Y ON X.PK = Y.FK Where the data for X, and Y are coming from two different sources like Oracle and WebService in Teiid, so in relational algebra you can represent above query as Here the result tuples from node X and node Y are being simultaneously fetched by Teiid query engine, then it joins the both the results inside Teiid engine based on the specified X.PK = Y.PK condition and returns the filtered resulted to the user. simple.. Now, what if, if X table has 5 rows and Y table has 100K rows? In order to do the JOIN naively Teiid need sto read all the 5

Teiid 8.11 Beta1 and 8.10.1 Released

Teiid 8.11 Beta1 is now available from the  downloads  and maven.  Feature highlights since Alpha2 include: TEIID-3434 More caching control over ttls in the result set cache down to the schema/table level. TEIID-3412 MS Access support via the UCanAccess driver. The UCanAccess support is necessary for those running on Java 1.8 as the JDBC ODBC bridge has been removed from the JRE. The waiting continues on EAP 6.4 Alpha1 - it still should be available shortly and should be the platform target for Teiid 8.11 Beta2. Of course, let us know if you find any issues with these early releases.  There's still plenty of time to get fixes into the final release. Teiid 8.10.1 is also available.  It addresses 5 important issues discovered since 8.10 was released: [ TEIID-3409 ] - PostgreSQLExecutionFactory TranslatorProperty annotation in wrong place [ TEIID-3437 ] - Inconsistencies with row count handling [ TEIID-3438 ] - Null value returned from BlobImpl

Teiid 8.13.3 Released

Teiid 8.13.3 is now  available .  In total 8.13.3 addresses 10 issues since 8.13.2: [ TEIID-4028 ] - adding salesforce-34 resource adapter does not work through the cli [ TEIID-4066 ] - Odata translator ClassNotFoundException: com.sun.ws.rs.ext.RuntimeDelegateImpl [ TEIID-4070 ] - Issues with resource adapters with api modules in wildfly [ TEIID-4089 ] - Teiid JDBC driver does not reset the update count when calling getMoreResults(int) [ TEIID-4093 ] - OData authentication fails with NPE when gss-pattern related properties are included in VDB [ TEIID-4096 ] - AssertionError with independent side of a dependent join that has an ordered limit [ TEIID-3050 ] - allow for more incremental insert with iterator [ TEIID-4075 ] - Netezza translator to support common table expressions [ TEIID-4098 ] - Always preserve columns order in google spreadsheets models [ TEIID-4046 ] - OData - $skip is beeing ignor