Skip to main content

Integrate Apache Solr search results with enterprise data with Teiid

Apache Solr is a full text search engine built on top of Apache Lucene for indexing and searching any data contents. This is been widely used by many organisations for their searching needs.

Typically when a user wants to use Apache Solr, they will configure an instance of Apache Solr or SolrCloud with relevant indexing fields and publish all their data/documents that instance to be indexed. Once the documents are indexed, they can use Solr APIs to search the documents and use it for their purposes. This is where I believe Teiid can help ease the uploading of the enterprise data and with integration of search results with other data sources.

Starting with Teiid 8.7.Alpha1, Teiid provides translator for Apache Solr. Using this translator, user can 

  1. Continually add/update the documents in the search system from other sources automatically.
  2. If the search fields are stored in Solr system, this can be used as very low latency data retrieval for serving high traffic applications
  3. Solr translator be used as fast full text search, where the Solr document only contained the index information, then use the results as inverted index to gather target full documents from the other enterprise sources such as RDBMS, Web Service, SalesForce etc, all in single client call transparently with out any coding.
To illustrate this integration in an example I wrote this article, please read on.. Integrate Apache Solr with Teiid

Let us know if you have any comments or questions in Teiid forums.

Thanks.

Ramesh..

Comments

Popular posts from this blog

Access Teiid from node.js

Are you writing a "node.js" application and would like to access Teiid VDB from it? If "yes", this is currently possible using NPM package "pg" .  Since, Teiid supports the PG transport, you can use this PostgreSQL client for "node.js" for accessing the Teiid. For example if you have VDB called "northwind" deployed on your Teiid server, and it has table called "customers" and you are using default configuration such as user = 'user' password = 'user' host = 127.0.0.1 port = 35432 then you can use following to write simple access program to Teiid var pg = require('pg'); var connectionString = "pg://user:user@localhost:35432/northwind" pg.connect(connectionString, function(err, client) { client.query('SELECT CustomerID, ContactName, ContactTitle FROM Customers', function(err, result) { console.log(result.rows) }); }); If you want ...

Teiid 8.13.3 Released

Teiid 8.13.3 is now  available .  In total 8.13.3 addresses 10 issues since 8.13.2: [ TEIID-4028 ] - adding salesforce-34 resource adapter does not work through the cli [ TEIID-4066 ] - Odata translator ClassNotFoundException: com.sun.ws.rs.ext.RuntimeDelegateImpl [ TEIID-4070 ] - Issues with resource adapters with api modules in wildfly [ TEIID-4089 ] - Teiid JDBC driver does not reset the update count when calling getMoreResults(int) [ TEIID-4093 ] - OData authentication fails with NPE when gss-pattern related properties are included in VDB [ TEIID-4096 ] - AssertionError with independent side of a dependent join that has an ordered limit [ TEIID-3050 ] - allow for more incremental insert with iterator [ TEIID-4075 ] - Netezza translator to support common table expressions [ TEIID-4098 ] - Always preserve columns order in google spreadsheets models [ TEIID-4046 ] - OData - $skip is bee...

Teiid 8.13.2 Released

Teiid 8.13.2 is now  available .  Note TEIID-4017 is an important security fix.  It is recommended that anyone running 8.12.x or 8.13.x upgrade to 8.13.2.  In total 8.13.2 addresses 27 issues since 8.13.1: [ TEIID-3872 ] - Error with odata entity create with generated keys [ TEIID-3975 ] - 8.13+ Teiid Client should work on JRE 1.6 [ TEIID-3978 ] - Remove AddressWrapper [ TEIID-3979 ] - Teiid generates queries containing VARCHAR without a size, causing an HSQL syntax error [ TEIID-3980 ] - NPE with Salesforce retrieve query and no matching entity [ TEIID-3981 ] - Salesforce-34 connector dependency on "com.force.api" is wrong [ TEIID-3983 ] - External Materialization MATVIEW_ONERROR_ACTION WAIT problem [ TEIID-3989 ] - PartialResultsWarning not being returned [ TEIID-3990 ] - Issues with nested correlated references [ TEIID-3993 ] - Teiid: indexOutOfBoundsException on union + ...