IT Skills which pay really really GOOD! – a brief comparison
Wed, 30/06/10 – 7:30 | 7 Comments

We definitely know that Information Technology (IT)  is here and even getting bigger and much more exciting than ever before in human history. The fact that several companies these days are raising bar and budget …

Read the full story »
More posts from this section »
More posts from this section »
Business Intelligence and DataWarehousing Concepts

Business Intelligence and DataWarehousing Concepts

Business, Economics and Money Making

Articles relating to business, economics, and all about money matters

Computer Tips & Tricks

all about the coolest tricks and tips on computers

IBM DB2, Lotus Notes, Cognos

IBM, DB2, Lotus Notes, Cognos

Wordpress, Blogging and Useful Stuffs

Wordpress, Blogging and Useful Stuffs

Business Intelligence and DataWarehousing Concepts, Codes and Scripts, Computer Tips & Tricks, IBM DB2, Lotus Notes, Cognos »

Using Talend Studio DI as ETL Tool for Lotus Notes Domino Database
Mon, 3/04/17 – 13:47 | No Comment

Using Talend Studio DI as ETL Tool for Lotus Notes Domino Database

I haven’t done much writing for a while but that doesn’t mean I am dead – literally and figuratively! LOL. I guess am just busy exploring, maybe traveling around to different cities, venturing into business and attending to personal stuffs that I forgot to pause and write some fascinating discoveries. Well that’s a different story. But then, here I am. Still alive and writing. Happy New Year 2017! 🙂

So while I was away for ‘ages’, there were lots of discoveries that I wanted to share. One of which is the tool called Talend Studio for Data Integration.

I’m still a Cognos Aficionado, by the way, and Cognos Data Manager is definitely a great tool but because of licensing issues we got in the office I was compelled to use or look for another ETL tool. Definitely an open source this time around, i told to myself. Well lucky enough, I found 2 great ETL tools worthy of my time to explore i.e. Pentaho Kettle and Talend Studio DI. Both of which are salubrious enough to solve any ETL related tasks including connectivity between traditional and non-traditional databases. More than that, it has connectors especially designed for IBM Lotus Notes Domino Databases. For this post, I am leaning towards the Talend Studio DI. It has a lot of cool and promising features which i am looking forward to in their next releases not to mention their seamless integration to java technology. Somehow the User Interface of Talend Studio DI is somewhat ‘eclipse’ like which am pretty sure this can be integrated to eclipse platform as a separate window perspective.

Download Talend and tnotesinput connectors from Talend Exchange

Download them here

https://www.talend.com/download/

Initial Setup:

Install our components in a new directory under your Talend directory.

In Windows -> Preferences -> Talend -> Components, change the User Component path to your extracted path.

tNotesInput – Reads data from a View (or @Function Select formula) and exposes as rows within Talend IDE.
tNotesOutput – Write data to a database (Inserts and Updates). You need a key to be able to use the Update function.
tNotesRunAgent – Runs a background agent in Lotus Notes Domino
For tNotesInput to work, you need to load the Notes.jar library. This file is available from either the Client or the Server. So, your first component in your job should be tLibraryLoad, which will declare Notes.jar
Configuring tNotesInput:

DIIOP – Allows you to bypass the local Client and instead execute remote instructions to the server. Minimizes the footprint on the client, but slows down processing. This option is necessary if you are working in 64-bit client environments.

Set the iNotes user id and password if you use DIIOP. Also, specify your server address for the DIIOP port. If you are using a local copy of the nsf database, just leave this blank.

Use the local client Password (current .ID file) if you do not use DIIOP

Domino Server & File/Path Name – Server can be local (leave as “”), or enter the server name here. File/Path should use forward slashes (like in the example)

ViewName – The name of the view you will “read”. Alternatively, you can select the @Formula checkbox. When checked, you can specify a Lotus Notes Select formula instead of a view (return a NotesDocumentCollection).

ReverseIndex – Read from the bottom of the View (or Collection) instead of the top.

# Docs To Return – Leave ALL if you want all docs in the view. Otherwise, specify the limit (integer).

Schema: The schema needs to be declared (since every notes entity can have unlimited fields). To do so, please review the following picture. IT shows an example schema for an Email message in Notes. Note how you can override Field names (Db Column) with an @Function formula placed in the Comment box.

Please click the image to enlarge

TalendLotusNotesDomino

 

Updates:

I am using Talend MDM Studio 6 version.  This is a better version than the Talend Data Integration 5.0. Talend 6 uses Java 1.8 version, so you may want to install java version 8 before you upgrade to Talend 6.

 

For more information, feel free to browse over the Techronnati boards

 
 
Why recents posts are not getting into my Feedburner?
Sun, 5/09/10 – 19:29 | No Comment
Why recents posts are not getting into my Feedburner?

It took me several days before I actually figured it out myself what went wrong with my feedburner. I was wondering why all this time my feeds  suddenly stopped its stream going to social network sites like …

Upgrading to WordPress 3.0
Sat, 26/06/10 – 13:25 | No Comment
Upgrading to WordPress 3.0

I’m excited to announce to everyone that Techronnati Blog, your ultimate resource to technology, business intelligence, collaboration and programming  is now  running on WordPress 3.0, the latest WordPress version as of today!
WordPress 3.0 aka Thelonious ,  is the …

Embarking on Information and Communications Technology (ICT) in the Philippine May 2010 Elections
Sat, 8/05/10 – 11:18 | 10 Comments
Embarking on Information and Communications Technology (ICT) in the Philippine May 2010 Elections

May-ten-twenty-ten (translation: May 10 ,2010) marks the official and national automated elections in the Philippines. Thanks to the stalwart and resilient effort of  the current administration and to the COMELEC for pushing this Information and Communications Technology …

How I got started with IBM Lotus Notes Domino Programming
Sun, 11/04/10 – 22:11 | 3 Comments
How I got started with IBM Lotus Notes Domino Programming

My career started roughly 8 years ago when i was hunting for an entry level job in 2001. Although many would have expected me to become a Math teacher, a Researcher, or Operations Analyst, since …

SQL Loader Error?
Sun, 7/02/10 – 18:22 | 2 Comments
SQL Loader Error?

The other day, I was attempting to load data coming from the Mainframe thru ftp server using Oracle sqlloader but while doing so i temporarily loss my consciousness because of this error.
The procedure entry point …

Happy 2010 to all Techronnati Readers!
Thu, 31/12/09 – 11:45 | One Comment
Happy 2010 to all Techronnati Readers!

As the current year draws to a close, i would like to extend my greetings to all Techronnati Readers who have remained loyal despite several months of my invisibility. The Year 2009 was undoubtedly a …

Windows 7 shows a promise
Thu, 10/12/09 – 18:07 | 3 Comments
Windows 7 shows a promise

I can’t believe it! Windows 7 can actually run to my old ACER laptop!
Yep, it’s not a typo thing but i guess you heard me right.
Let’s face it. Not everyone has decided to upgrade to …

Adding comment(s) in Cognos 8 Reportnet
Fri, 28/08/09 – 19:17 | 2 Comments
Adding comment(s) in Cognos 8 Reportnet

Two weeks ago, i was researching about how to place some comments in Cognos 8 Reportnet. I have lots of validation in my report layout hence the need to add program comments is as beneficial …

Thank you for visiting Techronnati.com. I hope you enjoy your stay. =)
Close Box