Skip to main content

By clicking Submit, you agree to the developerWorks terms of use.

The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

All information submitted is secure.

  • Close [x]

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerworks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

By clicking Submit, you agree to the developerWorks terms of use.

All information submitted is secure.

  • Close [x]

Semantic search in IBM OmniFind Enterprise Edition, Part 2: Semantic search with UIMA and OmniFind

Create, deploy, and search custom text analysis in IBM OmniFind Enterprise Edition 8.4

Michael Baessler (mbaessle@de.ibm.com), Software Engineer, IBM
Michael Baessler
Since joining the IBM in 2003, Michael Baessler works in the Enterprise Search Development team located in Boeblingen, Germany. Michael works on the integration of the Unstructured Information Management Architecture (UIMA) into OmniFind. Within OmniFind UIMA is used for the base linguistic analysis and enables customers to plug in custom analysis components. Besides his development effort for OmniFind Michael also works on new features and requirements for the UIMA framework itself.
Andrea Elias (baader@de.ibm.com), Software Engineer, IBM
Andrea Elias
Andrea Elias joined IBM in 2000 and has worked on several projects related to text search since. She is currently responsible for document parsing and custom dictionary creation in the Enterprise Search Development team. Andrea Elias graduated in Computer Scientist from Technical University Aachen (RWTH).
Thilo Goetz (tgoetz@de.ibm.com), Software Engineer, IBM
Thilo Goetz
Thilo Goetz joined IBM Watson Research in 1997, where he worked on various projects related to text analysis. In 2003, he moved to the IBM development lab in Germany, joining the group that develops OmniFind and UIMA. He has been a UIMA developer since its inception and is currently helping to establish UIMA as an Apache project.
Sebastian Nelke (snelke@de.ibm.com), OmniFind and UIMA developer, IBM
Sebastian Nelke photo
Sebastian Nelke is a software developer working for the Enterprise Search Development team in IBM's Development Lab in Boeblingen, Germany. Sebastian joined IBM in March 2005 after he participated in IBM's "Extreme Blue" program during summer 2004. You can reach Sebastian Nelke at snelke@de.ibm.com. Comments and further suggestions about this tutorial are welcome.

Summary:  Walk through an end-to-end scenario for creating and deploying custom text analysis in IBM® OmniFind™ Enterprise Edition 8.4. Find out everything you need to know from writing and testing a UIMA annotator, deploying it in OmniFind, and creating semantic search queries, to writing a custom search application for your custom content. Along the way, find pointers to other documentation and discover common traps and pitfalls. Be sure to check out the rest of this series as well.

View more content in this series

Date:  21 Dec 2006
Level:  Intermediate PDF:  A4 and Letter (678 KB | 40 pages)Get Adobe® Reader®

Activity:  11071 views
Comments:  

Before you start

Introduction

IBM OmniFind Enterprise Edition (henceforth: OmniFind) is more than a simple text search engine. You can use OmniFind to build powerful, so-called semantic search applications with little effort. Using IBM's open-source text analysis platform UIMA (Unstructured Information Management Architecture), you can add your own custom text analysis to the OmniFind indexing process. In a search application, you can use an XML metaphor to search for the semantic content your custom analysis has discovered.

This tutorial is a step-by-step introduction to the fascinating world of semantic search with UIMA and OmniFind. This tutorial starts at the beginning with the installation of the UIMA tooling you need for developing your custom analysis, then writing and deploying an annotator in OmniFind, right up to writing a custom semantic search application.

Please note that this tutorial covers version 8.4 of OmniFind. However, virtually all of this tutorial applies to OmniFind 8.3 as well. This tutorial points out any significant differences along the way.


Prerequisites

You need a working installation of OmniFind 8.4. This tutorial does not cover the installation of OmniFind. Please see the OmniFind installation guide for more information. This tutorial makes no assumptions about the OS platform OmniFind is installed on -- this tutorial should work for all platforms.

Before you can get your hands dirty writing custom text analysis, you need to install the UIMA development tooling and the OmniFind base annotators on a development machine. Please note that there are sometimes undesirable interferences between the UIMA SDK and an OmniFind installation, particularly on Windows. We therefore recommend not installing the UIMA SDK on your OmniFind server.

The next section of this tutorial, "Installing the necessary software," describes where to get and how to install the correct version of UIMA and the UIMA development tools. Please make sure to use the right version of UIMA to go with OmniFind 8.4.

1 of 19 | Next

Comments



Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Information Management
ArticleID=185224
TutorialTitle= Semantic search in IBM OmniFind Enterprise Edition, Part 2: Semantic search with UIMA and OmniFind
publish-date=12212006
author1-email=mbaessle@de.ibm.com
author1-email-cc=
author2-email=baader@de.ibm.com
author2-email-cc=
author3-email=tgoetz@de.ibm.com
author3-email-cc=
author4-email=snelke@de.ibm.com
author4-email-cc=

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere).

My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Try IBM PureSystems. No charge.