Skip to main content

By clicking Submit, you agree to the developerWorks terms of use.

The first time you sign into developerWorks, a profile is created for you. Select information in your developerWorks profile is displayed to the public, but you may edit the information at any time. Your first name, last name (unless you choose to hide them), and display name will accompany the content that you post.

All information submitted is secure.

  • Close [x]

The first time you sign in to developerWorks, a profile is created for you, so you need to choose a display name. Your display name accompanies the content you post on developerworks.

Please choose a display name between 3-31 characters. Your display name must be unique in the developerWorks community and should not be your email address for privacy reasons.

By clicking Submit, you agree to the developerWorks terms of use.

All information submitted is secure.

  • Close [x]

Select a language:

  • Close [x]
  • Close [x]

Semantic search in WebSphere II OmniFind Edition: Deploy a semantic search solution

Thomas Hampp (thomas.hampp@de.ibm.com), Senior Software Engineer, EMC
Thomas Hampp photo
Thomas Hampp is a leading expert on Text Analysis in the IBM Software Group, with a special focus on text analysis, text mining, and language processing. He has been working in these areas for several years, both in IBM research and development. During his years in research, he developed and patented the first version of a text analysis framework that has now developed into UIMA. He is a member of the architecture boards for UIMA, WebSphere II OmniFind, and Content Management. His current responsibility is defining and extending the integration architecture of UIMA into OmniFind.
Alexander Lang (alexlang@de.ibm.com), Software Engineer, EMC
Author2 photo
Since he joined IBM in 2000, Alexander Lang has worked on several IBM products in the areas of content management, search, and text analysis. For the current release, he developed the mapping of UIMA annotations to semantic search index structures, and led the team to support customer-defined synonyms for search terms. Besides his architecture and team leadership responsibilities, he works with customers and IBMers to identify the right mix of text analysis involved in custom semantic search solutions, and is investigating the use of taxonomies and ontologies in text search.

Summary:  Learn how to configure and deploy a semantic search solution using WebSphere® Information Integrator OmniFind Edition 8.2.2. This tutorial includes some pre-built text analysis steps, based on the Unstructured Information Management Architecture (UIMA) SDK. Based on a user scenario, you will deploy these steps into the OmniFind processing flow, and set up the configuration necessary to enable semantic search. Each step of the totorial includes sample queries that show the added value of semantic search over traditional keyword search.

View more content in this series

Date:  04 Aug 2005
Level:  Intermediate
PDF:  A4 and Letter (793 KB | 35 pages)Get Adobe® Reader®

Activity:  5822 views
Comments:  

Before you start

WebSphere Information Integrator OmniFind Edition 8.2.2 enables a new search paradigm, called semantic search. Semantic search allows users to query for concepts and relationships instead of just keywords. This is done by analyzing the document text and storing these analysis results in a semantic search index. Semantic search queries can access these analysis results to enable search for higher-level concepts that are not present in the actual document text.

This tutorial shows search administrators or search application developers how to develop and deploy a semantic search solution, based on a police station scenario. It guides through the the steps involved in deploying custom text analysis logic in enterprise search, and how to use the analysis results in queries to improve search results.

Prerequisites

To run the examples in this tutorial, you'll need the following:

  • A running WebSphere® Information Integrator OmniFind Edition V8.2.2 installation
  • Administrator access to the enterprise search administration console
  • The OmniFind sample search application deployed and running in enterprise search
  • The sample zip file called OFSamples.zip, bundled with this tutorial
  • An internet browser

This tutorial may be run using Windows® or UNIX® operating systems.

Part II of the tutorial is a follow-on of Part I, and hence requires you to have carried out the steps described in Part I. Part III is a follow-on of Part II.

You need about 30 minutes to complete Part I of the tutorial, about 50 minutes for Part II, and another 20 for Part III.

Back to top

Preparing the environment

Before you can begin the tutorial, carry out the following steps:

  1. Unzip the ZIP archive called OFSamples.zip to a directory of your choice. It will create an OFSample subdirectory.
  2. Make sure the sample data folder can be accessed by an OmniFind filesystem crawler later on. For example,copy the directory to the crawler node of your OmniFind installation.

In this example, the sampledata directory is copied to /home/esadmin/sampledata on Linux and D:\sampledata on Windows systems. The other folders contained in OFsample.zip, uc1, uc2 and uc3, contain code and descriptors necessary for the three sections of the tutorial. You do not have to copy these folders to your OmniFind installation.

To be able to run the three parts of the tutorial, be sure you have the required OmniFind access rights to create components, such as collections and crawlers.

1 of 9 | Next

Comments

Back to top

Close [x]

Help: Update or add to My dW interests

What's this?

This little timesaver lets you update your My developerWorks profile with just one click! The general subject of this content (AIX and UNIX, Information Management, Lotus, Rational, Tivoli, WebSphere, Java, Linux, Open source, SOA and Web services, Web development, or XML) will be added to the interests section of your profile, if it's not there already. You only need to be logged in to My developerWorks.

And what's the point of adding your interests to your profile? That's how you find other users with the same interests as yours, and see what they're reading and contributing to the community. Your interests also help us recommend relevant developerWorks content to you.

View your My developerWorks profile

Return from help

Close [x]

Help: Remove from My dW interests

What's this?

Removing this interest does not alter your profile, but rather removes this piece of content from a list of all content for which you've indicated interest. In a future enhancement to My developerWorks, you'll be able to see a record of that content.

View your My developerWorks profile

Return from help

static.content.url=http://www.ibm.com/developerworks/js/artrating/
SITE_ID=1
Zone=Information Management, WebSphere
ArticleID=140778
TutorialTitle=Semantic search in WebSphere II OmniFind Edition: Deploy a semantic search solution
publish-date=08042005
author1-email=thomas.hampp@de.ibm.com
author1-email-cc=thomas.hampp@de.ibm.com
author2-email=alexlang@de.ibm.com
author2-email-cc=alexlang@de.ibm.com

Table of contents

1 of 9 | Next

Local resources

Tags

Help
Use the search field to find all types of content in My developerWorks with that tag.

Use the slider bar to see more or fewer tags.

Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere).

My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

Use the search field to find all types of content in My developerWorks with that tag. Popular tags shows the top tags for this particular content zone (for example, Java technology, Linux, WebSphere). My tags shows your tags for this particular content zone (for example, Java technology, Linux, WebSphere).

 

Dig deeper into Information Management on developerWorks

Try IBM PureSystems. No charge.

IBM PureSystems on a kaleideoscope background

Experience today!

Get started with the cloud-based trial and pattern development kit.

Share this page:

  • Close [x]

Follow developerWorks:

  • Close [x]