Topic
  • 1 reply
  • Latest Post - ‏2008-09-18T10:32:48Z by SystemAdmin
dougspadotto
dougspadotto
146 Posts

Pinned topic Form based authentication and forwarding

‏2008-09-17T18:47:11Z |
Hello,

I've a situation where my crawler needs to get a page that is protected by form-based authentication.

The problem is that pages that require login are returning with code 302 (Found). I traced using the LiveHTTP headers plugin on Firefox, and found this out:
1) this is the form ACTION
https://w3.tap.ibm.com/com.ibm.ram/j_security_check

POST /com.ibm.ram/j_security_check HTTP/1.1
Content-Length: 69
j_username=secret&j_pass=secret&cmdSubmit=Log+In
HTTP/1.x 302 Found


2) this is an INTERMEDIARY page
https://w3.tap.ibm.com/com.ibm.ram/secure/loginProxy.faces?origin=/assetDetail/generalDetails.faces&v=1.0&guid=%7BA191D2B1-F729-8055-8A3D-750898BE417F%7D

GET /com.ibm.ram/secure/loginProxy.faces?origin=/assetDetail/generalDetails.faces&v=1.0&guid=%7BA191D2B1-F729-8055-8A3D-750898BE417F%7D HTTP/1.1
Referer: https://w3.tap.ibm.com/com.ibm.ram/login.jsp

HTTP/1.x 302 Found
Connection: Keep-Alive
Proxy-Connection: Keep-Alive
Via: HTTP/1.1 edge102.ihe.ibm.com (IBM-PROXY-WTE)


3) this is the actual CONTENT
https://w3.tap.ibm.com/com.ibm.ram/assetDetail/generalDetails.faces?v=1.0&guid=%7BA191D2B1-F729-8055-8A3D-750898BE417F%7D

GET /com.ibm.ram/assetDetail/generalDetails.faces?v=1.0&guid=%7BA191D2B1-F729-8055-8A3D-750898BE417F%7D HTTP/1.1

HTTP/1.x 200 OK
Connection: Keep-Alive
Proxy-Connection: Keep-Alive
Via: HTTP/1.1 edge102.ihe.ibm.com (IBM-PROXY-WTE)

It seems that OmniFind only gets to page 2 and returns that return code. Is there something I can do without resorting to prefetch plugins?

Or, if prefetch plugins are needed, anyone has a sample (the one in an article in devworks doesn't handle 302s nicely).

Thanks in advance,

Douglas
Updated on 2008-09-18T10:32:48Z at 2008-09-18T10:32:48Z by SystemAdmin
  • SystemAdmin
    SystemAdmin
    2014 Posts

    Re: Form based authentication and forwarding

    ‏2008-09-18T10:32:48Z  
    Hello Douglas,
    I checked your login page "https://w3.tap.ibm.com/com.ibm.ram/login.jsp" and saw the form name is null, Omnifind maybe not support.
    If you want to use prefetch plugins, You can refer to http://www-128.ibm.com/developerworks/db2/library/techarticle/dm-0707nishitani/.