Bioinformatics: Offline Knowledge Management tool

Created a global information management application that mines and collect information about scientific research conducted on a specific topic using associated keywords. It produces name of the scientist, institution, and research topic and contact information and provides hyperlink to the synopsis of research projects and /or research publications. It also displays the federal fund available to support research in the lab.

Client Details
A Leading consulting services company with expertise and experience in computational biology and bioinformatics.

Project Brief
Client needed a product which could search online medical journals, fetch user filtered data and create a knowledge repository on the user's local machine for user specified areas.

Challenges

Crawl and retrieve data from n number of online publications
Diverse search patterns and display formats.
Possibility of getting blocked by medical journals
Replicating a user's behavior for submitting search forms on the medical journals.

Solution

Developed a generic object model for crawling and retrieval of data
Templatised journal structures allowing addition of a new journal without any additional effort
Multi-threaded crawling model with configurable throttle time for eliminating being blocked by medical journals

Technology
C# & SQL Express (Personal Edition of MS SQL Server)